Files
PaperClipAI/ui/src/pages/apps/chat/GitHubBotManagement.test.tsx
T
DottaandPaperclip ed2c22ea8c feat(connections): simplify dedicated GitHub App setup (#15416)
## Thinking Path

> - Paperclip manages agent work and the tools each agent can use.
> - GitHub bots need their own App identity and restricted repository
access.
> - Manual App configuration and repeated setup gates make that
connection hard to finish.
> - GitHub can create an App from a manifest, but people must approve
creation and repository access.
> - Each Paperclip stack should own configuration, credentials,
signature verification, and task admission.
> - This change uses Cloud as an encrypted callback and event gateway,
then completes setup in the stack.
> - GitHub review bots have their own experimental setting. Chat
connector opt-in does not control them.

## Linked Issues or Issue Description

**What existing behavior does this improve?**

Dedicated GitHub App setup, bot settings, and task-scoped GitHub
replies.

**Current behavior**

Users must configure an App, copy credentials, repeat repository
selection, and complete manual verification gates. Review settings are
hard to scan. Mentions in descriptions can be missed, and automatic
completion text can produce an extra GitHub comment.

**Proposed behavior**

Choose an agent and connect GitHub under a personal account or
organization. GitHub asks for creation and installation consent.
Paperclip resumes the same draft, stores secrets locally, imports
access, verifies delivery, and opens Settings. Each accepted request has
one editable App-owned comment for progress and results. Review
assessments produce deterministic checks for the reviewed commit.

**Breaking changes**

GitHub bots require their own default-off experimental opt-in. The
setup-method and delegated-agent screens are removed. Per-person
automatic-run flags remain readable but are replaced by author filters.
Existing connections, direct webhooks, saved restrictions, and manual
existing-App recovery remain supported.

Companion gateway:
https://github.com/paperclipai/paperclip-cloud/pull/688 (merged). The
roadmap and related PRs were checked; no duplicate dedicated-App wizard
was found.

## What Changed

- Add an independent **GitHub review bots** setting across the catalog,
routes, identity admission, and task controls. Existing bots continue
running when the UI setting is off.
- Replace setup with Choose agent and Connect GitHub. Support personal
and organization owners, inline low-trust conversion, saved drafts,
known organization suggestions, automatic completion, and same-App
recovery.
- Keep manifests, OAuth PKCE, credential exchange, vault storage,
installation verification, and original webhook-signature validation in
the stack. Use the Cloud sealed gateway for public callbacks and
outbound local delivery.
- Add resumable owner metadata in migration 0323. Retry a failed
registration renewal through the same durable replacement rather than
creating another App route.
- Support authorized mentions in issue and PR bodies, comments, inline
comments, and review summaries. Preserve attachments, edited-source
identity, duplicate protection, and lifecycle invalidation. Filter
requests explicitly addressed to another connected bot.
- Give agents task-scoped review, comment, and update tools. Update one
working comment through progress and final output. Close coalesced
requests and recover delayed acknowledgements, including deleted earlier
working comments. Preserve automatic replies for legacy connections
without saved review configuration. Preserve partial publication
evidence and quarantine uncertain automatic fallbacks without blocking
Board messages or questions.
- Reorganize Settings and Access with rich slash-skill instructions,
numeric passing scores, clear automation controls, formal-review
tooltips, member and contributor sections, and verified App branding
links. Preserve invalid score drafts and automation choices across tabs.
- Paginate repositories in 20-row batches with search and a true
connection-wide toggle. Batch verification at GitHub's 500-ID token
limit. Keep saved repository overrides while hiding their editor.
- Give each review a detail URL that remains usable beyond the newest
100 records. Synchronize the manager OpenAPI contracts and add recovery,
authorization, UI, and browser regressions.
- Reconcile the current master branch and retain its agent avatar,
feature catalog, and extracted heartbeat preparation code. Preserve a
saved test-drive port and recover from an occupied high port.

## Verification

- Focused UI, independent experimental-setting, and CLI tests: 199
passed.
- `pnpm -r typecheck`, `pnpm build`, and `pnpm check:token-gates`
passed. The broad local Vitest attempt was interrupted after resource
timeouts and stale expectations; the affected regressions passed focused
reruns. The latest-head full CI matrix passed, including all browser
shards, server/chat suites, builds, typechecking, canary packaging, and
Docker context integrity. A Docker Hub 429 required a CI retry; it
passed without changing the code.
- Final review repairs: 127 attachment/event tests and server typecheck
passed. All 13 final integration regressions passed under the normal CI
timeout, covering legacy reply compatibility, deleted coalesced
comments, inline-only review completion, progress edits, and native
final recovery. Restart-safe description/review attachments passed the
attachment suite.
- Final regressions: four reply/lifecycle tests, both native GitHub wait
tests, 171 feature-gate/reply-contract tests, the routed review preview,
and five scheduler/reply regressions passed. The final fixture repair
also passed all six setup-continuation cases and all three complete
chat-test shards in CI, covering terminal receipts and retries under the
normal CI timeout. One loaded-host receipt run exceeded its local
timeout; the exact case passed in an isolated rerun and the complete CI
shard.
- GitHub integration tests cover personal and organization setup, retry
recovery, edited mentions, attachment provenance, coalesced requests,
delayed acknowledgements, partial review writes, old review URLs, and
company boundaries.
- Browser qualification: both GitHub journeys, all five provider
setup/management journeys, and the GitHub uncertain-send recovery
journey passed. GitHub setup, reconnect, and task replies run with chat
disabled; chat enabled alone cannot expose GitHub bots. The disposable
qualification database was removed after testing.
- Earlier live qualification verified App-owned issue replies, native
slash-skill invocation, progress comment edits, and a 5/5 PR review with
a passing current-head check in the dedicated permissions-smoke
repository. These live checks did not use personal credentials as bot
execution authority.

## Risks

- Deploy the merged Cloud gateway protocol before the stack update. Each
callback and encrypted event must retain the original instance and
tenant binding.
- Migration 0323 uses idempotent column additions for test installations
that already applied the earlier draft migration number.
- A verified connection does not prove runtime isolation or a completed
review. Runtime checks remain separate.
- Required merge checks must be configured in GitHub. A passing numeric
score does not formally approve a PR; approval and request-changes tools
remain opt-in.
- Existing-App credentials cannot silently renew an uncertain manifest
exchange. Recovery preserves the existing App, draft, connection, and
agent.
- Repository changes save immediately. Global toggles affect all
currently available repositories, including unloaded rows, without
granting new installation access.
- A failed or uncertain tool write suppresses automatic fallback text;
the governed outbox retains its evidence. Deleted or replaced response
comments are not recreated through a personal credential fallback.
- GitHub logo upload remains an optional human action in GitHub App
settings. Runtime provisioning, delegated setup, screenshot publication,
and production push delivery remain deferred.

## Model Used

OpenAI Codex, based on GPT-6, with tool use and code execution. The
exact runtime model identifier and context size are not exposed in this
session.

## Checklist

- [x] I have included a thinking path that traces from project context
to this change
- [x] I have specified the model used (with version and capability
details)
- [x] I have checked ROADMAP.md and confirmed this PR does not duplicate
planned core work
- [x] I have searched GitHub for duplicate or related PRs and linked
them above
- [x] I have either (a) linked existing issues with `Fixes: #` / `Closes
#` / `Refs #` OR (b) described the issue in-PR following the relevant
issue template
- [x] I have not referenced internal/instance-local Paperclip issues or
links (only public GitHub references)
- [x] My branch name describes the change and contains no internal
Paperclip ticket id or instance-derived details
- [x] I have run tests locally and they pass (focused suites; complete
test matrix is checked in CI)
- [x] I have added or updated tests where applicable
- [x] I have updated relevant documentation to reflect my changes
- [x] I have considered and documented any risks above
- [x] All Paperclip CI gates are green
- [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups
- [x] I will address all Greptile and reviewer comments before
requesting merge

---------

Co-authored-by: Paperclip <noreply@paperclip.ing>
2026-10-09 17:01:20 -05:00

733 lines
31 KiB
TypeScript
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
// @vitest-environment jsdom
import { act } from "react";
import { createRoot, type Root } from "react-dom/client";
import { QueryClient, QueryClientProvider } from "@tanstack/react-query";
import { afterEach, beforeEach, describe, expect, it, vi } from "vitest";
import {
defaultGitHubReviewPolicy,
buildSkillMentionHref,
type GitHubChatConfiguration,
type GitHubTaskReview,
} from "@paperclipai/shared";
import { ChatEndpointDetail } from "./ChatEndpointDetail";
import { GitHubReviewList, orderedGitHubReviews } from "./GitHubBotManagement";
import { GitHubPolicyEditor } from "./GitHubBotConfiguration";
import { conversationDestination } from "./ChatConversationList";
import { queryKeys } from "@/lib/queryKeys";
import { TooltipProvider } from "@/components/ui/tooltip";
import { gitHubAppSettingsUrl, gitHubBotMention } from "./GitHubAppIdentity";
import type { ChatEndpoint } from "@/api/chatEndpoints";
const mocks = vi.hoisted(() => ({
tab: "settings",
reviewId: undefined as string | undefined,
get: vi.fn(),
config: vi.fn(),
save: vi.fn(),
resources: vi.fn(),
repositoryPage: vi.fn(),
toggleAll: vi.fn(),
updateResources: vi.fn(),
reviews: vi.fn(),
review: vi.fn(),
members: vi.fn(),
links: vi.fn(),
setBreadcrumbs: vi.fn(),
}));
vi.mock("@/api/githubChat", () => ({
githubChatApi: {
configuration: mocks.config,
save: mocks.save,
reviews: mocks.reviews,
review: mocks.review,
repositories: mocks.repositoryPage,
toggleAllRepositories: mocks.toggleAll,
},
}));
vi.mock("@/api/chatEndpoints", () => ({
chatEndpointsApi: {
get: mocks.get,
listResources: mocks.resources,
updateResources: mocks.updateResources,
listPrincipals: mocks.links,
},
}));
vi.mock("@/api/access", () => ({ accessApi: { listMembers: mocks.members } }));
vi.mock("@/api/agents", () => ({ agentsApi: { get: vi.fn() } }));
vi.mock("@/context/BreadcrumbContext", () => ({
useBreadcrumbs: () => ({ setBreadcrumbs: mocks.setBreadcrumbs }),
}));
vi.mock("@/context/CompanyContext", () => ({
useOptionalCompany: () => ({ companies: [{ id: "company", name: "Acme Research" }], selectedCompany: { id: "other", name: "Wrong company" } }),
}));
vi.mock("@/context/ToastContext", () => ({
useToast: () => ({ pushToast: vi.fn() }),
}));
vi.mock("@/components/MarkdownBody", () => ({
MarkdownBody: ({ children }: { children: React.ReactNode }) => (
<div>{children}</div>
),
}));
// Exercise settings persistence through the shared editor contract. The editor's
// rich rendering and slash picker have their own tests and a live walkthrough.
vi.mock("@/components/MarkdownEditor", () => ({
MarkdownEditor: ({ value, onChange, ariaLabel, placeholder, readOnly }: {
value: string; onChange: (value: string) => void; ariaLabel: string; placeholder?: string; readOnly?: boolean;
}) => <textarea aria-label={ariaLabel} placeholder={placeholder} value={value} readOnly={readOnly}
onChange={(event) => onChange(event.target.value)} />,
}));
vi.mock("@/lib/router", () => ({
useParams: () => ({
endpointId: "bot",
tab: mocks.tab,
reviewId: mocks.reviewId,
}),
useNavigate: () => vi.fn(),
useLocation: () => ({ state: null }),
Link: ({
children,
to,
...props
}: React.ComponentProps<"a"> & { to: string }) => (
<a href={to} {...props}>
{children}
</a>
),
Navigate: () => null,
}));
const endpoint = {
id: "bot",
companyId: "company",
provider: "github",
assignedAgentId: "agent",
assignedAgentName: "Maya",
status: "active",
allowUnlinkedPeople: false,
setup: { step: "complete" },
};
const base: GitHubChatConfiguration = {
version: 1,
toolsEnabled: true,
responsibleUserId: "member",
memberAccess: "selected",
people: [
{
kind: "member",
userId: "member",
githubUserId: "42",
login: "maya",
automaticReviews: true,
},
],
defaults: {
...defaultGitHubReviewPolicy(),
instructions: "Keep existing instructions",
issueOpened: true,
},
repositories: {},
};
describe("GitHub bot management", () => {
let root: Root;
let container: HTMLDivElement;
let client: QueryClient;
beforeEach(() => {
vi.clearAllMocks();
mocks.tab = "settings";
mocks.reviewId = undefined;
mocks.get.mockResolvedValue(endpoint);
mocks.config.mockResolvedValue({
revision: 4,
configuration: structuredClone(base),
});
mocks.resources.mockResolvedValue([
{
id: "repo",
type: "repository",
label: "acme/web",
enabled: true,
availability: "available",
metadata: { providerRepositoryId: "100" },
},
]);
mocks.repositoryPage.mockImplementation(async () => ({
items: await mocks.resources(), nextOffset: null, totalCount: 1, enabledCount: 1, availableCount: 1,
}));
mocks.toggleAll.mockResolvedValue({ success: true });
mocks.links.mockResolvedValue([
{
id: "link",
principalId: "identity",
status: "linked",
githubUserId: "42",
githubLogin: "maya",
paperclipUserId: "member",
paperclipUserLabel: "Maya",
},
]);
mocks.members.mockResolvedValue({
members: [
{
principalId: "member",
status: "active",
membershipRole: "owner",
user: { name: "Maya" },
},
],
});
mocks.reviews.mockResolvedValue([]);
mocks.save.mockImplementation(async (_id, revision, configuration) => ({
revision: revision + 1,
configuration,
}));
mocks.updateResources.mockResolvedValue([]);
client = new QueryClient({
defaultOptions: { queries: { retry: false, staleTime: Infinity } },
});
client.setQueryData(queryKeys.agents.detail("agent"), {
id: "agent",
name: "Maya",
});
container = document.createElement("div");
document.body.append(container);
root = createRoot(container);
});
afterEach(async () => {
await act(async () => root.unmount());
client.clear();
container.remove();
vi.unstubAllGlobals();
});
async function render(tab = mocks.tab) {
mocks.tab = tab;
await act(async () =>
root.render(
<QueryClientProvider client={client}>
<TooltipProvider>
<ChatEndpointDetail />
</TooltipProvider>
</QueryClientProvider>,
),
);
await vi.waitFor(() =>
expect(
container.querySelector(
'textarea[placeholder="What should this agent do on GitHub?"]',
) || container.querySelector('[aria-label="Allow mentions from all linked members"]'),
).not.toBeNull(),
);
}
async function click(name: string) {
const target = [...container.querySelectorAll("button")].find(
(b) =>
b.getAttribute("aria-label") === name || b.textContent?.trim() === name,
);
expect(target).toBeDefined();
await act(async () => target!.click());
}
async function input(
element: HTMLTextAreaElement | HTMLSelectElement | HTMLInputElement,
value: string,
) {
await act(async () => {
Object.getOwnPropertyDescriptor(
element instanceof HTMLTextAreaElement
? HTMLTextAreaElement.prototype
: element instanceof HTMLSelectElement ? HTMLSelectElement.prototype : HTMLInputElement.prototype,
"value",
)!.set!.call(element, value);
element.dispatchEvent(
new Event(element instanceof HTMLSelectElement ? "change" : "input", {
bubbles: true,
}),
);
});
}
it("loads repositories 20 at a time, searches all pages, and toggles the full connection", async () => {
let enabled = true;
const all = Array.from({ length: 1000 }, (_, index) => ({
id: `repo-${index}`, type: "repository", providerResourceId: `acme/repo-${index}`,
label: `acme/repo-${String(index).padStart(4, "0")}`, availability: "available", enabled: true,
}));
mocks.repositoryPage.mockImplementation(async (_id, { offset, search, limit }) => {
const filtered = all.filter((row) => row.label.includes(search));
return { items: filtered.slice(offset, offset + limit).map((row) => ({ ...row, enabled })),
nextOffset: offset + limit < filtered.length ? offset + limit : null,
totalCount: 1000, enabledCount: enabled ? 1000 : 0, availableCount: 1000 };
});
mocks.toggleAll.mockImplementation(async (_id, value) => { enabled = value; return { success: true }; });
await render("access");
await vi.waitFor(() => expect(container.querySelectorAll('[role="region"] [role="switch"]')).toHaveLength(20));
expect(mocks.repositoryPage).toHaveBeenCalledWith("bot", { offset: 0, limit: 20, search: "" });
await click("Load more repositories");
await vi.waitFor(() => expect(container.querySelectorAll('[role="region"] [role="switch"]')).toHaveLength(40));
const search = container.querySelector('input[aria-label="Search repositories"]') as HTMLInputElement;
await input(search, "0999");
await vi.waitFor(() => expect(container.querySelectorAll('[role="region"] [role="switch"]')).toHaveLength(1));
expect(container.textContent).toContain("acme/repo-0999");
expect(container.textContent).toContain("1000 of 1000 repositories enabled");
await click("Disable all repositories");
await vi.waitFor(() => expect(container.textContent).toContain("0 of 1000 repositories enabled"));
expect(mocks.toggleAll).toHaveBeenCalledWith("bot", false);
expect(mocks.updateResources).not.toHaveBeenCalled();
await click("Enable all repositories");
await vi.waitFor(() => expect(container.textContent).toContain("1000 of 1000 repositories enabled"));
expect(mocks.toggleAll).toHaveBeenLastCalledWith("bot", true);
await input(search, "does-not-exist");
await vi.waitFor(() => expect(container.textContent).toContain("No repositories match your search"));
expect(container.querySelector('button[aria-label="Disable all repositories"]')?.hasAttribute("disabled")).toBe(false);
});
it("keeps repository failures visible and allows a retry", async () => {
mocks.repositoryPage.mockRejectedValueOnce(new Error("Unavailable"));
await render("access");
await vi.waitFor(() => expect(container.textContent).toContain("Could not load repositories"));
await click("Try again");
await vi.waitFor(() => expect(container.querySelectorAll('[role="region"] [role="switch"]')).toHaveLength(1));
expect(container.textContent).not.toContain("Could not load repositories");
});
it("automatically loads the next 20 repositories when the scroll sentinel becomes visible", async () => {
let intersect!: IntersectionObserverCallback;
vi.stubGlobal("IntersectionObserver", class {
constructor(callback: IntersectionObserverCallback) { intersect = callback; }
observe() {}
disconnect() {}
});
mocks.repositoryPage.mockImplementation(async (_id, { offset }) => ({
items: Array.from({ length: 20 }, (_, index) => ({
id: `repo-${offset + index}`, label: `acme/repo-${offset + index}`,
enabled: true, availability: "available", type: "repository",
})),
nextOffset: offset === 0 ? 20 : null, totalCount: 40, enabledCount: 40, availableCount: 40,
}));
await render("access");
await vi.waitFor(() => expect(intersect).toBeDefined());
await act(async () => intersect([{ isIntersecting: true } as IntersectionObserverEntry], {} as IntersectionObserver));
await vi.waitFor(() => expect(container.querySelectorAll('[role="region"] [role="switch"]')).toHaveLength(40));
expect(mocks.repositoryPage).toHaveBeenLastCalledWith("bot", { offset: 20, limit: 20, search: "" });
});
it("shows the verified custom App mention and its own organization branding settings", async () => {
const branded: ChatEndpoint = {
...endpoint,
provider: "github",
status: "active",
botLabel: "Maya Reviews",
botUsername: "maya-reviews[bot]",
providerAccountLabel: "acme",
setup: {
step: "complete",
github: {
stage: "verify",
appOwnerType: "organization",
appOwnerLogin: "acme",
appSlug: "old-draft-name",
},
},
};
mocks.get.mockResolvedValue(branded);
await render();
expect(
container.querySelector('button[aria-label="Copy GitHub mention"]')
?.textContent,
).toBe("@maya-reviews");
expect(container.textContent).toContain("Maya Reviews");
const branding = [...container.querySelectorAll("a")].find((a) =>
a.getAttribute("aria-label") === "Edit App name and logo on GitHub",
);
expect(branding?.href).toBe(
"https://github.com/organizations/acme/settings/apps/maya-reviews",
);
expect(
container.querySelector("a[download]")?.getAttribute("download"),
).toBe("Maya-Reviews-avatar.png");
expect(mocks.save).not.toHaveBeenCalled();
expect(
gitHubAppSettingsUrl({
...branded,
setup: {
step: "complete",
github: { stage: "verify", appOwnerType: "personal" },
},
}),
).toBe("https://github.com/settings/apps/maya-reviews");
expect(
gitHubAppSettingsUrl({ ...branded, setup: { step: "complete" } }),
).toBe("https://github.com/settings/apps");
expect(gitHubBotMention({ botUsername: null })).toBeNull();
});
it("keeps one draft across Settings, Access, and read-only tabs, then saves with the original revision", async () => {
await render();
await input(container.querySelector("textarea")!, "Edited instructions");
await render("access");
await click("Allow mentions from all linked members");
await render("reviews");
await render("settings");
expect(container.querySelector("textarea")?.value).toBe(
"Edited instructions",
);
expect(mocks.save).not.toHaveBeenCalled();
await click("Save changes");
await vi.waitFor(() => expect(mocks.save).toHaveBeenCalledTimes(1));
const [id, revision, saved] = mocks.save.mock.calls[0];
expect(id).toBe("bot");
expect(revision).toBe(4);
expect(saved).toEqual({
...base,
defaults: { ...base.defaults, instructions: "Edited instructions" },
memberAccess: "all_linked",
});
await vi.waitFor(() =>
expect(container.textContent).toContain("Changes saved."),
);
expect(
[...container.querySelectorAll("button")].some(
(b) => b.textContent === "Save changes",
),
).toBe(false);
});
it("retains a rejected draft and lets the user discard it", async () => {
mocks.save.mockRejectedValue(
new Error("Configuration changed. Reload before saving."),
);
await render();
await input(container.querySelector("textarea")!, "Unsaved");
await click("Save changes");
await vi.waitFor(() =>
expect(container.querySelector('[role="alert"]')?.textContent).toContain(
"Configuration changed",
),
);
expect(container.querySelector("textarea")?.value).toBe("Unsaved");
await click("Discard changes");
expect(container.querySelector("textarea")?.value).toBe(
base.defaults.instructions,
);
expect(container.querySelector('[role="alert"]')).toBeNull();
});
it("saves repository restrictions separately without touching the behavior draft", async () => {
await render();
await input(container.querySelector("textarea")!, "Unsaved behavior");
await render("access");
await vi.waitFor(() => expect(container.querySelector('button[aria-label="acme/web"]')).not.toBeNull());
await click("acme/web");
await vi.waitFor(() =>
expect(mocks.updateResources).toHaveBeenCalledWith("bot", [
{ id: "repo", enabled: false },
]),
);
expect(mocks.save).not.toHaveBeenCalled();
await render("settings");
expect(container.querySelector("textarea")?.value).toBe("Unsaved behavior");
});
it("hides repository overrides while preserving saved overrides when other settings change", async () => {
const overrides = { "100": { instructions: "Retain repository guidance", events: ["opened"] } };
mocks.config.mockResolvedValue({
revision: 4,
configuration: { ...base, repositories: overrides },
});
await render();
expect(container.textContent).not.toContain("Repository overrides");
expect(container.querySelector("#github-policy-repository")).toBeNull();
expect(mocks.resources).not.toHaveBeenCalled();
await input(container.querySelector("textarea")!, "Updated default instructions");
await click("Save changes");
await vi.waitFor(() => expect(mocks.save).toHaveBeenCalled());
const saved = mocks.save.mock.calls[0][2];
expect(saved.defaults.instructions).toBe("Updated default instructions");
expect(saved.repositories).toEqual(overrides);
});
it("names the endpoint company and omits per-person automatic switches", async () => {
mocks.config.mockResolvedValue({ revision: 4, configuration: { ...base, memberAccess: "all_linked", people: [] } });
await render("access");
await vi.waitFor(() => expect(container.textContent).toContain("@maya"));
expect(container.textContent).toContain("Includes members from Acme Research who link their GitHub account later.");
expect(container.textContent).not.toContain("Wrong company");
expect(container.querySelector('[aria-label="Run automatically for @maya"]')).toBeNull();
await click("Allow mentions from all linked members");
await click("Allow mentions from @maya");
await click("Save changes");
expect(mocks.save.mock.calls[0][2].people).toEqual([{ kind: "member", userId: "member", githubUserId: "42", login: "maya" }]);
});
it("does not show an off switch or silently enable a retained disabled bot", async () => {
mocks.config.mockResolvedValue({
revision: 4,
configuration: { ...base, toolsEnabled: false },
});
await render("access");
expect(
container.querySelector('[aria-label="Use this bot’s GitHub tools"]'),
).toBeNull();
expect(container.textContent).toContain("cannot start work or respond");
await render("settings");
await input(container.querySelector("textarea")!, "Edited instructions");
await click("Save changes");
await vi.waitFor(() => expect(mocks.save).toHaveBeenCalled());
expect(mocks.save.mock.calls[0][2].toolsEnabled).toBe(false);
});
it("loads a direct review URL and keeps unknown reviews within the current connection", async () => {
mocks.reviewId = "review-1";
mocks.reviews.mockResolvedValue([]);
mocks.review.mockImplementation(async (_endpoint, id) => {
if (id !== "review-1") throw new Error("not found");
return review("review-1", "repo", 1, "2026-10-07T10:00:00Z");
});
await render("reviews");
await vi.waitFor(() =>
expect(container.textContent).toContain(
"No assessment has been submitted yet.",
),
);
expect(
container.querySelector('a[href="/apps/chat/bot/reviews"]')?.textContent,
).toContain("All reviews");
mocks.reviewId = "foreign";
await render("reviews");
await vi.waitFor(() =>
expect(container.textContent).toContain("not found in this connection"),
);
expect(container.textContent).not.toContain(
"No assessment has been submitted yet.",
);
});
it("keeps saved automatic triggers when changing to mentions-only", async () => {
const change = vi.fn();
await act(async () =>
root.render(
<TooltipProvider>
<GitHubPolicyEditor policy={base.defaults} onChange={change} />
</TooltipProvider>,
),
);
await click("Run automatically");
expect(change.mock.calls[0][0]).toEqual({
...base.defaults,
invocation: "mentions_only",
});
});
it("keeps external-author mode and event choices when automatic runs are switched off and back on", async () => {
mocks.config.mockResolvedValue({ revision: 4, configuration: { ...base, defaults: { ...base.defaults, invocation: "allowed_authors" } } });
await render();
await click("Run automatically");
await click("Run automatically");
expect(container.querySelector('[aria-label="Save changes"]')).toBeNull();
await input(container.querySelector("textarea")!, "Still keep the same audience");
await click("Save changes");
expect(mocks.save.mock.calls[0][2].defaults).toEqual({ ...base.defaults, invocation: "allowed_authors", instructions: "Still keep the same audience" });
});
it("preserves an invalid score across Access and Settings without saving a stale value", async () => {
await render();
await input(container.querySelector('input[type="number"]')!, "6");
await render("access");
expect([...container.querySelectorAll("button")].find(b => b.textContent === "Save changes")?.disabled).toBe(true);
await render("settings");
expect(container.querySelector<HTMLInputElement>('input[type="number"]')!.value).toBe("6");
await click("Discard changes");
expect(container.querySelector<HTMLInputElement>('input[type="number"]')!.value).toBe("5");
expect(mocks.save).not.toHaveBeenCalled();
});
it("remembers external-author automation across tab changes", async () => {
mocks.config.mockResolvedValue({ revision: 4, configuration: { ...base, defaults: { ...base.defaults, invocation: "allowed_authors" } } });
await render(); await click("Run automatically");
await render("access"); await render("settings"); await click("Run automatically");
await input(container.querySelector("textarea")!, "Updated");
await click("Save changes");
expect(mocks.save.mock.calls[0][2].defaults.invocation).toBe("allowed_authors");
});
it("makes common and event instruction editors read-only throughout a pending save", async () => {
let finish!: (value: unknown) => void;
mocks.save.mockImplementation(() => new Promise(resolve => { finish = resolve; }));
await render();
await input(container.querySelector("textarea")!, "Saved instructions");
await act(async () => [...container.querySelectorAll("summary")].find(s => s.textContent?.includes("Event-specific instructions"))!.click());
await click("Save changes");
expect([...container.querySelectorAll<HTMLTextAreaElement>("textarea[aria-label]")].every(editor => editor.readOnly)).toBe(true);
await act(async () => { finish({ revision: 5, configuration: { ...base, defaults: { ...base.defaults, instructions: "Saved instructions" } } }); });
expect(container.querySelector("textarea")!.readOnly).toBe(false);
});
it("defaults to a typed score of 5 and preserves report-only and other review decisions", async () => {
await render();
const score = container.querySelector<HTMLInputElement>('input[type="number"]')!;
expect(score.value).toBe("5");
expect(container.querySelector('input[type="range"]')).toBeNull();
await input(score, "3");
await click("Save changes");
expect(mocks.save.mock.calls[0][2].defaults).toEqual({ ...base.defaults, ratingThreshold: 3 });
await click("Report only");
await click("Save changes");
expect(mocks.save.mock.calls[1][2].defaults.ratingThreshold).toBeNull();
expect(score.disabled).toBe(true);
await click("Report only");
expect(score.value).toBe("5");
});
it.each(["", "0", "6", "2.5"])("does not save an invalid score %s and allows correction or discard", async (value) => {
await render();
const score = container.querySelector<HTMLInputElement>('input[type="number"]')!;
await input(score, value);
expect(container.textContent).toContain("Enter a whole number from 1 to 5.");
await click("Save changes");
expect(mocks.save).not.toHaveBeenCalled();
await input(score, "4");
await click("Save changes");
expect(mocks.save.mock.calls[0][2].defaults.ratingThreshold).toBe(4);
await input(score, value);
await click("Discard changes");
expect(container.querySelector<HTMLInputElement>('input[type="number"]')?.value).toBe("4");
expect(container.querySelector('[role="alert"]')).toBeNull();
});
it("retains a saved report-only policy until the user changes it", async () => {
mocks.config.mockResolvedValue({ revision: 4, configuration: { ...base, defaults: { ...base.defaults, ratingThreshold: null } } });
await render();
expect(container.querySelector<HTMLInputElement>('input[type="number"]')?.disabled).toBe(true);
await input(container.querySelector("textarea")!, "Updated guidance");
await click("Save changes");
expect(mocks.save.mock.calls[0][2].defaults.ratingThreshold).toBeNull();
});
it("turns off selected member access without retaining an authorization entry", async () => {
await render("access");
await vi.waitFor(() => expect(container.querySelector('[aria-label="Allow mentions from @maya"]')?.hasAttribute("disabled")).toBe(false));
await click("Allow mentions from @maya");
expect(container.querySelector('[aria-label="Run automatically for @maya"]')).toBeNull();
await click("Save changes");
expect(mocks.save.mock.calls[0][2].people).toEqual([]);
expect(mocks.save.mock.calls[0][2].memberAccess).toBe("selected");
});
it("keeps automatic runs off when editing member access", async () => {
mocks.config.mockResolvedValue({ revision: 4, configuration: { ...base, defaults: { ...base.defaults, invocation: "mentions_only" } } });
await render("access");
await click("Allow mentions from all linked members");
await click("Save changes");
expect(mocks.save.mock.calls[0][2].defaults.invocation).toBe("mentions_only");
});
it("keeps newlines and commas while editing filters, saves separate entries, and restores discarded values", async () => {
await render();
const paths = container.querySelector<HTMLTextAreaElement>('textarea[id$="github-ignoredPaths"]')!;
await input(paths, "dist/**\n");
expect(paths.value).toBe("dist/**\n");
await input(paths, `${paths.value}vendor/**`);
const categories = container.querySelector<HTMLInputElement>('input[id$="github-categories"]')!;
await input(categories, "security, ");
expect(categories.value).toBe("security, ");
await input(categories, `${categories.value}correctness`);
await click("Save changes");
expect(mocks.save.mock.calls[0][2].defaults.ignoredPaths).toEqual(["dist/**", "vendor/**"]);
expect(mocks.save.mock.calls[0][2].defaults.findingCategories).toEqual(["security", "correctness"]);
await input(paths, "tmp/**");
await click("Discard changes");
expect(container.querySelector<HTMLTextAreaElement>('textarea[id$="github-ignoredPaths"]')?.value).toBe("dist/**\nvendor/**");
});
it("saves skill links in general and event instructions without resetting other guidance", async () => {
await render();
const skill = `[/review](${buildSkillMentionHref("11111111-1111-4111-8111-111111111111", "review")})`;
await input(container.querySelector('textarea[aria-label="Agent instructions"]')!, `Use ${skill}.`);
await input(container.querySelector('select[id$="github-prompt-event"]')!, "mention");
await input(container.querySelector('textarea[aria-label="Mention instructions"]')!, `For mentions, use ${skill}.`);
await input(container.querySelector('select[id$="github-prompt-event"]')!, "issue_opened");
await input(container.querySelector('textarea[aria-label="New issue instructions"]')!, `For issues, use ${skill}.`);
await click("Save changes");
const saved = mocks.save.mock.calls[0][2];
expect(saved.defaults.instructions).toBe(`Use ${skill}.`);
expect(saved.defaults.prompts.mention).toBe(`For mentions, use ${skill}.`);
expect(saved.defaults.issueOpenedInstructions).toBe(`For issues, use ${skill}.`);
expect(saved.defaults.prompts.opened).toBe(base.defaults.prompts.opened);
expect(saved.people).toEqual(base.people);
});
it.each(["mentions_only", "linked_authors", "allowed_authors"] as const)(
"makes mentions explicit in the selected %s mode", async (invocation) => {
await act(async () => root.render(<TooltipProvider>
<GitHubPolicyEditor policy={{ ...base.defaults, invocation }} onChange={() => {}} />
</TooltipProvider>));
expect(container.querySelector('[aria-label="Run automatically"]')?.getAttribute("aria-checked")).toBe(String(invocation !== "mentions_only"));
expect(container.textContent).toContain("Authorized people can always @mention this bot.");
},
);
});
function review(
id: string,
repositoryId: string,
pullNumber: number,
createdAt: string,
updatedAt = createdAt,
) {
return {
id,
repositoryId,
pullNumber,
createdAt,
updatedAt,
repository: "acme/web",
headSha: id,
issueId: "task",
event: { title: "Review focus handling" },
state: "queued",
assessment: null,
conclusion: null,
} as GitHubTaskReview;
}
describe("review history and thread labels", () => {
it("keeps every review in creation order, independent of late updates to an older head", () => {
const old = review(
"old",
"repo",
1,
"2026-10-07T10:00:00Z",
"2026-10-07T14:00:00Z",
);
const current = review("current", "repo", 1, "2026-10-07T11:00:00Z");
const other = review("other", "another-repo", 1, "2026-10-07T12:00:00Z");
expect(orderedGitHubReviews([old, current, other])).toEqual([
other,
current,
old,
]);
});
it("does not present a previous passing score as the pending current commit’s result", async () => {
const old = review("old", "repo", 1, "2026-10-07T10:00:00Z");
old.state = "completed";
old.conclusion = "success";
old.assessment = {
reviewedCommit: "old",
score: 5,
complete: true,
summary: "Previous result",
rationale: "Complete",
findings: [],
coverage: { reviewedPaths: [], omittedPaths: [], limitations: [] },
};
const current = review("current", "repo", 1, "2026-10-07T11:00:00Z");
const container = document.createElement("div");
const root = createRoot(container);
try {
await act(async () =>
root.render(
<GitHubReviewList endpointId="bot" reviews={[old, current]} />,
),
);
const rows = [...container.querySelectorAll("li")];
expect(rows).toHaveLength(2);
expect(rows[0].textContent).toContain("Queued");
expect(rows[0].textContent).not.toContain("5/5");
expect(rows[0].querySelector("a")?.getAttribute("href")).toBe(
"/apps/chat/bot/reviews/current",
);
expect(rows[1].textContent).toContain("5/5 · Passed");
expect(rows[1].querySelector("a")?.getAttribute("href")).toBe(
"/apps/chat/bot/reviews/old",
);
expect(container.querySelector("details")).toBeNull();
} finally {
await act(async () => root.unmount());
}
});
it("identifies GitHub thread numbers while preserving labels for other providers and invalid URLs", () => {
const row = {
externalLabel: "acme/web",
externalUrl: "https://github.com/acme/web/issues/42#issuecomment-1",
} as any;
expect(conversationDestination(row, "github")).toBe("acme/web #42");
expect(conversationDestination(row, "slack")).toBe("acme/web");
expect(
conversationDestination({ ...row, externalUrl: "invalid" }, "github"),
).toBe("acme/web");
});
});