Files
PaperClipAI/ui/src/pages/InstanceExperimentalSettings.test.tsx
T
DottaandPaperclip 0e0b63e5a5 feat(connections): add experimental task-pinned AI routing (#14967)
## Thinking Path

> - Paperclip manages AI agents and their work.
> - AI Connections separate account access from models and harnesses.
> - A pool must act as one connection while retaining each task’s
account.
> - Core must enforce member access and preserve session and recovery
rules.
> - A plugin supplies rotation policy without receiving credentials.
> - This change adds durable routing and native connector setup and
management.

## Linked Issues or Issue Description

**Subsystem affected**

AI Connections, Connectors, plugins, run dispatch, and session
compatibility.

**Problem or motivation**

Operators need to rotate new tasks across saved accounts while each task
keeps its account and session. Pool setup must fit the existing
connector catalog and account workflow.

**Proposed solution**

Add an experimental router binding, a capability-gated plugin hook, and
transactional task pins. Plugins declare native pooled connectors
through `aiConnectionRouter`. Core hosts the existing-account picker,
ordering step, and account settings. Related usage contract: #14936.
Companion private plugin:
https://github.com/paperclipai/paperclip-cloud/pull/643.

**Roadmap alignment**

This extends Apps and AI Connections. Core supplies generic enforcement
and native connector UI; the private plugin owns rotation and quota
policy. The prior duplicate search found no matching router
implementation.

## What Changed

- Add a router binding without changing existing concrete bindings. Keep
the instance flag and new pools disabled by default. Require manual
operator configuration. Show no routing toggle in Experimental settings
on either open-source or Cloud installs, even after routing is enabled.
- Persist company-scoped pools, one shared cursor per pool, and pins
keyed by company, pool, agent, and task. Commit pins and cursor advances
together with revision checks and bounded retries. Persist run-ID
affinity before allocation.
- Pass only authorized metadata and normalized usage to plugins. Core
retains credential handling, member access checks, runtime
qualification, and recovery evidence. Probe outside locks with a shared
15-second budget and freshness cache.
- Resolve routing before credential preparation and backend selection.
Preserve pins through turns, session resets, removed members, and quota
waits. Retain admitted recovery after disable or uninstall.
- Separate credential session epochs from token generations. Verified
refresh preserves the epoch; reconnect and manual replacement change it.
Include the credential slot ID in session and usage-cache identity, so
reconnecting an indexed legacy account invalidates its old session even
when both epochs are zero.
- Validate pool member installations before accepting saved-agent
bindings and recheck compatibility when the harness changes. Install
only authorized members in the new-agent transaction and record their
IDs in local activity. Pool membership cannot install a restricted
shared connection.
- Preserve pool bindings when agents hire teammates through either
creation API or native caller runtime inheritance. Block stale manager
credential references; retain explicit child authentication precedence
and reject incompatible inherited pools.
- Add native connector registration through plugin metadata. Reuse the
Connectors catalog, setup header, account header, sidebar, dialogs, and
usage display. Setup selects and orders saved connections. Advanced
settings hold usage rules and member runtime defaults. New-account setup
opens in another tab.
- Use revision-checked pool archival from the Connectors catalog and
account page. Keep task pins, cursors, recovery evidence, and underlying
connections. Reject ordinary connection updates or removals that bypass
pool revisions.
- Add pool selectors, composer models, override notes, quota status, run
details, activity records, and local run-log records. Keep
session-adoption copy minimal.
- Show **Used by** below the pool connections. List current company
agents with shared avatars and profile links. Include paused agents;
exclude terminated agents and agents using another pool.
- Add Core stories for the generic connector workflow and runtime
surfaces. Cloud stories reuse these production routes and tokens through
a preview-only alias.

## Verification

- Final head `73cb953bca30ed83e4505dd820edd9b5edffd28b`: full workspace
`pnpm -r typecheck`, `pnpm build`, and `pnpm check:token-gates` pass
locally.
- All 422 focused connector/settings/shared-contract/migration tests and
all 156 database-backed AI connection, hiring, reconnect, and
durable-routing cases pass (69 hiring cases rerun after the final
auth-precedence fix). The merged shared contract retains connection
instructions and pool metadata. The pool migration is generated at
sequence 0299 after the latest upstream migrations; this PR makes no
lockfile changes.
- All four full-app Playwright tests pass on the final head after a cold
restart and migration, against the installed private plugin and isolated
database, with no route or pool-API mocks. They cover hidden routing
controls after manual opt-in, native pool creation, ordering, membership
edits, rename, paused defaults, enabling/save/refresh persistence, stale
edits, cancellation/removal, preserved underlying accounts, unavailable
routers, and Used by avatars and profile links. Exact command:
`PAPERCLIP_CONNECTION_POOL_E2E=1
AI_CONNECTIONS_TEST_COMPANY_ID=a37b9625-5ecf-4e29-8081-04df3d6e7d6f
AI_CONNECTIONS_TEST_URL=http://127.0.0.1:3108 pnpm exec playwright test
--config tests/ai-connections-app/playwright.config.ts
connection-pools.spec.ts`.
- [Native setup, ordering, and management
screenshots](https://github.com/paperclipai/paperclip/pull/14967#issuecomment-6006976278)
address the review follow-up. [Earlier selector, quota, and run-detail
screenshots](https://github.com/paperclipai/paperclip/pull/14967#issuecomment-5971537316)
show the runtime surfaces. Core previews: `pnpm --filter @paperclipai/ui
storybook`, then **Connectors / Pool host** or **AI Connections /
Connection pools**. Cloud owns its host-backed plugin stories; both
repositories’ Operator Setup Required story assertions pass.
- Live acceptance used OpenAI/Codex and Anthropic/Claude ACPX, resumed
both exact sessions after restart, preserved pinned accounts through
explicit reset and controlled quota deferral/recovery, and committed
only two allocations across fourteen runs. A later UI-created task test
again rotated OpenAI then Anthropic and resumed OpenAI through
follow-up/restart/quota recovery. That later Anthropic execution was
blocked by its saved OAuth token expiring (provider 401). No live usage
probes ran.
- The full local `pnpm test:run` was attempted earlier and did not
complete because of macOS embedded PostgreSQL bootstrap/shared-memory
failures and the 40,000-file Git fixture timeout. The focused database
suites above now pass; full-suite verification is provided by the split
CI lanes. The preceding CI run had one runtime readiness timeout; it
passes locally both alone and inside the larger runtime suite. That
larger local suite also encountered an embedded PostgreSQL setup failure
and two macOS temporary-path alias assertions; those two assertions pass
with canonical TMPDIR=/private/tmp. All final-head CI checks are
terminal green, including full general/serialized server suites, Runner
checks, browser E2E shards, canary verification, build, and typecheck.
Greptile is 5/5 on that exact head with no unresolved threads.

## Risks

- The migration adds routing tables and a credential epoch column.
Install the private plugin only with the compatible Core contract.
- Routing and each pool require opt-in. Production distribution and
fleet defaults remain unchanged.
- Unknown usage stays eligible. Known pinned exhaustion waits; revoked
access requires operator repair.
- Legacy adapters require compatible members. Runner model and effort
overrides remain limited by qualified backend support.

## Model Used

OpenAI GPT-6 through Codex, with reasoning, repository editing, code
execution, and browser testing. The exact deployment model ID and
context window are not exposed in this session.

## Checklist

- [x] I have included a thinking path that traces from project context
to this change
- [x] I have specified the model used (with version and capability
details)
- [x] I have checked ROADMAP.md and confirmed this PR does not duplicate
planned core work
- [x] I have searched GitHub for duplicate or related PRs and linked
them above
- [x] I have either (a) linked existing issues with `Fixes:` / `Closes:`
/ `Refs:` OR (b) described the issue in-PR following the relevant issue
template
- [x] I have not referenced internal/instance-local Paperclip issues or
links
- [x] My branch name describes the change and contains no internal
Paperclip ticket id or instance-derived details
- [x] I have run tests locally and they pass (targeted suites;
full-suite limitations are reported above)
- [x] I have added or updated tests where applicable
- [x] I have updated relevant documentation to reflect my changes
- [x] I have considered and documented any risks above
- [x] All Paperclip CI gates are green
- [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups
- [x] I will address all Greptile and reviewer comments before
requesting merge

---------

Co-authored-by: Paperclip <noreply@paperclip.ing>
2026-10-05 20:44:37 -05:00

1132 lines
42 KiB
TypeScript

// @vitest-environment jsdom
import { flushSync } from "react-dom";
import { createRoot, type Root } from "react-dom/client";
import { QueryClient, QueryClientProvider } from "@tanstack/react-query";
import { INSTANCE_FEATURE_KEYS } from "@paperclipai/shared";
import type {
InstanceExperimentalSettings as InstanceExperimentalSettingsPayload,
InstanceExperimentalSettingsWithManaged,
} from "@paperclipai/shared";
import { afterEach, beforeEach, describe, expect, it, vi } from "vitest";
import { InstanceExperimentalSettings } from "./InstanceExperimentalSettings";
import { queryKeys } from "../lib/queryKeys";
const mockInstanceSettingsApi = vi.hoisted(() => ({
getExperimental: vi.fn(),
updateExperimental: vi.fn(),
}));
vi.mock("@/api/instanceSettings", () => ({
instanceSettingsApi: mockInstanceSettingsApi,
}));
vi.mock("../context/BreadcrumbContext", () => ({
useBreadcrumbs: () => ({ setBreadcrumbs: vi.fn() }),
}));
async function act(callback: () => void | Promise<void>) {
let result: void | Promise<void> = undefined;
flushSync(() => {
result = callback();
});
await result;
}
async function flushReact() {
for (let index = 0; index < 5; index += 1) {
await Promise.resolve();
await new Promise((resolve) => window.setTimeout(resolve, 0));
}
flushSync(() => {});
}
const CONFERENCE_TOGGLE_SELECTOR =
'button[aria-label="Toggle conference room chat experimental setting"]';
const STREAMLINED_TOGGLE_SELECTOR =
'button[aria-label="Toggle Streamlined UI experimental setting"]';
const TASK_WATCHDOGS_TOGGLE_SELECTOR =
'button[aria-label="Toggle task watchdogs experimental setting"]';
const CLASSIC_TASK_INTERFACE_TOGGLE_SELECTOR =
'button[aria-label="Toggle classic task interface experimental setting"]';
const GOALS_SIDEBAR_LINK_TOGGLE_SELECTOR =
'button[aria-label="Toggle goals sidebar link experimental setting"]';
const DECISIONS_TOGGLE_SELECTOR =
'button[aria-label="Toggle decisions experimental setting"]';
const SERVER_INFO_TOGGLE_SELECTOR =
'button[aria-label="Toggle server info debug view experimental setting"]';
const PAPERCLIP_DEVELOPER_MODE_TOGGLE_SELECTOR =
'button[aria-label="Toggle Paperclip developer mode experimental setting"]';
const BUILT_IN_AGENTS_TOGGLE_SELECTOR =
'button[aria-label="Toggle built-in agents experimental setting"]';
const BETA_SKILLS_TOGGLE_SELECTOR =
'button[aria-label="Toggle beta skills experimental setting"]';
const SUMMARIES_TOGGLE_SELECTOR =
'button[aria-label="Toggle summaries experimental setting"]';
const STATUS_CARDS_TOGGLE_SELECTOR =
'button[aria-label="Toggle status cards experimental setting"]';
const PAPERCLIP_RUNNER_TOGGLE_SELECTOR =
'button[aria-label="Toggle Paperclip Runner experimental setting"]';
function defaultExperimentalSettings(): InstanceExperimentalSettingsPayload {
return {
enableEnvironments: false,
enableNativeRunner: false,
enableAiConnectionRouters: false,
enableManagedSandboxOnly: false,
enableIsolatedWorkspaces: false,
enableIsolatedWorkspacesByDefault: false,
enableStreamlinedLeftNavigation: true,
enableStreamlinedUi: true,
enableApps: true,
enableMcpAggregators: true,
enableChatConnectors: false,
enableMemoryConnectors: false,
enablePipelines: false,
enableCases: false,
enableAgentChat: false,
enableCombinedInboxTasks: false,
enableConferenceRoomChat: false,
enableClassicTaskInterface: false,
enableIssuePlanDecompositions: false,
enableExperimentalFileViewer: false,
enableExternalObjects: false,
enableBuiltInAgents: false,
enableBetaSkills: false,
enableSummaries: false,
enableStatusCards: false,
enableDecisions: false,
enableGoalsSidebarLink: false,
enableServerInfoDebugView: false,
enablePaperclipDeveloperMode: false,
enableSimplifiedEnglishInteractions: false,
enableFirstTaskPlanProposal: false,
enableSmokeLab: false,
autoRestartDevServerWhenIdle: false,
enableWorkspaceBranchReconcileForward: true,
enableWorkspaceDirtyQuarantineRepair: true,
enableOwnerInstanceAdmin: false,
enableSandboxDuplexBridge: false,
enableRunnerPreviewIngress: false,
enableWorktreeRunExecution: false,
worktreeRunExecutionActivatedAt: null,
worktreeRunExecutionActivationInstanceId: null,
};
}
const WORKTREE_RUN_EXECUTION_TOGGLE_SELECTOR =
'button[aria-label="Toggle worktree run execution setting"]';
const ISOLATED_WORKSPACES_TOGGLE_SELECTOR =
'button[aria-label="Toggle isolated workspaces experimental setting"]';
const ISOLATED_WORKSPACES_BY_DEFAULT_TOGGLE_SELECTOR =
'button[aria-label="Toggle isolated workspaces by default experimental setting"]';
function setWorktreeRuntimeMeta(enabled: boolean) {
const name = "paperclip-worktree-enabled";
let meta = document.querySelector<HTMLMetaElement>(`meta[name="${name}"]`);
if (enabled) {
if (!meta) {
meta = document.createElement("meta");
meta.setAttribute("name", name);
document.head.appendChild(meta);
}
meta.setAttribute("content", "true");
} else if (meta) {
meta.remove();
}
}
function setWorktreeInstanceIdMeta(instanceId: string | null) {
const name = "paperclip-instance-id";
let meta = document.querySelector<HTMLMetaElement>(`meta[name="${name}"]`);
if (instanceId) {
if (!meta) {
meta = document.createElement("meta");
meta.setAttribute("name", name);
document.head.appendChild(meta);
}
meta.setAttribute("content", instanceId);
} else if (meta) {
meta.remove();
}
}
describe("InstanceExperimentalSettings — Conference Room Chat card (PAP-11233)", () => {
let container: HTMLDivElement;
let root: Root | null = null;
let currentExperimentalSettings: InstanceExperimentalSettingsPayload;
async function renderPage() {
root = createRoot(container);
const queryClient = new QueryClient({
defaultOptions: { queries: { retry: false } },
});
flushSync(() => {
root!.render(
<QueryClientProvider client={queryClient}>
<InstanceExperimentalSettings />
</QueryClientProvider>,
);
});
await flushReact();
}
beforeEach(() => {
container = document.createElement("div");
document.body.appendChild(container);
currentExperimentalSettings = defaultExperimentalSettings();
mockInstanceSettingsApi.getExperimental.mockImplementation(async () => ({
...currentExperimentalSettings,
}));
mockInstanceSettingsApi.updateExperimental.mockImplementation(async (patch) => {
currentExperimentalSettings = { ...currentExperimentalSettings, ...patch };
return { ...currentExperimentalSettings };
});
});
afterEach(() => {
flushSync(() => {
root?.unmount();
});
root = null;
container.remove();
setWorktreeRuntimeMeta(false);
setWorktreeInstanceIdMeta(null);
vi.clearAllMocks();
});
it("renders a page-level warning about instability and lack of guarantees", async () => {
await renderPage();
const warning = [...container.querySelectorAll('[role="alert"]')].find((alert) =>
alert.textContent?.includes("Experimental features may break at any time."),
);
expect(warning?.textContent).toContain("Experimental features may break at any time.");
expect(warning?.textContent).toContain("no compatibility guarantees");
});
it("does not render an Apps experimental setting", async () => {
await renderPage();
expect(container.querySelector('button[aria-label="Toggle apps experimental setting"]')).toBeNull();
expect(container.textContent).not.toContain("Show the Apps navigation");
});
it("defaults memory connectors off and persists an explicit toggle in both directions", async () => {
await renderPage();
const selector = 'button[aria-label="Toggle memory connectors experimental setting"]';
expect(container.querySelector(selector)?.getAttribute("aria-checked")).toBe("false");
expect(container.textContent).toContain("Existing connections keep running.");
for (const enabled of [true, false]) {
await act(() => container.querySelector<HTMLButtonElement>(selector)!.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenLastCalledWith({ enableMemoryConnectors: enabled });
expect(container.querySelector(selector)?.getAttribute("aria-checked")).toBe(String(enabled));
}
});
it("defaults Combined Inbox + Task List off and persists an explicit toggle in both directions", async () => {
await renderPage();
const selector = 'button[aria-label="Toggle combined inbox and task list experimental setting"]';
expect(container.textContent).toContain("Combined Inbox + Task List");
expect(container.textContent).not.toContain("Agent Chat v2");
expect(container.querySelector(selector)?.getAttribute("aria-checked")).toBe("false");
for (const enabled of [true, false]) {
await act(() => container.querySelector<HTMLButtonElement>(selector)!.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenLastCalledWith({ enableCombinedInboxTasks: enabled });
expect(container.querySelector(selector)?.getAttribute("aria-checked")).toBe(String(enabled));
}
});
it("does not offer a retired MCP aggregators toggle", async () => {
await renderPage();
expect(container.querySelector('button[aria-label="Toggle MCP aggregators experimental setting"]')).toBeNull();
expect(container.textContent).not.toContain("MCP aggregators");
});
it("defaults chat connectors off and persists an explicit toggle in both directions", async () => {
await renderPage();
const selector = 'button[aria-label="Toggle chat connectors experimental setting"]';
expect(container.querySelector(selector)?.getAttribute("aria-checked")).toBe("false");
expect(container.textContent).toContain("Existing chat connections keep running");
for (const enabled of [true, false]) {
await act(() => container.querySelector<HTMLButtonElement>(selector)!.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenLastCalledWith({ enableChatConnectors: enabled });
expect(container.querySelector(selector)?.getAttribute("aria-checked")).toBe(String(enabled));
expect(currentExperimentalSettings.enableApps).toBe(true);
}
});
it("does not render the Conference Room Chat experimental setting for now", async () => {
await renderPage();
const headings = [...container.querySelectorAll("section h2")].map((h) => h.textContent);
expect(headings).not.toContain("Conference Room Chat");
expect(container.querySelector(CONFERENCE_TOGGLE_SELECTOR)).toBeNull();
});
it("does not render the Pipelines experimental setting for now", async () => {
await renderPage();
const headings = [...container.querySelectorAll("section h2")].map((h) => h.textContent);
expect(headings).not.toContain("Pipelines");
expect(container.querySelector('button[aria-label="Toggle pipelines experimental setting"]')).toBeNull();
});
it("does not render the toggle even when the stored flag is currently enabled", async () => {
currentExperimentalSettings = {
...currentExperimentalSettings,
enableConferenceRoomChat: true,
};
await renderPage();
const toggle = container.querySelector(CONFERENCE_TOGGLE_SELECTOR);
expect(toggle).toBeNull();
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("renders and patches the Streamlined UI experimental toggle on and off", async () => {
await renderPage();
expect(container.textContent).toContain("Streamlined UI");
expect(container.textContent).toContain(
"Use the simplified main sidebar, shared Tasks and Inbox presentation, focused task detail layout, and contextual navigation across Agents, Routines, Skills, and Settings.",
);
const toggle = container.querySelector<HTMLButtonElement>(STREAMLINED_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("true");
await act(() => toggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenLastCalledWith({
enableStreamlinedUi: false,
});
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(() => toggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenLastCalledWith({
enableStreamlinedUi: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("does not render a Task Watchdogs toggle because watchdogs are always enabled", async () => {
await renderPage();
expect(container.textContent).not.toContain("Task Watchdogs");
expect(container.querySelector('button[aria-label="Toggle task watchdogs experimental setting"]')).toBeNull();
});
it("does not expose the retired Runner Preview Ingress setting separately", async () => {
currentExperimentalSettings.enableRunnerPreviewIngress = true;
await renderPage();
expect(container.textContent).not.toContain("Runner Preview Ingress");
expect(container.querySelector(
'button[aria-label="Toggle runner preview ingress experimental setting"]',
)).toBeNull();
});
it("keeps Paperclip Runner default-off and exposes an explicit opt-in", async () => {
await renderPage();
expect(container.textContent).toContain("Paperclip Runner");
expect(container.textContent).toContain("Onboarding continues to use legacy adapters");
const toggle = container.querySelector<HTMLButtonElement>(
PAPERCLIP_RUNNER_TOGGLE_SELECTOR,
);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableNativeRunner: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("renders and patches the Classic Task Interface experimental toggle on and off", async () => {
await renderPage();
expect(container.textContent).toContain("Classic Task Interface");
expect(container.textContent).toContain(
"Restores the previous task detail page",
);
expect(container.textContent).toContain(
"Switching takes effect immediately. No task data is affected.",
);
const toggle = container.querySelector<HTMLButtonElement>(
CLASSIC_TASK_INTERFACE_TOGGLE_SELECTOR,
);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableClassicTaskInterface: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
flushSync(() => {
root?.unmount();
});
root = null;
container.textContent = "";
await renderPage();
const enabledToggle = container.querySelector<HTMLButtonElement>(
CLASSIC_TASK_INTERFACE_TOGGLE_SELECTOR,
);
expect(enabledToggle?.getAttribute("aria-checked")).toBe("true");
await act(async () => {
enabledToggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenLastCalledWith({
enableClassicTaskInterface: false,
});
});
it("renders and patches the Decisions experimental toggle", async () => {
await renderPage();
expect(container.textContent).toContain("Decisions");
expect(container.textContent).toContain(
"Show the Decisions item in the main sidebar",
);
const toggle = container.querySelector<HTMLButtonElement>(DECISIONS_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableDecisions: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("renders and patches the Goals Sidebar Link experimental toggle", async () => {
await renderPage();
expect(container.textContent).toContain("Goals Sidebar Link");
expect(container.textContent).toContain(
"Restore the Goals item in the main sidebar while the goals surface is being evaluated.",
);
const toggle = container.querySelector<HTMLButtonElement>(GOALS_SIDEBAR_LINK_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableGoalsSidebarLink: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("hides the isolated-workspaces-by-default toggle while isolated workspaces are off", async () => {
await renderPage();
expect(container.querySelector(ISOLATED_WORKSPACES_TOGGLE_SELECTOR)).not.toBeNull();
expect(
container.querySelector(ISOLATED_WORKSPACES_BY_DEFAULT_TOGGLE_SELECTOR),
).toBeNull();
expect(container.textContent).not.toContain("Use Isolated Workspaces By Default");
});
it("keeps the dependent toggle hidden even when its stored flag is already on", async () => {
// The operator default is inert without isolated workspaces, so the server
// ignores a stored `true`. The control must not imply otherwise.
currentExperimentalSettings = {
...currentExperimentalSettings,
enableIsolatedWorkspaces: false,
enableIsolatedWorkspacesByDefault: true,
};
await renderPage();
expect(
container.querySelector(ISOLATED_WORKSPACES_BY_DEFAULT_TOGGLE_SELECTOR),
).toBeNull();
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("renders and patches the isolated-workspaces-by-default toggle on and off", async () => {
currentExperimentalSettings = {
...currentExperimentalSettings,
enableIsolatedWorkspaces: true,
};
await renderPage();
expect(container.textContent).toContain("Use Isolated Workspaces By Default");
expect(container.textContent).toContain("per-task worktree");
const toggle = container.querySelector<HTMLButtonElement>(
ISOLATED_WORKSPACES_BY_DEFAULT_TOGGLE_SELECTOR,
);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableIsolatedWorkspacesByDefault: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenLastCalledWith({
enableIsolatedWorkspacesByDefault: false,
});
expect(toggle?.getAttribute("aria-checked")).toBe("false");
});
it("reflects a stored isolated-workspaces-by-default value as checked", async () => {
currentExperimentalSettings = {
...currentExperimentalSettings,
enableIsolatedWorkspaces: true,
enableIsolatedWorkspacesByDefault: true,
};
await renderPage();
const toggle = container.querySelector<HTMLButtonElement>(
ISOLATED_WORKSPACES_BY_DEFAULT_TOGGLE_SELECTOR,
);
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("hides the worktree run-execution toggle when not running in a worktree", async () => {
setWorktreeRuntimeMeta(false);
await renderPage();
const headings = [...container.querySelectorAll("section h2")].map((h) => h.textContent);
expect(headings).not.toContain("Run tasks in this worktree");
expect(container.querySelector(WORKTREE_RUN_EXECUTION_TOGGLE_SELECTOR)).toBeNull();
});
it("renders and patches the worktree run-execution toggle when in a worktree", async () => {
setWorktreeRuntimeMeta(true);
await renderPage();
expect(container.textContent).toContain("Run tasks in this worktree");
expect(container.textContent).toContain(
"isolated git-worktree preview instance",
);
const toggle = container.querySelector<HTMLButtonElement>(WORKTREE_RUN_EXECUTION_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableWorktreeRunExecution: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("shows the cutoff-copy for the worktree run-execution toggle when off", async () => {
setWorktreeRuntimeMeta(true);
await renderPage();
expect(container.textContent).toContain(
"Only tasks created after enabling will run automatically",
);
expect(container.textContent).toContain("Toggling off and on resets the cutoff.");
// Off => no armed banner and no fail-closed hint.
expect(container.textContent).not.toContain("Running tasks created after");
expect(container.textContent).not.toContain("Execution is suppressed");
});
it("shows the armed timestamp when the flag matches the current instance", async () => {
setWorktreeRuntimeMeta(true);
setWorktreeInstanceIdMeta("inst-current");
currentExperimentalSettings = {
...currentExperimentalSettings,
enableWorktreeRunExecution: true,
worktreeRunExecutionActivatedAt: "2026-07-10T18:34:00.000Z",
worktreeRunExecutionActivationInstanceId: "inst-current",
};
await renderPage();
expect(container.textContent).toContain("Running tasks created after");
expect(container.textContent).not.toContain("Execution is suppressed");
const toggle = container.querySelector<HTMLButtonElement>(WORKTREE_RUN_EXECUTION_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("fails closed with a re-enable hint when the flag was armed in another instance", async () => {
setWorktreeRuntimeMeta(true);
setWorktreeInstanceIdMeta("inst-current");
currentExperimentalSettings = {
...currentExperimentalSettings,
enableWorktreeRunExecution: true,
worktreeRunExecutionActivatedAt: "2026-07-10T18:34:00.000Z",
worktreeRunExecutionActivationInstanceId: "inst-other",
};
await renderPage();
expect(container.textContent).toContain("Execution is suppressed");
expect(container.textContent).toContain("armed in a different instance");
expect(container.textContent).toContain("Toggle it off and back on");
expect(container.textContent).not.toContain("Running tasks created after");
});
it("fails closed with a re-enable hint when the activation cutoff is missing", async () => {
setWorktreeRuntimeMeta(true);
setWorktreeInstanceIdMeta("inst-current");
currentExperimentalSettings = {
...currentExperimentalSettings,
enableWorktreeRunExecution: true,
worktreeRunExecutionActivatedAt: null,
worktreeRunExecutionActivationInstanceId: null,
};
await renderPage();
expect(container.textContent).toContain("Execution is suppressed");
expect(container.textContent).toContain("missing its activation cutoff");
expect(container.textContent).not.toContain("Running tasks created after");
});
it("renders and patches the Built-in Agents experimental toggle", async () => {
await renderPage();
expect(container.textContent).toContain("Built-in Agents");
expect(container.textContent).toContain("Show Paperclip-managed built-in agent surfaces");
const toggle = container.querySelector<HTMLButtonElement>(BUILT_IN_AGENTS_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableBuiltInAgents: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("renders and patches the Beta skills experimental toggle", async () => {
await renderPage();
expect(container.textContent).toContain("Beta skills");
expect(container.textContent).toContain("pin beta releases of the Paperclip core skill");
const toggle = container.querySelector<HTMLButtonElement>(BETA_SKILLS_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableBetaSkills: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("renders and patches the Summaries experimental toggle", async () => {
await renderPage();
expect(container.textContent).toContain("Summaries");
expect(container.textContent).toContain("Show Summarizer-generated status slots");
const toggle = container.querySelector<HTMLButtonElement>(SUMMARIES_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableSummaries: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("enables Summaries when enabling the Status Cards experimental toggle", async () => {
await renderPage();
expect(container.textContent).toContain("Status Cards");
expect(container.textContent).toContain("experimental shared status-card board");
const toggle = container.querySelector<HTMLButtonElement>(STATUS_CARDS_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableSummaries: true,
enableStatusCards: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
expect(
container.querySelector<HTMLButtonElement>(SUMMARIES_TOGGLE_SELECTOR)?.getAttribute("aria-checked"),
).toBe("true");
});
it("disables Status Cards when disabling Summaries", async () => {
currentExperimentalSettings = {
...currentExperimentalSettings,
enableSummaries: true,
enableStatusCards: true,
};
await renderPage();
const summariesToggle = container.querySelector<HTMLButtonElement>(SUMMARIES_TOGGLE_SELECTOR);
await act(async () => {
summariesToggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableSummaries: false,
enableStatusCards: false,
});
expect(summariesToggle?.getAttribute("aria-checked")).toBe("false");
expect(
container.querySelector<HTMLButtonElement>(STATUS_CARDS_TOGGLE_SELECTOR)?.getAttribute("aria-checked"),
).toBe("false");
});
it("renders and patches the Server Info Debug View experimental toggle", async () => {
await renderPage();
expect(container.textContent).toContain("Server Info Debug View");
expect(container.textContent).toContain(
'Show a "Server" section in the account drawer with the current server restart time and running commit.',
);
const toggle = container.querySelector<HTMLButtonElement>(SERVER_INFO_TOGGLE_SELECTOR);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableServerInfoDebugView: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
it("renders and patches Paperclip Developer Mode", async () => {
await renderPage();
expect(container.textContent).toContain("Paperclip Developer Mode");
expect(container.textContent).toContain("including Honeycomb trace queries on run pages");
const toggle = container.querySelector<HTMLButtonElement>(
PAPERCLIP_DEVELOPER_MODE_TOGGLE_SELECTOR,
);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
await act(async () => {
toggle?.click();
});
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enablePaperclipDeveloperMode: true,
});
expect(toggle?.getAttribute("aria-checked")).toBe("true");
});
});
describe("InstanceExperimentalSettings — cloud-managed keys", () => {
const MANAGED_BADGE_TEXT = "Managed by Paperclip Cloud";
let container: HTMLDivElement;
let root: Root | null = null;
let queryClient: QueryClient;
async function renderPage(settings: InstanceExperimentalSettingsWithManaged) {
mockInstanceSettingsApi.getExperimental.mockResolvedValue({ ...settings });
root = createRoot(container);
queryClient = new QueryClient({
defaultOptions: { queries: { retry: false } },
});
flushSync(() => {
root!.render(
<QueryClientProvider client={queryClient}>
<InstanceExperimentalSettings />
</QueryClientProvider>,
);
});
await flushReact();
}
beforeEach(() => {
container = document.createElement("div");
document.body.appendChild(container);
mockInstanceSettingsApi.updateExperimental.mockImplementation(async (patch) => ({
...defaultExperimentalSettings(),
...patch,
}));
});
afterEach(() => {
flushSync(() => {
root?.unmount();
});
root = null;
queryClient?.clear();
container.remove();
vi.clearAllMocks();
});
it("renders a managed key locked with the badge while unmanaged keys stay editable", async () => {
await renderPage({
...defaultExperimentalSettings(),
enableBuiltInAgents: true,
managedKeys: {
enableBuiltInAgents: { managed: true, managedBy: "paperclip-cloud" },
},
});
expect(container.textContent).toContain(MANAGED_BADGE_TEXT);
const builtInAgentsToggle = container.querySelector<HTMLButtonElement>(BUILT_IN_AGENTS_TOGGLE_SELECTOR);
expect(builtInAgentsToggle?.getAttribute("aria-checked")).toBe("true");
expect(builtInAgentsToggle?.disabled).toBe(true);
await act(() => builtInAgentsToggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
const summariesToggle = container.querySelector<HTMLButtonElement>(SUMMARIES_TOGGLE_SELECTOR);
expect(summariesToggle?.disabled).toBe(false);
await act(() => summariesToggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({
enableSummaries: true,
});
});
it("keeps a managed isolated-workspaces-by-default setting locked", async () => {
// The cloud overlay owns this key, so the tenant sees its value but cannot
// write it back and have the overlay immediately override the write.
await renderPage({
...defaultExperimentalSettings(),
enableIsolatedWorkspaces: true,
enableIsolatedWorkspacesByDefault: true,
managedKeys: {
enableIsolatedWorkspacesByDefault: { managed: true, managedBy: "paperclip-cloud" },
},
});
const toggle = container.querySelector<HTMLButtonElement>(
ISOLATED_WORKSPACES_BY_DEFAULT_TOGGLE_SELECTOR,
);
expect(toggle?.getAttribute("aria-checked")).toBe("true");
expect(toggle?.disabled).toBe(true);
expect(container.textContent).toContain(MANAGED_BADGE_TEXT);
await act(() => toggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("keeps a managed chat connectors setting locked", async () => {
await renderPage({
...defaultExperimentalSettings(),
managedKeys: { enableChatConnectors: { managed: true, managedBy: "paperclip-cloud" } },
});
const toggle = container.querySelector<HTMLButtonElement>('button[aria-label="Toggle chat connectors experimental setting"]');
expect(toggle?.disabled).toBe(true);
expect(toggle?.getAttribute("aria-checked")).toBe("false");
expect(container.textContent).toContain(MANAGED_BADGE_TEXT);
await act(() => toggle?.click());
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("locks Status Cards when managed Summaries is disabled", async () => {
await renderPage({
...defaultExperimentalSettings(),
managedKeys: {
enableSummaries: { managed: true, managedBy: "paperclip-cloud" },
},
});
const statusCardsToggle = container.querySelector<HTMLButtonElement>(STATUS_CARDS_TOGGLE_SELECTOR);
expect(statusCardsToggle?.disabled).toBe(true);
await act(() => statusCardsToggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("locks Summaries on when managed Status Cards is enabled", async () => {
await renderPage({
...defaultExperimentalSettings(),
enableSummaries: true,
enableStatusCards: true,
managedKeys: {
enableStatusCards: { managed: true, managedBy: "paperclip-cloud" },
},
});
const summariesToggle = container.querySelector<HTMLButtonElement>(SUMMARIES_TOGGLE_SELECTOR);
expect(summariesToggle?.disabled).toBe(true);
await act(() => summariesToggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("renders no managed badge and keeps toggles editable without managedKeys (self-hosted)", async () => {
await renderPage(defaultExperimentalSettings());
expect(container.textContent).not.toContain(MANAGED_BADGE_TEXT);
const builtInAgentsToggle = container.querySelector<HTMLButtonElement>(BUILT_IN_AGENTS_TOGGLE_SELECTOR);
expect(builtInAgentsToggle?.disabled).toBe(false);
await act(() => builtInAgentsToggle?.click());
await flushReact();
expect(mockInstanceSettingsApi.updateExperimental).toHaveBeenCalledWith({ enableBuiltInAgents: true });
});
});
describe("InstanceExperimentalSettings — card ordering and headings (PAP-393)", () => {
let container: HTMLDivElement;
let root: Root | null = null;
async function renderPage(settings: InstanceExperimentalSettingsWithManaged) {
mockInstanceSettingsApi.getExperimental.mockResolvedValue({ ...settings });
root = createRoot(container);
const queryClient = new QueryClient({
defaultOptions: { queries: { retry: false } },
});
flushSync(() => {
root!.render(
<QueryClientProvider client={queryClient}>
<InstanceExperimentalSettings />
</QueryClientProvider>,
);
});
await flushReact();
}
beforeEach(() => {
container = document.createElement("div");
document.body.appendChild(container);
mockInstanceSettingsApi.updateExperimental.mockImplementation(async (patch) => ({
...defaultExperimentalSettings(),
...patch,
}));
});
afterEach(() => {
flushSync(() => {
root?.unmount();
});
root = null;
container.remove();
setWorktreeRuntimeMeta(false);
vi.clearAllMocks();
});
it("groups developer and legacy settings into sections", async () => {
setWorktreeRuntimeMeta(true);
await renderPage(defaultExperimentalSettings());
const headings = [...container.querySelectorAll("section > div > h2")].map(
(heading) => heading.textContent ?? "",
);
expect(headings).toEqual([
"Experimental features",
"Paperclip Developer Mode",
"Legacy",
]);
const sections = [...container.querySelectorAll("section")];
expect(sections.at(0)?.textContent).not.toContain("Run tasks in this worktree");
expect(sections.at(0)?.textContent).not.toContain("Managed Environment Only");
expect(sections.at(-2)?.textContent).toContain("Run tasks in this worktree");
expect(sections.at(-2)?.textContent).toContain("Managed Environment Only");
expect(sections.at(-2)?.textContent).toContain("Auto-Restart Dev Server When Idle");
expect(sections.at(-2)?.textContent).toContain("Server Info Debug View");
expect(sections.at(-2)?.textContent).toContain("Smoke Lab");
expect(sections.at(-2)?.textContent).toContain("Task Plan Decomposition");
expect(sections.at(-1)?.textContent).toContain("These features are going to be removed.");
expect(sections.at(-1)?.textContent).toContain("Classic Task Interface");
expect(sections.at(-1)?.textContent).toContain("Goals Sidebar Link");
});
it("alphabetizes cards by their displayed title within each section", async () => {
setWorktreeRuntimeMeta(true);
await renderPage({ ...defaultExperimentalSettings(), enableIsolatedWorkspaces: true });
for (const section of container.querySelectorAll("section")) {
const titles = [...section.querySelectorAll("h3")].map((heading) => heading.textContent ?? "");
expect(titles.length).toBeGreaterThan(1);
expect(titles).toEqual([...titles].sort((a, b) => a.localeCompare(b, "en", { sensitivity: "base" })));
}
});
it("renders setting cards without a background color", async () => {
await renderPage(defaultExperimentalSettings());
const cards = [...container.querySelectorAll('[data-slot="card"]')];
expect(cards.length).toBeGreaterThan(10);
expect(cards.every((card) => card.classList.contains("bg-transparent"))).toBe(true);
});
it("no longer renders an 'Experimental' secondary badge on any card", async () => {
await renderPage(defaultExperimentalSettings());
const badges = [...container.querySelectorAll('[data-slot="badge"]')].map(
(badge) => badge.textContent?.trim(),
);
expect(badges).not.toContain("Experimental");
});
});
describe("InstanceExperimentalSettings — operator-hidden cards", () => {
let container: HTMLDivElement;
let root: Root | null = null;
let queryClient: QueryClient;
beforeEach(() => {
container = document.createElement("div");
document.body.appendChild(container);
});
afterEach(() => {
flushSync(() => root?.unmount());
root = null;
queryClient?.clear();
container.remove();
setWorktreeRuntimeMeta(false);
vi.clearAllMocks();
});
async function renderPage(
hiddenSettings?: string[],
settings: InstanceExperimentalSettingsWithManaged = defaultExperimentalSettings(),
) {
mockInstanceSettingsApi.getExperimental.mockResolvedValue(settings);
root = createRoot(container);
queryClient = new QueryClient({ defaultOptions: { queries: { retry: false } } });
queryClient.setQueryData(queryKeys.health, {
status: "ok",
...(hiddenSettings ? { hiddenSettings } : {}),
});
flushSync(() => {
root!.render(
<QueryClientProvider client={queryClient}>
<InstanceExperimentalSettings />
</QueryClientProvider>,
);
});
await flushReact();
}
it.each([
{ cloud: false, enabled: false },
{ cloud: false, enabled: true },
{ cloud: true, enabled: false },
{ cloud: true, enabled: true },
])("offers no AI routing control with cloud=$cloud and enabled=$enabled", async ({ cloud, enabled }) => {
await renderPage(undefined, {
...defaultExperimentalSettings(),
enableAiConnectionRouters: enabled,
...(cloud ? { managedKeys: { enableAiConnectionRouters: { managed: true, managedBy: "paperclip-cloud" as const } } } : {}),
});
expect(container.textContent).toContain("Experimental features");
expect(container.textContent).not.toContain("AI connection routers");
expect(container.querySelector('button[aria-label="Toggle AI connection routers experimental setting"]')).toBeNull();
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("renders nothing for an operator-hidden toggle and keeps the rest", async () => {
await renderPage(["instance.experimental.enableEnvironments"]);
expect(container.textContent).not.toContain("Enable Environments");
expect(container.textContent).toContain("Beta skills");
expect(container.textContent).not.toContain("Show the Apps navigation");
});
it("keeps only permitted controls in alphabetical order, including when hidden features are enabled", async () => {
setWorktreeRuntimeMeta(true);
const visible = new Set(["enableExternalObjects", "enableMemoryConnectors", "enableSimplifiedEnglishInteractions"]);
await renderPage(
INSTANCE_FEATURE_KEYS.filter((key) => !visible.has(key)).map((key) => `instance.experimental.${key}`),
{
...defaultExperimentalSettings(),
enableIsolatedWorkspaces: true,
enableIsolatedWorkspacesByDefault: true,
enablePaperclipDeveloperMode: true,
managedKeys: {
enableIsolatedWorkspacesByDefault: { managed: true, managedBy: "paperclip-cloud" },
},
},
);
expect([...container.querySelectorAll("h3")].map((heading) => heading.textContent)).toEqual([
"Enable External Objects",
"Memory connectors",
"Simplified English Interactions",
]);
expect([...container.querySelectorAll("section h2")].map((heading) => heading.textContent)).toEqual([
"Experimental features",
]);
expect(container.querySelectorAll('button[role="switch"]')).toHaveLength(3);
expect(mockInstanceSettingsApi.updateExperimental).not.toHaveBeenCalled();
});
it("retains a section when one of its controls is visible", async () => {
const visible = new Set(["enablePaperclipDeveloperMode", "enableGoalsSidebarLink"]);
await renderPage(INSTANCE_FEATURE_KEYS.filter((key) => !visible.has(key)).map((key) => `instance.experimental.${key}`));
expect(container.querySelector('[aria-labelledby="developer-mode-heading"] h3')?.textContent).toBe("Paperclip Developer Mode");
expect(container.querySelector('[aria-labelledby="legacy-heading"] h3')?.textContent).toBe("Goals Sidebar Link");
});
it("shows every toggle when nothing is hidden", async () => {
await renderPage();
expect(container.textContent).toContain("Enable Environments");
expect(container.textContent).toContain("Beta skills");
});
});