mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-22 16:51:28 +02:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - Connections give agents access to external services. > - AgentMail needs both a saved key and an inbox assigned to the agent. > - Chat requests offered a setup link instead of an inline card and could treat a saved key as complete. > - Inbox setup also hid address conflicts behind a generic server error and a separate review step. > - This pull request makes AgentMail a default connection, adds the inline card, reduces setup to two steps, and shows conflicts beside the address. > - Shared native dropdown styles also give every caret a consistent inset. ## Linked Issues or Issue Description **What happened?** AgentMail requests in chat did not show a usable inline connection card. Manual setup required extra screens, ignored saved account keys, and could trap new-address setup in a locked inbox dropdown. Agent selectors omitted the avatar from the selected value. A taken address could produce an HTTP 403 from AgentMail and appear as an internal server error. Native dropdown arrows also touched the right edge of their fields. **Expected behavior** Make AgentMail available as a default connection. Ask for the API key inline, with a direct link to its provider page. Default human access to the company and agent access to the requesting agent. Resume the agent only after an assigned inbox is active. Manual setup should ask for an agent and email address, then finish. Address checks should run as the user types. Taken addresses should show clickable alternatives. A domain dropdown beside the name should prefer a verified custom domain. Setup should suggest authorized saved AgentMail keys and show agent avatars in the picker and selected value. **Steps to reproduce** 1. Ask an agent to connect AgentMail when it has no assigned inbox. 2. Check that an inline API-key card appears and links to the provider's API-key page. 3. Open AgentMail setup, choose an agent, and request an address that is already taken. 4. Correct the inline error, refresh, and finish setup with the same request ID. 5. Inspect native dropdown carets in light, dark, disabled, and right-to-left states. Uses the bounded provider-error parser merged in #14768. Related work: #13256 introduced AgentMail; #14725 expanded connection search. ## What Changed - Stop recurring email queries for tasks that have no email thread. Share the query between the thread provider and activity view. Keep email-task updates and invalidation-based discovery. - Make AgentMail available without the experimental chat setting. Keep the catalog, setup and management routes, agent Channels tab, task email feed, receiving worker, and agent tools available by default. Other experimental chat providers stay gated. - Make the email address and copy icon a single clickable action with the shared Copied! confirmation. Add View inbox linking directly to the matching AgentMail console inbox, with the address encoded as one URL path segment. - Reorganize inbox Settings around the copyable email address, usage instructions, and receiving status. Move reconnect credentials into a disclosure and separate the Disconnect action. Add production Settings stories for active, paused, unassigned-address, revoked, webhook, long-address, mobile, and reconnect states. Show repair controls when the inbox has an error. Keep usage instructions tied to an active inbox with an address. - Add AgentMail channel intents and an inline key field with the direct API-key URL. - Keep setup and retry state tied to the interaction. Require an active inbox for completion. Preserve company and agent access checks. - Reduce manual setup to agent selection and email selection. Put the domain dropdown beside the address and default to a verified custom domain. Preserve explicit choices across reloads. Keep receiving settings under Advanced options. - Check the initial address and edits after a 350 ms pause. Abort superseded requests and ignore stale responses. Show clickable suggestions and retain known creation conflicts across reloads. - Add a company-scoped, manager-only address check using the saved credential. Search the visible inbox list instead of fetching an uncreated inbox: live AgentMail retains negative lookups that can break subsequent access-key creation. Unlisted addresses remain unknown; creation is authoritative. - Suggest labeled saved AgentMail keys in both manual setup and the inline card. Filter by company, provider, active credential, and current-user grants on the server. Prefer an account key and preserve the selected key or an explicit new-key choice across refresh. Use verified scope metadata and bounded concurrent checks for legacy keys. Never return secret values. - Catch an inbox-only key before the email step. Allow its existing inbox only after an explicit choice. Recover old locked drafts at the key picker. Save the replacement key before retiring an empty draft, then use a new setup URL so refresh preserves the switched account; stop if cleanup fails. Preserve already allocated addresses and their original accounts. - Use the shared AgentSelect in email setup. Show the canonical agent avatar in each option and the selected value, including other consumers of the shared component. Add regression coverage for legacy and current Lucide agent-mention icon formats. - Start each catalog Add connection with a fresh setup identity. Honor Finish setup's exact draft/account/address instead of resuming an unrelated browser draft. Return Cancel and Done to Connectors and Email settings to the inbox. Group the task/thread explanation in a How it Works card. - Route AgentMail catalog removal through the email inbox control API, including unfinished drafts. Refresh both the catalog and inbox views. - Render each inbox management tab separately. Access uses the saved account grants and agent controls; Conversations and Activity use the shared persisted email feed. Activity lifecycle actions use the email API. Reconnect returns to inbox Settings. Conversation failures show a retry instead of a false empty state. Email delivery recovery stays in the task. - Map documented provider address conflicts to a field error. Preserve actionable messages for other failures. - Preserve non-secret draft fields across refresh, scoped to the requested agent. Never save API keys in browser storage. Resume partial inbox creation with the original agent, address, and request ID. - Show an already-created address with explicit retry and new-address recovery instead of locked inputs. Preserve the original inbox and resumable draft when choosing another address. Distinguish runtime-key 404 errors and log safe provider status/operation/code. - Apply final agent access once within email setup authorization for a new account whose original installs are unchanged. Preserve later permission edits and reused account installs. Support in-place retry of progress loading. - Let a failed inline setup change keys after retiring an empty draft. Persist its replacement setup identity without storing secrets. Recover a server-saved account when refresh interrupts the save response, while preserving intentional account changes. - Render the production setup in Storybook and add error, recovery, and mobile states. - Inset native select carets in shared CSS. Preserve custom icons, listboxes, keyboard behavior, and forced-color controls. - Add browser regression coverage and an AgentMail Product E2E case with persisted-state and rendered-card evidence. ## Verification - Full `pnpm -r typecheck`, `pnpm build`, `pnpm check:token-gates`, and `git diff --check` passed after the default-availability change. - All 485 focused tests passed. These cover setup, management, catalog and route gates, connection intents, email authorization, Cursor execution, and the OpenAPI contract. All 39 email integration tests run with the experimental chat setting off. - The shared polling change passed four behavioral tests, UI typecheck and build, and token gates. - `tests/e2e/agentmail.spec.ts` passed with the actual server setting off. This full-stack browser test uses simulated provider responses. It covers catalog entry, saved keys, editable address and domain controls, creation, conflicts, retry, all management tabs, clipboard feedback, the provider link, and task email rendering. - In the live local browser, Add connection reached the editable email step with the saved account key. The verified custom domain was selected by default. Both domain choices worked. The existing inbox Settings page remained available. Both active inboxes completed new mail checks with the setting off. No new provider inbox or email message was created for this pass. - Earlier live provider acceptance covered creation on a verified custom domain, Finish connecting on the reported draft, successful mail checks after refresh, and catalog removal of disposable draft and active connections. Clicking the email address copied the exact address and showed Copied!. View inbox opened the same inbox in AgentMail’s console. No email messages were sent. - Production setup and Settings Storybook builds and interactions passed. Settings states include active, paused, unassigned, revoked, webhook, long-address, mobile, and reconnect. Receiving and revoked-access stories had zero accessibility violations. - Full local `pnpm test:run` on an earlier revision completed with 14,709 passing, 87 skipped, and four transient failures. All four failed cases passed in focused reruns without product changes. That serial full local command was not repeated after each follow-up. The latest-head full CI suite is the final test gate. - CI found an obsolete browser assertion that hid every channel when the flag was off. Updated it to keep AgentMail and the Channels surface visible while preserving the GitHub chat route gates. All 11 provider browser tests passed locally after scoping the Channels selector to the agent sidebar. Two initial local attempts stopped at temporary Postgres initialization. The passing run used a separate disposable database on the existing local Postgres server; it was removed after the test. - Updated the remaining sidebar and aggregator discovery assertions for default AgentMail availability. Ordinary task fixtures now return no email thread. All 128 sidebar/task-page tests and all 42 aggregator tests passed locally. - Latest head `b42bb4cd5cc9f2d01a99ab8026832d5a956ea85f`: full CI passed, with 54 successful checks including Snyk and two intentional Storybook skips. The CI run is https://github.com/paperclipai/paperclip/actions/runs/37020833647. A fresh Greptile review scored 5/5 with no unresolved threads. Live model evaluations and inbound/outbound email delivery were not run. ## Risks - AgentMail no longer needs experimental opt-in. Setup still requires a human to connect an account and assign an inbox. Inline setup creates an inbox after a human submits a new or saved key. Company access, agent access, inbox assignment, and completion checks remain enforced. - AgentMail read APIs cannot prove global address availability. The visible-list check is bounded to 100 entries and cannot see inboxes outside the key’s scope. The UI reports this limitation, suggests alternatives without claiming they are free, and keeps final creation conflicts inline. Lookup outages show an error without preventing the authoritative creation attempt. - Native select CSS affects the whole app. Custom-icon selects and multi-row lists are excluded. Forced-color mode keeps the browser caret. - Saved-key discovery uses stored verified scope metadata and checks authorized legacy credentials concurrently within a shared three-second deadline. Provider outages mark legacy choices unavailable; users can still enter another key. Final use rechecks authorization and provider access. - No database migration or transport default change. Live connection remains the default. ## Model Used OpenAI Codex, GPT-6, with reasoning, tool use, and code execution. The exact served model ID and context-window size are not exposed in this session. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass (focused suites; full-suite limitation documented above) - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green (latest head `b42bb4cd5cc9f2d01a99ab8026832d5a956ea85f`) - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups (latest head `b42bb4cd5cc9f2d01a99ab8026832d5a956ea85f`) - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
826 lines
33 KiB
TypeScript
826 lines
33 KiB
TypeScript
import { randomUUID } from "node:crypto";
|
|
import { eq } from "drizzle-orm";
|
|
import { afterAll, beforeAll, describe, expect, it } from "vitest";
|
|
import {
|
|
agents,
|
|
authUsers,
|
|
companies,
|
|
companyMemberships,
|
|
goals,
|
|
heartbeatRuns,
|
|
issueThreadInteractions,
|
|
issueComments,
|
|
issues,
|
|
createDb,
|
|
toolApplications,
|
|
toolConnections,
|
|
connectionGrants,
|
|
toolCatalogEntries,
|
|
toolProfiles,
|
|
toolProfileBindings,
|
|
toolConnectionInstalls,
|
|
} from "@paperclipai/db";
|
|
import type { RuntimeToolsTokenClaims } from "../runtime-tools-token.js";
|
|
import { connectionIntentService } from "../services/connection-intents.js";
|
|
import { instanceSettingsService } from "../services/instance-settings.js";
|
|
import { issueThreadInteractionService } from "../services/issue-thread-interactions.js";
|
|
import {
|
|
getEmbeddedPostgresTestSupport,
|
|
startEmbeddedPostgresTestDatabase,
|
|
} from "./helpers/embedded-postgres.js";
|
|
const support = await getEmbeddedPostgresTestSupport();
|
|
(support.supported ? describe : describe.skip)(
|
|
"aggregator connection fallback",
|
|
() => {
|
|
let db!: ReturnType<typeof createDb>;
|
|
let connectionString!: string;
|
|
let cleanup: (() => Promise<void>) | undefined;
|
|
let claims!: RuntimeToolsTokenClaims;
|
|
let runId!: string;
|
|
beforeAll(async () => {
|
|
const tempDb = await startEmbeddedPostgresTestDatabase(
|
|
"paperclip-connection-intents-",
|
|
);
|
|
cleanup = tempDb.cleanup;
|
|
connectionString = tempDb.connectionString;
|
|
db = createDb(connectionString);
|
|
const companyId = randomUUID();
|
|
const agentId = randomUUID();
|
|
const goalId = randomUUID();
|
|
const issueId = randomUUID();
|
|
runId = randomUUID();
|
|
await db.insert(companies).values({
|
|
id: companyId,
|
|
name: "Connection tests",
|
|
issuePrefix: "AGG",
|
|
requireBoardApprovalForNewAgents: false,
|
|
});
|
|
await db.insert(authUsers).values({
|
|
id: "responsible-user", name: "Responsible user", email: "responsible-user@example.test",
|
|
createdAt: new Date(), updatedAt: new Date(),
|
|
});
|
|
await db.insert(companyMemberships).values({
|
|
companyId,
|
|
principalType: "user",
|
|
principalId: "responsible-user",
|
|
status: "active",
|
|
membershipRole: "member",
|
|
});
|
|
await db.insert(goals).values({
|
|
id: goalId,
|
|
companyId,
|
|
title: "Connect a service",
|
|
level: "task",
|
|
status: "active",
|
|
});
|
|
await db.insert(agents).values({
|
|
id: agentId,
|
|
companyId,
|
|
name: "Researcher",
|
|
role: "researcher",
|
|
status: "active",
|
|
adapterType: "codex_local",
|
|
adapterConfig: {},
|
|
runtimeConfig: {},
|
|
permissions: {},
|
|
});
|
|
await db.insert(issues).values({
|
|
id: issueId,
|
|
companyId,
|
|
goalId,
|
|
title: "Read Notion",
|
|
status: "in_progress",
|
|
priority: "medium",
|
|
assigneeAgentId: agentId,
|
|
});
|
|
await db.insert(heartbeatRuns).values({
|
|
id: runId,
|
|
companyId,
|
|
agentId,
|
|
status: "running",
|
|
responsibleUserId: "responsible-user",
|
|
contextSnapshot: { issueId },
|
|
});
|
|
claims = {
|
|
sub: agentId,
|
|
company_id: companyId,
|
|
run_id: runId,
|
|
responsible_user_id: "responsible-user",
|
|
scope: "connection_intents",
|
|
iat: 1,
|
|
exp: 2,
|
|
instance_id: "test",
|
|
};
|
|
}, 60_000);
|
|
|
|
afterAll(async () => {
|
|
await cleanup?.();
|
|
});
|
|
|
|
async function userRequest(body: string, userId = "responsible-user") {
|
|
const [run] = await db
|
|
.select()
|
|
.from(heartbeatRuns)
|
|
.where(eq(heartbeatRuns.id, runId));
|
|
await db
|
|
.insert(issueComments)
|
|
.values({
|
|
companyId: claims.company_id,
|
|
issueId: run!.contextSnapshot!.issueId as string,
|
|
authorUserId: userId,
|
|
body,
|
|
});
|
|
}
|
|
async function resetQuestions() {
|
|
await db
|
|
.delete(issueComments)
|
|
.where(eq(issueComments.companyId, claims.company_id));
|
|
await db
|
|
.delete(issueThreadInteractions)
|
|
.where(eq(issueThreadInteractions.companyId, claims.company_id));
|
|
await db
|
|
.delete(toolConnections)
|
|
.where(eq(toolConnections.companyId, claims.company_id));
|
|
await db
|
|
.delete(toolProfiles)
|
|
.where(eq(toolProfiles.companyId, claims.company_id));
|
|
await db
|
|
.delete(toolApplications)
|
|
.where(eq(toolApplications.companyId, claims.company_id));
|
|
}
|
|
async function selectProvider(
|
|
option: string,
|
|
userId = "responsible-user",
|
|
query = "hubspot",
|
|
) {
|
|
const result = await connectionIntentService(db).search(claims, query);
|
|
const [run] = await db
|
|
.select()
|
|
.from(heartbeatRuns)
|
|
.where(eq(heartbeatRuns.id, runId));
|
|
const issue = {
|
|
id: run!.contextSnapshot!.issueId as string,
|
|
companyId: claims.company_id,
|
|
};
|
|
const interaction = await issueThreadInteractionService(db).create(
|
|
issue,
|
|
{
|
|
kind: "ask_user_questions",
|
|
payload: { version: 1, questions: [result.providerQuestion!] },
|
|
sourceRunId: runId,
|
|
addresseeUserId: "responsible-user",
|
|
},
|
|
{ agentId: claims.sub, runId },
|
|
);
|
|
// Public resolution service enforces human answer semantics; company membership
|
|
// and wrong-identity request checks are also exercised below.
|
|
await issueThreadInteractionService(db).answerQuestions(
|
|
issue,
|
|
interaction.id,
|
|
{
|
|
answers: [
|
|
{ questionId: result.providerQuestion!.id, optionIds: [option] },
|
|
],
|
|
},
|
|
{ userId },
|
|
);
|
|
return interaction;
|
|
}
|
|
async function seedProvider(
|
|
provider: string,
|
|
toolName: string,
|
|
userId = "responsible-user",
|
|
allowed = true,
|
|
) {
|
|
const [app] = await db
|
|
.insert(toolApplications)
|
|
.values({
|
|
companyId: claims.company_id,
|
|
applicationKey: randomUUID(),
|
|
name: provider,
|
|
type: "mcp_http",
|
|
status: "active",
|
|
metadata: { sourceTemplateKey: provider },
|
|
})
|
|
.returning();
|
|
const [connection] = await db
|
|
.insert(toolConnections)
|
|
.values({
|
|
companyId: claims.company_id,
|
|
applicationId: app!.id,
|
|
uid: randomUUID(),
|
|
name: provider,
|
|
transport: "mcp_remote",
|
|
authKind: "none",
|
|
credentialPolicy: "per_user",
|
|
status: "active",
|
|
enabled: true,
|
|
healthStatus: "ok",
|
|
config: { sourceTemplateKey: provider },
|
|
})
|
|
.returning();
|
|
await db.insert(connectionGrants).values({
|
|
companyId: claims.company_id,
|
|
connectionId: connection!.id,
|
|
kind: "user",
|
|
subjectUserId: userId,
|
|
status: "active",
|
|
});
|
|
await db.insert(toolCatalogEntries).values({
|
|
companyId: claims.company_id,
|
|
connectionId: connection!.id,
|
|
toolName,
|
|
name: toolName,
|
|
versionHash: "fixture",
|
|
status: "active",
|
|
entryKind: "tool",
|
|
lastSeenAt: new Date("2026-09-20T00:00:00Z"),
|
|
});
|
|
await db.insert(toolConnectionInstalls).values({
|
|
companyId: claims.company_id,
|
|
connectionId: connection!.id,
|
|
targetType: "agent",
|
|
targetId: claims.sub,
|
|
});
|
|
if (allowed) {
|
|
const [profile] = await db
|
|
.insert(toolProfiles)
|
|
.values({
|
|
companyId: claims.company_id,
|
|
profileKey: randomUUID(),
|
|
name: "Fixture reads",
|
|
defaultAction: "allow",
|
|
status: "active",
|
|
})
|
|
.returning();
|
|
await db.insert(toolProfileBindings).values({
|
|
companyId: claims.company_id,
|
|
profileId: profile!.id,
|
|
targetType: "agent",
|
|
targetId: claims.sub,
|
|
});
|
|
}
|
|
return connection!;
|
|
}
|
|
it.each([
|
|
["AgentMail create an email address and manage an agent mailbox", "agentmail"],
|
|
["Please acquire an email address through agent mail and remember it", "agentmail"],
|
|
["I need an Agentmial inbox for receiving mail from customers", "agentmail"],
|
|
["Please connect my Linear workspace so I can triage the team's backlog", "linear"],
|
|
["Find a Notion connection to search our engineering documentation", "notion"],
|
|
["Can you find the OpenRouter connection for the model I want to use?", "openrouter"],
|
|
["Please help me connect to Git Hub to look at my pull requests", "github"],
|
|
])("finds native connections in natural-language queries: %s", async (query, service) => {
|
|
await resetQuestions();
|
|
await instanceSettingsService(db).updateExperimental({ enableChatConnectors: true });
|
|
try {
|
|
const result = await connectionIntentService(db).search(claims, query);
|
|
expect(result.results[0]).toMatchObject({ service, state: "available" });
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
} finally {
|
|
await instanceSettingsService(db).updateExperimental({ enableChatConnectors: false });
|
|
}
|
|
});
|
|
it.each([false, true])("discovers AgentMail with truthful setup actions regardless of the chat setting (%s)", async (enabled) => {
|
|
await resetQuestions();
|
|
const service = connectionIntentService(db);
|
|
await instanceSettingsService(db).updateExperimental({ enableChatConnectors: enabled });
|
|
try {
|
|
const result = await service.search(claims, "agentmail");
|
|
expect(result.results[0]?.methods).toEqual([expect.objectContaining({
|
|
key: "email-agent", purpose: "channel", setupPath: `/AGG/apps/chat/connect?provider=agentmail&purpose=chat&agentId=${claims.sub}`,
|
|
})]);
|
|
expect(result.instruction).toContain("connection_request");
|
|
const requested = await service.request(claims, "agentmail");
|
|
expect(requested).toMatchObject({ state: "needs_user_action", interactionId: expect.any(String) });
|
|
expect(await service.request(claims, "agentmail")).toMatchObject({ interactionId: requested.interactionId });
|
|
const options = await service.setupOptions(requested.interactionId!);
|
|
expect(options.interaction.payload).toMatchObject({ purpose: "channel", serviceSlug: "agentmail", requestingAgentId: claims.sub });
|
|
expect(options.emailSetup).toEqual({ credentialConnectionId: null, readyConnectionId: null });
|
|
await service.decline(requested.interactionId!, "responsible-user");
|
|
await expect(service.request(claims, "agentmail")).rejects.toThrow(/already been resolved/);
|
|
const browse = await service.search(claims, "");
|
|
expect(browse.results.some(item => item.service === "agentmail")).toBe(true);
|
|
expect(browse.results.some(item => item.service === "anthropic")).toBe(true);
|
|
} finally {
|
|
await instanceSettingsService(db).updateExperimental({ enableChatConnectors: false });
|
|
}
|
|
});
|
|
it("keeps useful capability matches even when other query words do not occur in the catalog", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(claims,
|
|
"I need something that can search documents and spreadsheets for our quarterly planning discussion");
|
|
expect(result.results.some(item => item.service === "google-drive")).toBe(true);
|
|
expect(result.results.some(item => item.service === "google-sheets")).toBe(true);
|
|
expect(result.instruction).not.toContain("search its exact name");
|
|
});
|
|
it.each([
|
|
["help me find tools for circle back", "circleback-mcp"],
|
|
["Find Circlebak meeting transcripts and action items from yesterday", "circleback-mcp"],
|
|
["Can you connect Circleback MCP to get all our meeting notes?", "circleback-mcp"],
|
|
["Find Attio tools to review all our customer contacts before next week's meeting", "attio"],
|
|
["Help me find a ClickUp connection to organize our team's projects", "clickup"],
|
|
])("finds verified aggregator apps in natural-language queries: %s", async (query, target) => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(claims, query);
|
|
expect(result.results).toEqual(expect.arrayContaining([expect.objectContaining({
|
|
service: `via:composio:${target}`, source: "aggregator",
|
|
aggregator: expect.objectContaining({ evidenceUrl: expect.stringContaining("composio.dev/"), targetService: target }),
|
|
})]));
|
|
expect(result.providerQuestion?.options.map(option => option.id)).toContain(`via:composio:${target}`);
|
|
await expect(connectionIntentService(db).request(claims, `via:composio:${target}`)).rejects.toThrow();
|
|
});
|
|
it.each([false, true])("prefers an exact Motion match over fuzzy Notion (Notion denied: %s)", async denied => {
|
|
await resetQuestions();
|
|
if (denied) await seedProvider("notion", "notion_search", "responsible-user", false);
|
|
const result = await connectionIntentService(db).search(claims, "Help me find Motion tools");
|
|
expect(result.results[0]?.service).toBe("via:composio:motion");
|
|
expect(result.providerQuestion?.id).toBe("connection-provider:motion");
|
|
expect(result.instruction).not.toContain("administratively restricted");
|
|
});
|
|
it("finds namespaced installed aggregator tools with extra query words", async () => {
|
|
await resetQuestions();
|
|
await seedProvider("executor", "heliotrope:list_records");
|
|
const result = await connectionIntentService(db).search(claims, "Please find heliotrope tools for our weekly report");
|
|
expect(result.results[0]?.service).toBe("via:executor:heliotrope");
|
|
});
|
|
it("returns multiple named services so the agent can choose the relevant result", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(claims, "Find Linear or Notion for our project planning");
|
|
expect(result.results.map(item => item.service)).toEqual(expect.arrayContaining(["linear", "notion"]));
|
|
});
|
|
it("returns multiple aggregator apps without inventing a combined route or choosing consent", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(claims, "Find Circleback and Attio tools");
|
|
expect(result.results.map(item => item.service)).toEqual(expect.arrayContaining(["via:composio:circleback-mcp", "via:composio:attio"]));
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
expect(result.instruction).toContain("aggregator.targetService");
|
|
});
|
|
it("keeps native and aggregator app matches from the same query", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(claims, "Find Notion and Circleback tools");
|
|
expect(result.results.map(item => item.service)).toEqual(expect.arrayContaining(["notion", "via:composio:circleback-mcp"]));
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
});
|
|
|
|
it("prefers the built-in Jira connection and returns a direct instruction", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"atlassian jira",
|
|
);
|
|
expect(result.results[0]?.service).toBe("jira");
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
expect(result.instruction).toContain("connection_request");
|
|
});
|
|
it("returns ranked verified routes and does not create questions or connections during search", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"HubSpot recent contacts",
|
|
);
|
|
expect(result.results.map((item) => item.service)).toEqual([
|
|
"via:composio:hubspot",
|
|
"via:arcade:hubspot",
|
|
"via:zapier:hubspot",
|
|
]);
|
|
expect(result.providerQuestion?.prompt).toContain("external service");
|
|
expect(result.results.every((item) => item.state !== "ready")).toBe(true);
|
|
expect(result.results.every((item) => item.aggregator?.evidenceUrl)).toBe(
|
|
true,
|
|
);
|
|
expect(
|
|
await db
|
|
.select()
|
|
.from(issueThreadInteractions)
|
|
.where(eq(issueThreadInteractions.companyId, claims.company_id)),
|
|
).toHaveLength(0);
|
|
});
|
|
it("requires a real saved provider answer before requesting setup", async () => {
|
|
await resetQuestions();
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:composio:hubspot"),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:composio:hubspot", {
|
|
selectionInteractionId: randomUUID(),
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
});
|
|
it("uses the second selected provider and preserves target disclosure and idempotency", async () => {
|
|
await resetQuestions();
|
|
const answer = await selectProvider("via:arcade:hubspot");
|
|
const service = connectionIntentService(db);
|
|
const search = await service.search(claims, "hubspot");
|
|
expect(search.results.map((item) => item.service)).toEqual([
|
|
"via:arcade:hubspot",
|
|
]);
|
|
expect(search.selectionInteractionId).toBe(answer.id);
|
|
const first = await service.request(claims, "via:arcade:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
});
|
|
const again = await service.request(claims, "via:arcade:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
});
|
|
expect(again.interactionId).toBe(first.interactionId);
|
|
const [row] = await db
|
|
.select()
|
|
.from(issueThreadInteractions)
|
|
.where(eq(issueThreadInteractions.id, first.interactionId!));
|
|
expect(row!.payload).toMatchObject({
|
|
serviceSlug: "arcade",
|
|
serviceName: "HubSpot through Arcade",
|
|
upstreamService: { slug: "hubspot", selectionInteractionId: answer.id },
|
|
});
|
|
await expect(
|
|
service.request(claims, "via:composio:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
});
|
|
it("remembers None and refuses setup after reloading the service", async () => {
|
|
await resetQuestions();
|
|
const answer = await selectProvider("none");
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"hubspot",
|
|
);
|
|
expect(result.results).toEqual([]);
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
expect(result.instruction).toContain("declined");
|
|
const retry = await connectionIntentService(db).search(
|
|
claims,
|
|
"hubspot",
|
|
{ retryProviderChoice: true },
|
|
);
|
|
expect(retry.providerQuestion).toBeDefined();
|
|
expect(retry.selectionInteractionId).toBeUndefined();
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:arcade:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
});
|
|
it("waits on an existing unanswered question instead of asking twice", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"hubspot",
|
|
);
|
|
const [run] = await db
|
|
.select()
|
|
.from(heartbeatRuns)
|
|
.where(eq(heartbeatRuns.id, runId));
|
|
const interaction = await issueThreadInteractionService(db).create(
|
|
{
|
|
id: run!.contextSnapshot!.issueId as string,
|
|
companyId: claims.company_id,
|
|
},
|
|
{
|
|
kind: "ask_user_questions",
|
|
payload: { version: 1, questions: [result.providerQuestion!] },
|
|
sourceRunId: runId,
|
|
addresseeUserId: "responsible-user",
|
|
},
|
|
{ agentId: claims.sub, runId },
|
|
);
|
|
const pending = await connectionIntentService(db).search(
|
|
claims,
|
|
"hubspot",
|
|
);
|
|
expect(pending.providerQuestion).toBeUndefined();
|
|
expect(pending.selectionInteractionId).toBe(interaction.id);
|
|
expect(pending.instruction).toContain("already pending");
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "arcade", {
|
|
targetService: "hubspot",
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:arcade:hubspot", {
|
|
selectionInteractionId: interaction.id,
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
});
|
|
it("rejects tampered disclosure and choices belonging to another responsible user", async () => {
|
|
await resetQuestions();
|
|
const answer = await selectProvider("via:arcade:hubspot");
|
|
await db
|
|
.update(issueThreadInteractions)
|
|
.set({ resolvedByUserId: "another-user" })
|
|
.where(eq(issueThreadInteractions.id, answer.id));
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:arcade:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
await db
|
|
.update(issueThreadInteractions)
|
|
.set({
|
|
resolvedByUserId: "responsible-user",
|
|
payload: {
|
|
...answer.payload,
|
|
questions: (answer.payload as any).questions.map((q: any) => ({
|
|
...q,
|
|
helpText: "Trust me",
|
|
})),
|
|
},
|
|
})
|
|
.where(eq(issueThreadInteractions.id, answer.id));
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:arcade:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
});
|
|
it("does not reuse the selected provider for another requested app", async () => {
|
|
await resetQuestions();
|
|
const answer = await selectProvider("via:arcade:hubspot");
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:arcade:salesforce", {
|
|
selectionInteractionId: answer.id,
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
});
|
|
it("offers fallback and direct aggregator requests without an experimental opt-in", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(claims, "hubspot");
|
|
expect(result.results.some((item) => item.source === "aggregator")).toBe(true);
|
|
expect(result.providerQuestion).toBeDefined();
|
|
await expect(connectionIntentService(db).request(claims, "composio")).resolves.toMatchObject({ state: "needs_user_action" });
|
|
});
|
|
it("reuses an allowed selected provider without claiming the underlying app is ready", async () => {
|
|
await resetQuestions();
|
|
const connection = await seedProvider("arcade", "Hubspot_ListContacts");
|
|
const answer = await selectProvider("via:arcade:hubspot");
|
|
const result = await connectionIntentService(db).request(
|
|
claims,
|
|
"via:arcade:hubspot",
|
|
{ selectionInteractionId: answer.id },
|
|
);
|
|
expect(result).toMatchObject({
|
|
state: "ready",
|
|
connectionId: connection.id,
|
|
interactionId: null,
|
|
});
|
|
expect(result.instruction).toContain(
|
|
"HubSpot access is not yet verified",
|
|
);
|
|
expect(result.instruction).toContain("Arcade");
|
|
});
|
|
it("does not switch providers when the chosen route loses permission", async () => {
|
|
await resetQuestions();
|
|
const answer = await selectProvider("via:arcade:hubspot");
|
|
await seedProvider(
|
|
"arcade",
|
|
"Hubspot_ListContacts",
|
|
"responsible-user",
|
|
false,
|
|
);
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"hubspot",
|
|
);
|
|
expect(result.results).toEqual([]);
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
expect(result.instruction).toContain("no longer available");
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "via:composio:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
}),
|
|
).rejects.toMatchObject({ status: 403 });
|
|
});
|
|
it("keeps a decline effective when disclosure wording has changed", async () => {
|
|
await resetQuestions();
|
|
const answer = await selectProvider("none");
|
|
await db
|
|
.update(issueThreadInteractions)
|
|
.set({
|
|
payload: {
|
|
...answer.payload,
|
|
questions: (answer.payload as any).questions.map((q: any) => ({
|
|
...q,
|
|
prompt: "Older disclosure wording",
|
|
})),
|
|
},
|
|
})
|
|
.where(eq(issueThreadInteractions.id, answer.id));
|
|
expect(
|
|
(await connectionIntentService(db).search(claims, "hubspot"))
|
|
.instruction,
|
|
).toContain("declined");
|
|
});
|
|
it("persists app authorization guidance in the completed setup outcome", async () => {
|
|
await resetQuestions();
|
|
const answer = await selectProvider("via:composio:hubspot");
|
|
const service = connectionIntentService(db);
|
|
const requested = await service.request(claims, "via:composio:hubspot", {
|
|
selectionInteractionId: answer.id,
|
|
});
|
|
const connection = await seedProvider(
|
|
"composio",
|
|
"COMPOSIO_SEARCH_TOOLS",
|
|
);
|
|
const completed = await service.complete(
|
|
requested.interactionId!,
|
|
connection.id,
|
|
"responsible-user",
|
|
);
|
|
expect(completed).toMatchObject({
|
|
status: "accepted",
|
|
result: {
|
|
outcome: "connected",
|
|
connectionId: connection.id,
|
|
instruction: expect.stringContaining(
|
|
"HubSpot access is not yet verified",
|
|
),
|
|
},
|
|
});
|
|
expect((completed.result as any).instruction).toContain(
|
|
"COMPOSIO_MANAGE_CONNECTIONS",
|
|
);
|
|
});
|
|
it("uses only authorized Executor tool evidence and preserves the actual observation date", async () => {
|
|
await resetQuestions();
|
|
const connection = await seedProvider(
|
|
"executor",
|
|
"heliotrope:list_records",
|
|
"someone-else",
|
|
);
|
|
expect(
|
|
(await connectionIntentService(db).search(claims, "heliotrope"))
|
|
.results,
|
|
).toEqual([]);
|
|
await db
|
|
.update(connectionGrants)
|
|
.set({ subjectUserId: "responsible-user" })
|
|
.where(eq(connectionGrants.connectionId, connection.id));
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"heliotrope",
|
|
);
|
|
expect(result.results[0]).toMatchObject({
|
|
service: "via:executor:heliotrope",
|
|
aggregator: { verifiedAt: "2026-09-20T00:00:00.000Z" },
|
|
});
|
|
await db
|
|
.update(toolConnections)
|
|
.set({ status: "archived" })
|
|
.where(eq(toolConnections.id, connection.id));
|
|
expect(
|
|
(await connectionIntentService(db).search(claims, "heliotrope"))
|
|
.results,
|
|
).toEqual([]);
|
|
});
|
|
it("does not bypass an administratively denied built-in connection", async () => {
|
|
await resetQuestions();
|
|
await seedProvider("jira", "jira_read", "responsible-user", false);
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"Jira recent issues",
|
|
);
|
|
expect(result.results[0]).toMatchObject({
|
|
service: "jira",
|
|
state: "unavailable",
|
|
});
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
expect(result.instruction).toContain("Do not bypass");
|
|
});
|
|
it("does not invent support for unknown apps", async () => {
|
|
await resetQuestions();
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"nimbuscrm-not-real",
|
|
);
|
|
expect(result.results).toEqual([]);
|
|
expect(result.instruction).toContain("could not be verified");
|
|
});
|
|
it("preserves indexed-only display names when a saved choice is requested by slug", async () => {
|
|
await resetQuestions();
|
|
await seedProvider("executor", "heliotrope:list_records");
|
|
const answer = await selectProvider(
|
|
"via:executor:heliotrope",
|
|
"responsible-user",
|
|
"HELIOTROPE",
|
|
);
|
|
const result = await connectionIntentService(db).request(
|
|
claims,
|
|
"via:executor:heliotrope",
|
|
{ selectionInteractionId: answer.id },
|
|
);
|
|
expect(result.state).toBe("ready");
|
|
expect(result.instruction).toContain(
|
|
"Heliotrope access is not yet verified",
|
|
);
|
|
});
|
|
|
|
it("honors explicitly named providers and preserves target app context", async () => {
|
|
await resetQuestions();
|
|
await userRequest("Connect HubSpot through Arcade");
|
|
const service = connectionIntentService(db);
|
|
const result = await service.search(claims, "HubSpot through Arcade");
|
|
expect(result.results.map((item) => item.service)).toEqual(["arcade"]);
|
|
expect(result.providerQuestion).toBeUndefined();
|
|
expect(result.instruction).toContain("targetService hubspot");
|
|
const request = await service.request(claims, "arcade", {
|
|
targetService: "hubspot",
|
|
});
|
|
const intent = await service.loadIntent(request.interactionId!);
|
|
expect(intent.interaction.payload).toMatchObject({
|
|
serviceName: "HubSpot through Arcade",
|
|
upstreamService: { slug: "hubspot", name: "HubSpot" },
|
|
});
|
|
expect(
|
|
(await service.search(claims, "HubSpot through Executor")).results,
|
|
).toEqual([]);
|
|
await expect(
|
|
service.request(claims, "executor", { targetService: "hubspot" }),
|
|
).rejects.toThrow("cannot connect");
|
|
await expect(
|
|
service.request(claims, "github", { targetService: "hubspot" }),
|
|
).rejects.toThrow("direct external-provider");
|
|
});
|
|
|
|
it("permits explicit provider preference for a supported native app but not a native denial", async () => {
|
|
await resetQuestions();
|
|
await userRequest("Connect Jira via Arcade, not Zapier");
|
|
const service = connectionIntentService(db);
|
|
expect(
|
|
(await service.search(claims, "Jira via Arcade, not Zapier")).results.map(
|
|
(item) => item.service,
|
|
),
|
|
).toEqual(["arcade"]);
|
|
await seedProvider("jira", "jira_read", "responsible-user", false);
|
|
expect((await service.search(claims, "Jira via Arcade, not Zapier")).results).toEqual(
|
|
[expect.objectContaining({ service: "jira", state: "unavailable" })],
|
|
);
|
|
});
|
|
|
|
it("does not let an agent-supplied explicit query or direct target override a saved choice", async () => {
|
|
await resetQuestions();
|
|
const service = connectionIntentService(db);
|
|
const unproven = await service.search(claims, "HubSpot via Arcade");
|
|
expect(
|
|
unproven.providerQuestion?.options.map((option) => option.id),
|
|
).toEqual(["via:arcade:hubspot", "none"]);
|
|
await expect(
|
|
service.request(claims, "arcade", { targetService: "hubspot" }),
|
|
).rejects.toThrow("cannot connect");
|
|
await userRequest("Connect HubSpot via Arcade is just an example; do not connect yet");
|
|
await expect(service.request(claims,"arcade",{targetService:"hubspot"})).rejects.toThrow("cannot connect");
|
|
await userRequest("Connect HubSpot via Arcade");
|
|
await selectProvider("none");
|
|
expect(
|
|
(await service.search(claims, "HubSpot via Arcade")).results,
|
|
).toEqual([]);
|
|
await expect(
|
|
service.request(claims, "arcade", { targetService: "hubspot" }),
|
|
).rejects.toThrow("cannot connect");
|
|
await userRequest("Connect HubSpot via Arcade", "someone-else");
|
|
await expect(
|
|
service.request(claims, "arcade", { targetService: "hubspot" }),
|
|
).rejects.toThrow("cannot connect");
|
|
await userRequest("Please connect HubSpot through Arcade");
|
|
expect(
|
|
(await service.request(claims, "arcade", { targetService: "hubspot" }))
|
|
.state,
|
|
).toBe("needs_user_action");
|
|
await resetQuestions();
|
|
const chosen = await selectProvider("via:composio:hubspot");
|
|
await expect(
|
|
service.request(claims, "arcade", { targetService: "hubspot" }),
|
|
).rejects.toThrow("cannot connect");
|
|
const accepted = await service.request(claims, "composio", {
|
|
targetService: "hubspot",
|
|
});
|
|
expect(
|
|
(await service.loadIntent(accepted.interactionId!)).interaction.payload,
|
|
).toMatchObject({
|
|
upstreamService: { selectionInteractionId: chosen.id },
|
|
});
|
|
});
|
|
|
|
it("asks for a choice when human and agent messages name alternatives", async () => {
|
|
await resetQuestions();
|
|
await userRequest("Connect HubSpot via Arcade or Composio");
|
|
const result = await connectionIntentService(db).search(
|
|
claims,
|
|
"HubSpot via Arcade or Composio",
|
|
);
|
|
expect(
|
|
result.providerQuestion?.options.map((option) => option.id),
|
|
).toEqual([
|
|
"via:composio:hubspot",
|
|
"via:arcade:hubspot",
|
|
"via:zapier:hubspot",
|
|
"none",
|
|
]);
|
|
await expect(
|
|
connectionIntentService(db).request(claims, "arcade", {
|
|
targetService: "hubspot",
|
|
}),
|
|
).rejects.toThrow("cannot connect");
|
|
});
|
|
},
|
|
);
|