mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-21 08:22:20 +02:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - Issue interactions give agents and people a structured decision record. > - Resolver routes used different authorization rules. > - Some routes blocked valid agents, including task watchdogs with normal issue access. > - The API did not show who could resolve a pending interaction. > - This pull request gives every interaction kind one resolver policy evaluator. > - The benefit is a clear decision path with consistent governance and company isolation. ## Linked Issues or Issue Description Fixes: #8087 Refs: #7403 Related PR: #11082 proposes board-only confirmation rules. This change keeps human-only review as an explicit policy. **What happened?** Agents could create issue interactions. Some resolver routes still required board access. This left valid agent confirmations pending. Task watchdogs could see the same problem without board identity. **Expected behavior** Every interaction kind must use one resolver policy contract. The contract must support `anyone`, `not_creator`, and `human_only`. It must also apply all normal governance controls. **Steps to reproduce** 1. Create a `request_confirmation` interaction as an agent. 2. Resolve it with another authorized agent. 3. Observe the board-only denial. **Paperclip version or commit** The problem exists on `master` before this change. **Deployment mode** Local development with `pnpm dev`. ## What Changed - Add canonical policies for `anyone`, `not_creator`, and `human_only`. - Use one server evaluator for every interaction kind. - Apply named addressees, company limits, review rules, and task watchdog scope. - Charge cross-issue resolutions to the existing per-run action limit. - Return the effective resolver audience in attention and interaction data. - Show the audience, governance choices, and denial reasons in the board UI. - Add telemetry, API documents, product documents, and regression fixtures. - Add migration provenance for safe legacy behavior. - Make migration `0218` safe for complete replays and partial prior runs. ## Product Rules - An interaction records a response. It does not grant authority for the next action. - `anyone` lets any authorized issue participant respond. - `not_creator` requires a responder other than the interaction creator. - `human_only` requires an authorized person. - A named addressee, company policy, or governed action can narrow the audience. - These controls cannot widen the audience. - A task watchdog uses the same rules as an ordinary agent. - A task watchdog does not receive board authority. - An agent resolution on another issue uses the shared cross-issue action limit. - Legacy pending interactions keep their earlier restrictions. - The UI shows the effective audience and a permanent denial reason. ## Verification - `pnpm --filter @paperclipai/db check:migrations` - `pnpm --filter @paperclipai/db typecheck` - `pnpm exec vitest run packages/db/src/issue-thread-interaction-resolver-policy-migration.test.ts` - The focused PostgreSQL test applies migration `0218` twice. - The test also completes a partial prior run and preserves existing provenance. - The latest GitHub head has 29 successful checks. - The opt-in Storybook visual check skipped as expected. - Greptile reports 5/5 with no open comments. ## Risks - New interaction writes use `anyone` by default. - Callers must select `not_creator` or `human_only` when they need stricter review. - Legacy pending interactions keep the old creator and human restrictions. - Migration `0218` fills only missing provenance fields during recovery. - Cross-issue resolutions can reach the existing action limit. - The shared evaluator affects every interaction kind. - Route, service, database, shared contract, and UI tests cover these rules. > This work matches the Agent Reviews and Approvals direction in `ROADMAP.md`. It does not duplicate a planned item. ## Model Used OpenAI Codex, GPT-5. The runtime does not expose the exact deployment ID or context window. The agent used reasoning, repository tools, shell commands, and test execution. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either linked public issues or described the issue with the required labels - [x] I have not referenced internal Paperclip issues or links - [x] My branch name describes the change and contains no internal ticket id - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation - [x] I have considered and documented the risks - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open comments - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
390 lines
15 KiB
TypeScript
390 lines
15 KiB
TypeScript
import { randomUUID } from "node:crypto";
|
|
import express from "express";
|
|
import request from "supertest";
|
|
import { and, eq } from "drizzle-orm";
|
|
import { afterAll, afterEach, beforeAll, describe, expect, it } from "vitest";
|
|
import {
|
|
activityLog,
|
|
agentWakeupRequests,
|
|
agents,
|
|
companies,
|
|
companyMemberships,
|
|
createDb,
|
|
heartbeatRuns,
|
|
issueThreadInteractions,
|
|
issues,
|
|
} from "@paperclipai/db";
|
|
import { errorHandler } from "../middleware/index.js";
|
|
import { issueRoutes } from "../routes/issues.js";
|
|
import { CROSS_ISSUE_INFLUENCE_LIMIT } from "../services/cross-issue-influence-limit.js";
|
|
import {
|
|
getEmbeddedPostgresTestSupport,
|
|
startEmbeddedPostgresTestDatabase,
|
|
} from "./helpers/embedded-postgres.js";
|
|
|
|
const embeddedPostgresSupport = await getEmbeddedPostgresTestSupport();
|
|
const describeEmbeddedPostgres = embeddedPostgresSupport.supported ? describe : describe.skip;
|
|
|
|
if (!embeddedPostgresSupport.supported) {
|
|
console.warn(
|
|
`Skipping embedded Postgres interaction-resolution cap tests on this host: ${embeddedPostgresSupport.reason ?? "unsupported environment"}`,
|
|
);
|
|
}
|
|
|
|
/**
|
|
* Route-level proof for the per-run cross-issue influence cap on issue-thread
|
|
* interaction resolution, against the real routes, real services, and a real
|
|
* database: the mocked route harness can prove ordering, but only this can prove
|
|
* that a capped run leaves no interaction result, child task, activity receipt,
|
|
* or wake behind, and that concurrent resolutions cannot race past the cap.
|
|
*/
|
|
describeEmbeddedPostgres("cross-issue interaction resolution cap (routes + postgres)", () => {
|
|
let db!: ReturnType<typeof createDb>;
|
|
let tempDb: Awaited<ReturnType<typeof startEmbeddedPostgresTestDatabase>> | null = null;
|
|
|
|
beforeAll(async () => {
|
|
tempDb = await startEmbeddedPostgresTestDatabase("paperclip-interaction-cap-");
|
|
db = createDb(tempDb.connectionString);
|
|
}, 30_000);
|
|
|
|
// An allowed resolution wakes the assignee, and that wake can land a heartbeat
|
|
// run row just after the response, so teardown is best-effort in foreign-key
|
|
// order. Every assertion below is scoped to its own seeded company instead of
|
|
// relying on an empty database.
|
|
afterEach(async () => {
|
|
const cleanups = [
|
|
() => db.delete(issueThreadInteractions),
|
|
() => db.delete(activityLog),
|
|
() => db.delete(heartbeatRuns),
|
|
() => db.delete(agentWakeupRequests),
|
|
() => db.delete(heartbeatRuns),
|
|
() => db.delete(issues),
|
|
() => db.delete(companyMemberships),
|
|
() => db.delete(agents),
|
|
() => db.delete(companies),
|
|
];
|
|
for (const cleanup of cleanups) await cleanup().catch(() => undefined);
|
|
});
|
|
|
|
afterAll(async () => {
|
|
await tempDb?.cleanup();
|
|
});
|
|
|
|
function app(actor: Record<string, unknown>) {
|
|
const testApp = express();
|
|
testApp.use(express.json());
|
|
testApp.use((req, _res, next) => {
|
|
(req as any).actor = actor;
|
|
next();
|
|
});
|
|
testApp.use("/api", issueRoutes(db, {} as any, {}));
|
|
testApp.use(errorHandler);
|
|
return testApp;
|
|
}
|
|
|
|
function agentActor(companyId: string, agentId: string, runId: string) {
|
|
return { type: "agent", source: "agent_key", companyId, agentId, runId };
|
|
}
|
|
|
|
function boardActor(companyId: string, userId: string) {
|
|
return {
|
|
type: "board",
|
|
source: "session",
|
|
userId,
|
|
companyIds: [companyId],
|
|
memberships: [{ companyId, status: "active", membershipRole: "operator" }],
|
|
isInstanceAdmin: false,
|
|
};
|
|
}
|
|
|
|
const INTERACTION_FIXTURES = {
|
|
accept: {
|
|
// A suggested-task card proves the 429 also stops the child-task effect.
|
|
kind: "suggest_tasks",
|
|
payload: {
|
|
version: 1,
|
|
tasks: [{ clientKey: "spawned", title: "Spawned by a capped run" }],
|
|
},
|
|
body: { selectedClientKeys: ["spawned"] },
|
|
},
|
|
reject: {
|
|
kind: "request_confirmation",
|
|
payload: { version: 1, prompt: "Proceed?" },
|
|
body: { reason: "Not now" },
|
|
},
|
|
respond: {
|
|
kind: "ask_user_questions",
|
|
payload: {
|
|
version: 1,
|
|
questions: [{
|
|
id: "scope",
|
|
prompt: "Which scope?",
|
|
selectionMode: "single",
|
|
options: [{ id: "phase-1", label: "Phase 1" }],
|
|
}],
|
|
},
|
|
body: { answers: [{ questionId: "scope", optionIds: ["phase-1"] }] },
|
|
},
|
|
verdicts: {
|
|
kind: "request_item_verdicts",
|
|
payload: {
|
|
version: 1,
|
|
prompt: "Review these",
|
|
items: [{ id: "item-1", label: "Item one" }],
|
|
verdicts: ["approve", "reject"],
|
|
},
|
|
body: { verdicts: [{ id: "item-1", verdict: "approve" }] },
|
|
},
|
|
} as const;
|
|
|
|
type ResolutionRoute = keyof typeof INTERACTION_FIXTURES;
|
|
|
|
async function seedCompanyAndAgent(prefix: string) {
|
|
const companyId = randomUUID();
|
|
const agentId = randomUUID();
|
|
const userId = `${prefix.toLowerCase()}-operator`;
|
|
await db.insert(companies).values({
|
|
id: companyId,
|
|
name: `${prefix} Company`,
|
|
issuePrefix: prefix,
|
|
requireBoardApprovalForNewAgents: false,
|
|
});
|
|
await db.insert(agents).values({
|
|
id: agentId,
|
|
companyId,
|
|
name: `${prefix} Resolver`,
|
|
role: "engineer",
|
|
status: "idle",
|
|
adapterType: "codex_local",
|
|
adapterConfig: {},
|
|
runtimeConfig: {},
|
|
permissions: {},
|
|
});
|
|
await db.insert(companyMemberships).values({
|
|
companyId,
|
|
principalType: "user",
|
|
principalId: userId,
|
|
status: "active",
|
|
membershipRole: "operator",
|
|
});
|
|
return { companyId, agentId, userId };
|
|
}
|
|
|
|
let issueSequence = 0;
|
|
|
|
async function seedIssue(companyId: string, prefix: string, assigneeAgentId: string | null) {
|
|
const issueId = randomUUID();
|
|
issueSequence += 1;
|
|
await db.insert(issues).values({
|
|
id: issueId,
|
|
companyId,
|
|
identifier: `${prefix}-${issueSequence}`,
|
|
title: `${prefix} issue ${issueSequence}`,
|
|
status: "in_progress",
|
|
priority: "medium",
|
|
assigneeAgentId,
|
|
});
|
|
return issueId;
|
|
}
|
|
|
|
/** A run whose persisted context names `sourceIssueId`, not the target issue. */
|
|
async function seedRun(companyId: string, agentId: string, sourceIssueId: string) {
|
|
const runId = randomUUID();
|
|
await db.insert(heartbeatRuns).values({
|
|
id: runId,
|
|
companyId,
|
|
agentId,
|
|
invocationSource: "assignment",
|
|
triggerDetail: "system",
|
|
status: "running",
|
|
contextSnapshot: { issueId: sourceIssueId, wakeReason: "issue_assigned" },
|
|
});
|
|
return runId;
|
|
}
|
|
|
|
async function seedInteraction(companyId: string, issueId: string, route: ResolutionRoute) {
|
|
const fixture = INTERACTION_FIXTURES[route];
|
|
const [row] = await db.insert(issueThreadInteractions).values({
|
|
companyId,
|
|
issueId,
|
|
kind: fixture.kind,
|
|
status: "pending",
|
|
continuationPolicy: "wake_assignee",
|
|
requestedResolverPolicy: "anyone",
|
|
effectiveResolverPolicy: "anyone",
|
|
payload: fixture.payload as never,
|
|
}).returning({ id: issueThreadInteractions.id });
|
|
return row.id;
|
|
}
|
|
|
|
async function spendBudget(companyId: string, agentId: string, runId: string, attempts: number) {
|
|
if (attempts === 0) return;
|
|
await db.insert(activityLog).values(Array.from({ length: attempts }, () => ({
|
|
companyId,
|
|
actorType: "agent" as const,
|
|
actorId: agentId,
|
|
agentId,
|
|
runId,
|
|
action: "issue.cross_issue_influence_observed",
|
|
entityType: "issue",
|
|
entityId: runId,
|
|
})));
|
|
}
|
|
|
|
async function countInfluenceRows(companyId: string, runId: string, action: string) {
|
|
const rows = await db
|
|
.select({ id: activityLog.id })
|
|
.from(activityLog)
|
|
.where(and(
|
|
eq(activityLog.companyId, companyId),
|
|
eq(activityLog.runId, runId),
|
|
eq(activityLog.action, action),
|
|
));
|
|
return rows.length;
|
|
}
|
|
|
|
it.each(["accept", "reject", "respond", "verdicts"] as const)(
|
|
"fails a capped run closed on cross-issue %s with no interaction, task, activity, or wake",
|
|
async (route) => {
|
|
const { companyId, agentId } = await seedCompanyAndAgent("CAP");
|
|
const sourceIssueId = await seedIssue(companyId, "CAP", agentId);
|
|
const targetIssueId = await seedIssue(companyId, "CAP", agentId);
|
|
const runId = await seedRun(companyId, agentId, sourceIssueId);
|
|
await spendBudget(companyId, agentId, runId, CROSS_ISSUE_INFLUENCE_LIMIT);
|
|
const interactionId = await seedInteraction(companyId, targetIssueId, route);
|
|
|
|
const res = await request(app(agentActor(companyId, agentId, runId)))
|
|
.post(`/api/issues/${targetIssueId}/interactions/${interactionId}/${route}`)
|
|
.send(INTERACTION_FIXTURES[route].body);
|
|
|
|
expect(res.status, JSON.stringify(res.body)).toBe(429);
|
|
expect(res.body.details).toMatchObject({
|
|
code: "cross_issue_influence_cap_exceeded",
|
|
cap: CROSS_ISSUE_INFLUENCE_LIMIT,
|
|
count: CROSS_ISSUE_INFLUENCE_LIMIT + 1,
|
|
mode: "enforce",
|
|
});
|
|
// The refusal must not leak the run's own (possibly inaccessible) source
|
|
// issue or the resolver policy it passed.
|
|
expect(JSON.stringify(res.body)).not.toContain(sourceIssueId);
|
|
expect(JSON.stringify(res.body)).not.toContain("anyone");
|
|
|
|
const [interaction] = await db
|
|
.select({ status: issueThreadInteractions.status, result: issueThreadInteractions.result })
|
|
.from(issueThreadInteractions)
|
|
.where(eq(issueThreadInteractions.id, interactionId));
|
|
expect(interaction).toMatchObject({ status: "pending", result: null });
|
|
|
|
const childIssues = await db
|
|
.select({ id: issues.id })
|
|
.from(issues)
|
|
.where(and(eq(issues.companyId, companyId), eq(issues.parentId, targetIssueId)));
|
|
expect(childIssues).toEqual([]);
|
|
|
|
const wakes = await db
|
|
.select({ id: agentWakeupRequests.id })
|
|
.from(agentWakeupRequests)
|
|
.where(eq(agentWakeupRequests.companyId, companyId));
|
|
expect(wakes).toEqual([]);
|
|
|
|
const resolutionActivity = await db
|
|
.select({ action: activityLog.action })
|
|
.from(activityLog)
|
|
.where(and(eq(activityLog.companyId, companyId), eq(activityLog.entityId, targetIssueId)));
|
|
expect(resolutionActivity.map((row) => row.action)).toEqual([
|
|
"issue.cross_issue_influence_cap_rejected",
|
|
]);
|
|
expect(await countInfluenceRows(companyId, runId, "issue.cross_issue_influence_observed"))
|
|
.toBe(CROSS_ISSUE_INFLUENCE_LIMIT);
|
|
},
|
|
30_000,
|
|
);
|
|
|
|
it("charges one budget slot for an allowed cross-issue resolution", async () => {
|
|
const { companyId, agentId } = await seedCompanyAndAgent("ALW");
|
|
const sourceIssueId = await seedIssue(companyId, "ALW", agentId);
|
|
const targetIssueId = await seedIssue(companyId, "ALW", agentId);
|
|
const runId = await seedRun(companyId, agentId, sourceIssueId);
|
|
const interactionId = await seedInteraction(companyId, targetIssueId, "respond");
|
|
|
|
const res = await request(app(agentActor(companyId, agentId, runId)))
|
|
.post(`/api/issues/${targetIssueId}/interactions/${interactionId}/respond`)
|
|
.send(INTERACTION_FIXTURES.respond.body);
|
|
|
|
expect(res.status, JSON.stringify(res.body)).toBe(200);
|
|
expect(res.body).toMatchObject({ status: "answered" });
|
|
expect(await countInfluenceRows(companyId, runId, "issue.cross_issue_influence_observed")).toBe(1);
|
|
|
|
const [observed] = await db
|
|
.select({ details: activityLog.details })
|
|
.from(activityLog)
|
|
.where(and(
|
|
eq(activityLog.companyId, companyId),
|
|
eq(activityLog.action, "issue.cross_issue_influence_observed"),
|
|
));
|
|
expect(observed.details).toMatchObject({
|
|
kind: "interaction_resolution",
|
|
sourceIssueId,
|
|
targetIssueId,
|
|
count: 1,
|
|
});
|
|
}, 30_000);
|
|
|
|
it("leaves same-issue and board resolutions outside the counter", async () => {
|
|
const { companyId, agentId, userId } = await seedCompanyAndAgent("SME");
|
|
const issueId = await seedIssue(companyId, "SME", agentId);
|
|
const boardIssueId = await seedIssue(companyId, "SME", agentId);
|
|
const runId = await seedRun(companyId, agentId, issueId);
|
|
await spendBudget(companyId, agentId, runId, CROSS_ISSUE_INFLUENCE_LIMIT);
|
|
const sameIssueInteractionId = await seedInteraction(companyId, issueId, "respond");
|
|
const boardInteractionId = await seedInteraction(companyId, boardIssueId, "respond");
|
|
|
|
const sameIssue = await request(app(agentActor(companyId, agentId, runId)))
|
|
.post(`/api/issues/${issueId}/interactions/${sameIssueInteractionId}/respond`)
|
|
.send(INTERACTION_FIXTURES.respond.body);
|
|
expect(sameIssue.status, JSON.stringify(sameIssue.body)).toBe(200);
|
|
|
|
const board = await request(app(boardActor(companyId, userId)))
|
|
.post(`/api/issues/${boardIssueId}/interactions/${boardInteractionId}/respond`)
|
|
.send(INTERACTION_FIXTURES.respond.body);
|
|
expect(board.status, JSON.stringify(board.body)).toBe(200);
|
|
|
|
expect(await countInfluenceRows(companyId, runId, "issue.cross_issue_influence_observed"))
|
|
.toBe(CROSS_ISSUE_INFLUENCE_LIMIT);
|
|
expect(await countInfluenceRows(companyId, runId, "issue.cross_issue_influence_cap_rejected")).toBe(0);
|
|
}, 30_000);
|
|
|
|
it("cannot let concurrent cross-issue resolutions race past the cap", async () => {
|
|
const { companyId, agentId } = await seedCompanyAndAgent("RCE");
|
|
const sourceIssueId = await seedIssue(companyId, "RCE", agentId);
|
|
const firstTargetId = await seedIssue(companyId, "RCE", agentId);
|
|
const secondTargetId = await seedIssue(companyId, "RCE", agentId);
|
|
const runId = await seedRun(companyId, agentId, sourceIssueId);
|
|
// One slot left in the shared budget for two simultaneous resolutions.
|
|
await spendBudget(companyId, agentId, runId, CROSS_ISSUE_INFLUENCE_LIMIT - 1);
|
|
const firstInteractionId = await seedInteraction(companyId, firstTargetId, "respond");
|
|
const secondInteractionId = await seedInteraction(companyId, secondTargetId, "respond");
|
|
const client = app(agentActor(companyId, agentId, runId));
|
|
|
|
const results = await Promise.all([
|
|
request(client)
|
|
.post(`/api/issues/${firstTargetId}/interactions/${firstInteractionId}/respond`)
|
|
.send(INTERACTION_FIXTURES.respond.body),
|
|
request(client)
|
|
.post(`/api/issues/${secondTargetId}/interactions/${secondInteractionId}/respond`)
|
|
.send(INTERACTION_FIXTURES.respond.body),
|
|
]);
|
|
|
|
expect(results.map((res) => res.status).sort()).toEqual([200, 429]);
|
|
expect(await countInfluenceRows(companyId, runId, "issue.cross_issue_influence_observed"))
|
|
.toBe(CROSS_ISSUE_INFLUENCE_LIMIT);
|
|
expect(await countInfluenceRows(companyId, runId, "issue.cross_issue_influence_cap_rejected")).toBe(1);
|
|
|
|
const answered = await db
|
|
.select({ status: issueThreadInteractions.status })
|
|
.from(issueThreadInteractions)
|
|
.where(eq(issueThreadInteractions.companyId, companyId));
|
|
expect(answered.map((row) => row.status).sort()).toEqual(["answered", "pending"]);
|
|
}, 30_000);
|
|
});
|