mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-31 06:04:11 +01:00
## Thinking Path > - Paperclip is the open source control plane people use to organize, govern, and understand AI-agent work > - Operators need concise, current status views across projects and execution workspaces without manually reading every issue and run > - Paperclip already has auditable issues, documents, built-in agents, routines, and live run events, but no first-class summary-slot workflow connecting those systems > - A built-in Summarizer can generate status prose through ordinary governed tasks while summary slots provide stable, revisioned destinations for that output > - The UI needs to show current summaries, generation progress, failures, revisions, and streaming draft status in the places operators already work > - This pull request adds the end-to-end summary-slot data, API, agent, orchestration, and UI surfaces behind an experimental setting > - The benefit is decision-oriented status context that remains company-scoped, auditable, retryable, and inexpensive by default ## Linked Issues or Issue Description No public GitHub issue exists for this feature. **Problem** Operators currently have to reconstruct project and workspace status by reading many issues, runs, and comments. This makes it hard to identify decisions, review queues, recent work, and the next event worth watching. **Proposed capability** Add an experimental summary system with revisioned summary slots for projects and workspaces, a paused-by-default built-in Summarizer agent, governed generation tasks, live draft status, and reusable UI cards. **Expected behavior** - Summary data remains company-scoped and revisions remain auditable. - Generation runs through normal issue/agent orchestration and deduplicates active requests. - Only the linked built-in Summarizer generation task can author a slot revision. - Operators can generate, retry, inspect revisions, and follow draft progress from project and workspace views. - The feature remains opt-in and background generation remains paused by default. ## What Changed - Added summary-slot schema, idempotent migrations, shared contracts, validators, API paths, and service tests. - Added company-scoped summary-slot routes for reading revisions, requesting generation, and guarded Summarizer writes with activity logging. - Added terminal generation finalization, failure reasons, assignment wakeups, and orchestration integration. - Added the paused-by-default built-in Summarizer bundle, low-cost runtime defaults, status-summarization skill, and stale-summary routine. - Added summary cards, revision selection, retry/configuration states, live draft streaming, transcript chunk handling, and project/workspace integrations. - Updated Claude local parsing for streamed status output and expanded server, adapter, shared, database, catalog, and UI coverage. ## Verification - `pnpm -r typecheck` - `pnpm exec vitest run packages/db/src/summary-slots-schema.test.ts packages/shared/src/summary-slot.test.ts server/src/__tests__/summary-slot-routes.test.ts server/src/__tests__/summary-slots.test.ts server/src/__tests__/built-in-agents.test.ts ui/src/components/SummarySlotCard.test.tsx ui/src/components/SummarySlotCard.status.test.tsx ui/src/components/useSummaryDraftStream.test.tsx ui/src/lib/summary-draft-stream.test.ts ui/src/lib/run-log-chunks.test.ts ui/src/context/LiveUpdatesProvider.hook.test.tsx` — 113 tests passed - `pnpm test:run` — server and UI suites passed; one CLI AWS doctor test was affected by inherited `AWS_ACCESS_KEY_ID`/`AWS_SECRET_ACCESS_KEY`, and passed when those host credentials were removed - `pnpm exec vitest run cli/src/__tests__/secrets.test.ts` with inherited AWS credential variables removed — 8 tests passed - `pnpm build` - `pnpm check:token-gates` currently reports nine `#9627` comment references introduced by current `master`; none are in this PR diff ## Risks - Database risk is limited by incrementally ordered, idempotent migrations and migration safety checks. - Summary generation creates normal issues/runs, so misconfiguration can produce failed slots; the UI exposes retryable failure reasons and agent configuration entry points. - Streaming draft parsing depends on the documented `STATUS:` protocol; final persisted revisions remain the source of truth. - The feature is experimental, opt-in, and its built-in routine is paused with no background token spend by default. > For core feature work, check [`ROADMAP.md`](ROADMAP.md) first and discuss it in `#dev` before opening the PR. Feature PRs that overlap with planned core work may need to be redirected — check the roadmap first. See `CONTRIBUTING.md`. ## Model Used - OpenAI GPT-5.3 Codex with reasoning, repository tool use, code execution, GitHub CLI, and Paperclip control-plane integration. Earlier branch commits also record Claude model co-authorship where applicable. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing> Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
209 lines
7.2 KiB
TypeScript
209 lines
7.2 KiB
TypeScript
import { Router, type Request } from "express";
|
|
import type { Db } from "@paperclipai/db";
|
|
import { generateSummarySlotSchema, writeSummarySlotSchema } from "@paperclipai/shared";
|
|
import { validate } from "../middleware/validate.js";
|
|
import { forbidden, notFound } from "../errors.js";
|
|
import { accessService, heartbeatService, instanceSettingsService, logActivity } from "../services/index.js";
|
|
import { queueIssueAssignmentWakeup } from "../services/issue-assignment-wakeup.js";
|
|
import { summarySlotService } from "../services/summary-slots.js";
|
|
import { assertCompanyAccess, getActorInfo } from "./authz.js";
|
|
|
|
function readScopeId(req: Request): string | null {
|
|
const raw = req.query.scopeId;
|
|
if (typeof raw === "string" && raw.trim().length > 0) return raw;
|
|
return null;
|
|
}
|
|
|
|
export function summarySlotSessionTaskKey(input: {
|
|
companyId: string;
|
|
scopeKind: string;
|
|
slotKey: string;
|
|
scopeId: string | null;
|
|
}) {
|
|
return `summary-slot:${input.companyId}:${input.scopeKind}:${input.scopeId ?? "company"}:${input.slotKey}`;
|
|
}
|
|
|
|
export function summarySlotRoutes(db: Db) {
|
|
const router = Router();
|
|
const access = accessService(db);
|
|
const settings = instanceSettingsService(db);
|
|
const svc = summarySlotService(db);
|
|
const heartbeat = heartbeatService(db);
|
|
|
|
async function assertSummariesEnabled() {
|
|
const experimental = await settings.getExperimental();
|
|
if (experimental.enableSummaries !== true) {
|
|
throw notFound("Summaries are not enabled");
|
|
}
|
|
}
|
|
|
|
/** Manual generate is a board/user action; agents cannot trigger it. */
|
|
async function assertCanGenerateSummary(req: Request, companyId: string) {
|
|
assertCompanyAccess(req, companyId);
|
|
if (req.actor.type !== "board") {
|
|
throw forbidden("Only board operators can generate summaries.");
|
|
}
|
|
if (req.actor.source === "local_implicit" || req.actor.isInstanceAdmin) return;
|
|
const allowed = await access.canUser(companyId, req.actor.userId, "tasks:assign");
|
|
if (!allowed) {
|
|
throw forbidden("Missing permission: tasks:assign");
|
|
}
|
|
}
|
|
|
|
async function logSummaryMutation(
|
|
req: Request,
|
|
input: {
|
|
companyId: string;
|
|
action: "summary_slot.generate_requested" | "summary_slot.write";
|
|
slotId: string;
|
|
details: Record<string, unknown>;
|
|
},
|
|
) {
|
|
const actor = getActorInfo(req);
|
|
await logActivity(db, {
|
|
companyId: input.companyId,
|
|
actorType: actor.actorType,
|
|
actorId: actor.actorId,
|
|
action: input.action,
|
|
entityType: "summary_slot",
|
|
entityId: input.slotId,
|
|
...(actor.agentId ? { agentId: actor.agentId } : {}),
|
|
...(actor.runId ? { runId: actor.runId } : {}),
|
|
details: input.details,
|
|
});
|
|
}
|
|
|
|
router.get("/companies/:companyId/summary-slots/:scopeKind/:slotKey", async (req, res) => {
|
|
const companyId = req.params.companyId as string;
|
|
assertCompanyAccess(req, companyId);
|
|
await assertSummariesEnabled();
|
|
const result = await svc.getSlot({
|
|
companyId,
|
|
scopeKind: req.params.scopeKind as string,
|
|
slotKey: req.params.slotKey as string,
|
|
scopeId: readScopeId(req),
|
|
});
|
|
res.json(result);
|
|
});
|
|
|
|
router.get("/companies/:companyId/summary-slots/:scopeKind/:slotKey/revisions", async (req, res) => {
|
|
const companyId = req.params.companyId as string;
|
|
assertCompanyAccess(req, companyId);
|
|
await assertSummariesEnabled();
|
|
const result = await svc.listRevisions({
|
|
companyId,
|
|
scopeKind: req.params.scopeKind as string,
|
|
slotKey: req.params.slotKey as string,
|
|
scopeId: readScopeId(req),
|
|
});
|
|
res.json(result);
|
|
});
|
|
|
|
router.post(
|
|
"/companies/:companyId/summary-slots/:scopeKind/:slotKey/generate",
|
|
validate(generateSummarySlotSchema),
|
|
async (req, res) => {
|
|
const companyId = req.params.companyId as string;
|
|
await assertSummariesEnabled();
|
|
await assertCanGenerateSummary(req, companyId);
|
|
const actor = getActorInfo(req);
|
|
const result = await svc.generate(
|
|
{
|
|
companyId,
|
|
scopeKind: req.params.scopeKind as string,
|
|
slotKey: req.params.slotKey as string,
|
|
scopeId: (req.body?.scopeId as string | null | undefined) ?? readScopeId(req),
|
|
},
|
|
{
|
|
agentId: actor.actorType === "agent" ? actor.actorId : null,
|
|
userId: actor.actorType === "user" ? actor.actorId : null,
|
|
runId: actor.runId ?? null,
|
|
},
|
|
);
|
|
await logSummaryMutation(req, {
|
|
companyId,
|
|
action: "summary_slot.generate_requested",
|
|
slotId: result.slot.id,
|
|
details: {
|
|
scopeKind: result.slot.scopeKind,
|
|
scopeId: result.slot.scopeId,
|
|
slotKey: result.slot.slotKey,
|
|
generatingIssueId: result.generatingIssue.id,
|
|
alreadyGenerating: result.alreadyGenerating,
|
|
},
|
|
});
|
|
if (!result.alreadyGenerating) {
|
|
await queueIssueAssignmentWakeup({
|
|
heartbeat,
|
|
issue: {
|
|
id: result.generatingIssue.id,
|
|
assigneeAgentId: result.generatingIssue.assigneeAgentId ?? null,
|
|
status: result.generatingIssue.status,
|
|
},
|
|
reason: "summary_slot_generation_requested",
|
|
mutation: "summary_slot.generate",
|
|
contextSource: "summary-slot.generate",
|
|
requestedByActorType: actor.actorType === "agent" ? "agent" : "user",
|
|
requestedByActorId: actor.actorId,
|
|
taskKey: summarySlotSessionTaskKey({
|
|
companyId,
|
|
scopeKind: result.slot.scopeKind,
|
|
slotKey: result.slot.slotKey,
|
|
scopeId: result.slot.scopeId,
|
|
}),
|
|
rethrowOnError: true,
|
|
});
|
|
}
|
|
res.status(result.alreadyGenerating ? 200 : 202).json(result);
|
|
},
|
|
);
|
|
|
|
router.put(
|
|
"/companies/:companyId/summary-slots/:scopeKind/:slotKey",
|
|
validate(writeSummarySlotSchema),
|
|
async (req, res) => {
|
|
const companyId = req.params.companyId as string;
|
|
assertCompanyAccess(req, companyId);
|
|
await assertSummariesEnabled();
|
|
if (req.actor.type !== "agent") {
|
|
throw forbidden("Only the Summarizer built-in agent may write summaries");
|
|
}
|
|
const actor = getActorInfo(req);
|
|
const result = await svc.write(
|
|
{
|
|
companyId,
|
|
scopeKind: req.params.scopeKind as string,
|
|
slotKey: req.params.slotKey as string,
|
|
scopeId: (req.body?.scopeId as string | null | undefined) ?? readScopeId(req),
|
|
markdown: req.body.markdown,
|
|
title: req.body.title ?? null,
|
|
changeSummary: req.body.changeSummary ?? null,
|
|
baseRevisionId: req.body.baseRevisionId ?? null,
|
|
generationIssueId: req.body.generationIssueId ?? null,
|
|
model: req.body.model ?? null,
|
|
},
|
|
{
|
|
agentId: actor.agentId,
|
|
runId: actor.runId ?? null,
|
|
},
|
|
);
|
|
await logSummaryMutation(req, {
|
|
companyId,
|
|
action: "summary_slot.write",
|
|
slotId: result.slot.id,
|
|
details: {
|
|
scopeKind: result.slot.scopeKind,
|
|
scopeId: result.slot.scopeId,
|
|
slotKey: result.slot.slotKey,
|
|
documentId: result.document.id,
|
|
revisionId: result.revision.id,
|
|
revisionNumber: result.revision.revisionNumber,
|
|
},
|
|
});
|
|
res.json(result);
|
|
},
|
|
);
|
|
|
|
return router;
|
|
}
|