mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-23 17:33:51 +02:00
DottaandPaperclip
2238831ecd
Third PR: depends on #15728 and #15727. The user has reviewed and authorized merging this experimental feature stack. ## Thinking Path > - Paperclip manages agent work through tasks and governed connections. > - Chat connections already bind external conversations to those tasks. > - Speko handles voice and telephony, while the selected Paperclip agent does the work. > - A call needs durable session authority, ordered follow-ups, and safe result delivery. > - This PR adds repeatable qualification for the Speko voice task integration. > - This PR depends on #15728, which depends on #15727. Speko stays experimental. ## Linked Issues or Issue Description **Problem or motivation** Phone and browser voice conversations cannot use the chat connection task lifecycle. A separate voice runtime is needed to preserve task authority, retries, and reply history. **Proposed solution** Add company-scoped voice sessions, signed callbacks, durable replies, inbound intake, and an agent-facing outbound-call tool. Reuse existing tasks, queues, secrets, and publications. **Roadmap alignment** This extends the experimental chat connector entry points under Agent Chat and Connected Apps. The project owner requested this feature. Refs #11418 for the original provider catalog proposal. This implementation uses the newer chat connection infrastructure rather than an MCP catalog-only integration. Refs #15721 for remote OpenCode startup. ## What Changed - Add a real Paperclip server/database E2E fixture that stubs only external Speko transport and the execution provider. - Add authenticated multi-user and cross-company qualification journeys. - Add Storybook interaction, accessibility, responsive, and visual-suite integration. - Add an E01–E16 runbook, component-to-story inventory, and current redacted qualification report. - Keep historical private call traces out of the PR. Provider proof tools are opt-in. ## Verification - All 21 standalone proof tests and browser client/server syntax checks pass. They cover signatures, redaction, cleanup retry, final audio saves, bounded report transport and late server write ordering. No live calls were placed. - All 27 focused UI/controller regressions, UI typecheck, token gates, and 28 map/catalog structural tests pass. The shared connection cache test covers pause/resume invalidation during the 30-second fresh period. - Storybook builds 157 Speko production-component stories. The complete prior 156-story set passed all 624 checks on UI source249cbc616a. After the final cache repair, all 152 affected page/launcher checks passed across both themes, 390/1200 widths and reduced motion. Real microphone access and external provider requests are blocked. - Hosted Storybook origin isolation and representative narrow-screen stories pass. Provider requests remain blocked. - Source annotations follow the current generated-catalog contract. No generated catalog or lockfile is included. Three inherited GitHub-heading tests passed after master reconciliation. - Commit905bc5da5dhas 55 passing checks, including required verify/E2E gates, and a fresh Greptile 5/5 review with zero unresolved findings. Local fixture success does not establish provider or spoken-playback acceptance. - The separate integrated browser run passed two journeys and failed browser answer retrieval. Real browser/telephone playback and timing acceptance remain outstanding. See the dated qualification report and E01–E16 runbook. Speko stays experimental. ## Risks - Voice sessions add migrations and provider-dependent lifecycle behavior. Migrations preserve existing chat and AI transports. - Callback origins must be reachable HTTPS. Provider keys and signing secrets remain vaulted. - Unverified callers receive task-scoped low-trust authority. Caller ID does not grant private task access. - Outbound telephony incurs provider charges. Provider acceptance is not proof that the caller heard an answer. - Keep the feature behind the existing experimental chat setting until the real browser, inbound, outbound, and delayed-result acceptance matrix passes. ## Model Used OpenAI Codex, GPT-6, with tool use and code execution. The exact serving model ID and context window are not exposed in this session. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [ ] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
50 lines
2.7 KiB
JavaScript
50 lines
2.7 KiB
JavaScript
/** Publish only an allowlisted, content-free view of a private synthetic run. */
|
|
import { readFile, writeFile } from "node:fs/promises";
|
|
|
|
const [input, output] = process.argv.slice(2);
|
|
if (!input || !output) throw new Error("Usage: node summarize-run.mjs private/report.json new-report.json");
|
|
const run = JSON.parse(await readFile(input, "utf8"));
|
|
const eventKinds = new Set([
|
|
"session_created", "remote_audio_subscribed", "input_start", "input_end",
|
|
"request_accepted", "followup_accepted", "poll_returned", "result_ready",
|
|
"result_returned_to_tool", "tool_rejected", "transcript_received",
|
|
"script_completed", "script_failed", "media_disconnected", "session_end_requested",
|
|
"session_end_failed", "audio_stream_closed", "cleanup_failed",
|
|
"application_notification_sent",
|
|
"application_notifier_joined", "audio_activity_started",
|
|
"interruption_requested",
|
|
]);
|
|
const events = run.events.filter((event) => eventKinds.has(event.kind)).map((event) => {
|
|
const item = { kind: event.kind, elapsedMs: event.elapsedMs };
|
|
for (const key of ["requestCount", "cursor", "jobElapsedMs", "characters", "verification", "toolMarkup"]) {
|
|
if (["number", "boolean"].includes(typeof event[key])) item[key] = event[key];
|
|
}
|
|
if (["start", "followup"].includes(event.label)) item.label = event.label;
|
|
return item;
|
|
});
|
|
const cleanupFailureCount = Math.max(run.cleanupFailures?.length ?? 0, run.events.filter(event => event.kind === "cleanup_failed").length);
|
|
const report = {
|
|
date: run.startedAt ?? "2026-09-11 (exact start available from provider session)",
|
|
sourceDigests: run.sourceDigests ? Object.fromEntries(
|
|
["live-client.mjs", "proof.mjs", "media-failure.mjs"]
|
|
.filter((name) => /^[a-f0-9]{64}$/.test(run.sourceDigests[name] ?? ""))
|
|
.map((name) => [name, run.sourceDigests[name]]),
|
|
) : null,
|
|
sessionId: run.sessionId,
|
|
input: run.mode,
|
|
applicationNotification: run.notifyReady === true,
|
|
applicationNotifierWebJoin: run.notifyViaJoin === true,
|
|
interruptAcknowledgment: run.interruptAcknowledgment === true,
|
|
llmConstraint: run.provider,
|
|
status: run.failure || cleanupFailureCount ? "failed" : "requires_audio_review",
|
|
cleanupFailureCount,
|
|
failure: run.failure ? "Scenario did not complete; see qualification report for diagnosis" : cleanupFailureCount ? "Run cleanup did not complete; see private evidence for diagnosis" : null,
|
|
acceptedRequests: run.proof.acceptedRequests,
|
|
resultReturned: run.proof.resultReturned,
|
|
synthesizedAudioReceived: run.audioFrames > 0,
|
|
// A transcript event and RTP frames cannot establish that the answer was heard.
|
|
confirmedResultPlayback: false,
|
|
events,
|
|
};
|
|
await writeFile(output, `${JSON.stringify(report, null, 2)}\n`, { flag: "wx" });
|