mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-29 21:07:40 +01:00
<!-- entire-trail-link-start --> https://entire.com/gh/paperclipai/-/trails/123/changes/paperclip/123 <!-- entire-trail-link-end --> ## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - People save tasks, write documents, make decisions and send board messages. > - A disconnect can hide a response after the server accepts a write. > - Recovery must keep the original account, task and request key. > - The merged connection foundation in #15754 handles reads and shared outage state. > - This change adds bounded write recovery and explicit actions when recovery stops. ## Linked Issues or Issue Description **What happened?** Temporary failures could lose edits, report accepted writes as failures, or require people to copy and send input again. A retry could target a newly selected task or account. Restoring attachments could create a second task. **Expected behavior** Keep the draft, its owner and its target. Retry only operations with a server contract that prevents duplicate writes. Verify uncertain results. Show conflicts and permanent failures, with an explicit resend or cancel action. **Steps to reproduce** 1. Save a task title during an outage, then open another task before recovery. 2. Restore a task creation that needs files, selecting those files in another order. 3. Lose a document or decision response, then interrupt the verification read. 4. Switch accounts while a create, upload or connected-channel publication is pending. 5. Type and erase a new-task draft before the first account lookup completes, then reopen it. This PR carries the write layer from #15769 and its review fixes. It targets master after #15754 merged. Related test cleanup #16952 already covers the unchanged copy-link toast test; this PR does not duplicate that work. ## What Changed - Add bounded autosave and submit jobs for supported writes, with pending, conflict and manual retry states. Retain admitted autosaves after navigation and preserve newer task revisions. - Keep each job with its original account, task and operation. First account resolution adopts admitted startup work; a later account change cancels old work. Remount inline and document editors when their owner or document subject changes. - Preserve task-creation keys and immutable request snapshots through file reattachment. Restore generated document keys before comparing reselected files. Reject changed requests instead of creating a second task. - Check the original account scope before creates and each upload. Save successful upload receipts before stopping on an account change. Identify attachments by content digest and metadata. - Verify uncertain document and decision results. Replay only plain, keyed comments automatically; combined reassignment, reopen and run-setting changes require receipt reconciliation or cancel. Settle each request once when a receipt races its retry. - Scope drafts and connected-channel publication reads to their owner. Keep unowned older records unread and unreplayed, with an explicit confirmed discard action after Activity inspection. Preserve typing through the first session lookup, keep erased text erased, and report browser persistence only when storage succeeds. - Wait for the first account lookup before sending startup status changes or decisions. Retry failed required lookups with a fixed limit and surface exhaustion to the original action. Preserve uncertain comment keys on account cancellation. Check the account generation before a comment retry calls its sender and again immediately before POST after asynchronous preparation. Retire only that request’s optimistic echo on completion. - Return an ordinary comment’s accepted same-company, same-task, same-user receipt before workspace reopening, task status changes or wakeups. Reused keys with changed text still conflict. Complete reference and activity records through the same finalizer for initial sends and accepted retries. It locks the task before its comment, matching task and company deletion, comment removal and tombstoning, rejects removed or tombstoned comments, repairs references and inserts a missing activity record in one transaction, and publishes after commit. - Remove reader-only record and comment-body size caps so accepted browser writes remain readable, including JSON-escaped comment requests in local and session storage. Update four existing Storybook fixtures to use owned draft keys. - Document the write contracts and add regression and real browser recovery coverage. - Add the exact reviewed-save recovery regression for both composer implementations and reloads. Align receipt completion, both comment deletion methods and company deletion with task deletion by locking tasks first. Cover real task and company deletion races. ## Verification - The exact reviewed-unknown-save regression fails in all four cases on original commit `1ed0af4186`. It passes with this PR for both composers, before and after reload. Cancel keeps the text and uploaded receipt. The retained draft sends, and the next message also sends. Run `pnpm exec vitest run --project @paperclipai/ui ui/src/components/composer-recovery.test.tsx`. - The new real PostgreSQL task-deletion race fails with SQLSTATE `40P01` on parent commit `f3253a00c4`. The company-deletion race also fails with `40P01` on `e8cf0e02dd`. All six receipt tests pass after the final lock-order fixes. They cover company deletion, task deletion, comment removal, tombstoning, concurrent cross-task references and interrupted reference repair. Run `pnpm exec vitest run --project @paperclipai/server server/src/__tests__/issue-comment-receipt-postgres.test.ts`. - The full UI run passed 9,656 of 9,659 tests across 816 files. Three cases failed under that run: two large-tree timeouts and one plugin-panel assertion. All 67 tests in those two files passed in an isolated rerun. These failures remain recorded; this does not claim a clean full UI run. - `pnpm -r typecheck`, `pnpm build`, token gates and map checks pass on the final change. The local full repository test command was started, then stopped when the delivery moved to this existing PR. Fresh PR CI must provide the full-suite gate. - A local Storybook walkthrough used the real rich editor. Cancel kept the restored text, Send cleared it after the simulated save, and a new draft enabled Send again. Storybook simulates submission; it is not staging acceptance. - Earlier verification on `f3253a00c4` recorded five browser journeys for title saves, cached-task offline recovery, startup recovery, accepted comment replay and session lookup failure. Those results remain prior-head evidence. No new staging deployment is claimed. - On `e8cf0e02dd`, all CI checks passed after one browser-shard rerun. Its first failure copied page text instead of YAML in an unrelated agent-configuration test. On final commit `35131d4380`, Greptile is 5/5 with no unresolved review threads. The first CI attempt has two failures outside this diff: runner close-attachment suspension and scheduled-retry teardown. The scheduled-retry file passes all 14 tests in isolation; the isolated runner test still fails locally. The single standard CI rerun passed both jobs, and the aggregate verification gate passed. All CI checks are green on `35131d4380`; Apex is 5/5 on that same commit with no unresolved findings. ## Risks - Automatic replay requires server duplicate prevention or result verification. Uncertain combined mutations require receipt observation or cancel and a fresh intentional send. - Old unowned form drafts remain stored but are not assigned to an account. Unowned channel records can be retired after Activity inspection; this never cancels an accepted remote update. - Browser storage and hashing can be unavailable. Storage failure is reported honestly. Without a digest, replay can duplicate an upload rather than silently drop a selected file. - Detached autosaves remain bounded and check account ownership on each attempt. Conflicts or exhaustion retain the draft for explicit recovery. - No schema, credential or agent permission change is included. This PR does not claim staging deployment or original-task acceptance. ## Model Used Anthropic Claude Opus 5.5 (`claude-opus-5-5`) produced the original implementation with tool use. OpenAI Codex, GPT-6 family, assisted with restoration, integration, verification and review fixes. This Codex session does not expose its exact serving model ID or context window size. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: devinfoley <139239+devinfoley@users.noreply.github.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: Paperclip <noreply@paperclip.ing> Co-authored-by: Amy (Opus) <claude@users.noreply.github.com> Co-authored-by: Dotta <bippadotta@protonmail.com>
341 lines
13 KiB
TypeScript
341 lines
13 KiB
TypeScript
/**
|
|
* Per-task composer draft persistence, shared by the chat composers.
|
|
*
|
|
* Ordinary task drafts use localStorage; agent chat drafts use tab-scoped
|
|
* sessionStorage under the caller-provided key. All
|
|
* access is guarded so disabled or full storage never throws into React.
|
|
* Empty drafts remove the text key. Uploaded receipt metadata has a separate,
|
|
* versioned task-keyed record; legacy text drafts remain plain strings.
|
|
*/
|
|
|
|
/** Debounce before a keystroke lands in browser storage. */
|
|
export const DRAFT_DEBOUNCE_MS = 800;
|
|
|
|
// Chat drafts and uncertain submissions belong to this browser tab. Sharing a
|
|
// submission fence across tabs prevents intentional concurrent conversation turns.
|
|
function draftStorage(draftKey: string): Storage {
|
|
return draftKey.startsWith("paperclip:agent-chat-draft:") ? sessionStorage : localStorage;
|
|
}
|
|
|
|
export function loadDraft(draftKey: string): string {
|
|
return loadDraftIfAvailable(draftKey) ?? "";
|
|
}
|
|
|
|
/** Distinguish an empty stored draft from unavailable browser storage. */
|
|
export function loadDraftIfAvailable(draftKey: string): string | null {
|
|
try {
|
|
return draftStorage(draftKey).getItem(draftKey) ?? "";
|
|
} catch {
|
|
return null;
|
|
}
|
|
}
|
|
|
|
/** A conflicting tab keeps its own recoverable buffer without replacing the
|
|
* shared draft or acquiring another tab's pending receipt. */
|
|
export function loadDraftRecoveryKey(draftKey: string): string | null {
|
|
const key = `paperclip:agent-chat-draft:recovered:${draftKey}`;
|
|
try {
|
|
return sessionStorage.getItem(`${key}:recovery:v1`) === draftKey ? key : null;
|
|
} catch { return null; }
|
|
}
|
|
|
|
export function preserveDraftInTab(draftKey: string, body: string, attachments: unknown): { key: string; persisted: boolean } {
|
|
const key = `paperclip:agent-chat-draft:recovered:${draftKey}`;
|
|
try {
|
|
sessionStorage.setItem(key, body);
|
|
sessionStorage.setItem(`${key}:attachments:v1`, JSON.stringify({ version: 1, draftKey: key, attachments: draftAttachments(attachments) }));
|
|
sessionStorage.setItem(`${key}:recovery:v1`, draftKey);
|
|
return { key, persisted: true };
|
|
} catch {
|
|
return { key, persisted: false };
|
|
}
|
|
}
|
|
|
|
function syncDraftRecoveryMarker(draftKey: string) {
|
|
const prefix = "paperclip:agent-chat-draft:recovered:";
|
|
if (!draftKey.startsWith(prefix)) return;
|
|
const marker = `${draftKey}:recovery:v1`;
|
|
if (loadDraft(draftKey).trim() || loadDraftAttachments(draftKey).length || loadDraftSubmission(draftKey)) {
|
|
sessionStorage.setItem(marker, draftKey.slice(prefix.length));
|
|
} else {
|
|
sessionStorage.removeItem(marker);
|
|
}
|
|
}
|
|
|
|
function mayWriteDraft(draftKey: string, attemptId?: string) {
|
|
const pending = loadDraftSubmission(draftKey);
|
|
return !pending || pending.attemptId === attemptId;
|
|
}
|
|
|
|
export function saveDraft(draftKey: string, value: string, attemptId?: string) {
|
|
try {
|
|
if (!mayWriteDraft(draftKey, attemptId)) return;
|
|
if (value.trim()) {
|
|
draftStorage(draftKey).setItem(draftKey, value);
|
|
} else {
|
|
draftStorage(draftKey).removeItem(draftKey);
|
|
}
|
|
syncDraftRecoveryMarker(draftKey);
|
|
} catch {
|
|
// Ignore browser storage failures.
|
|
}
|
|
}
|
|
|
|
export function clearDraft(draftKey: string, attemptId?: string) {
|
|
try {
|
|
if (!mayWriteDraft(draftKey, attemptId)) return;
|
|
draftStorage(draftKey).removeItem(draftKey);
|
|
draftStorage(draftKey).removeItem(`${draftKey}:attachments:v1`);
|
|
draftStorage(draftKey).removeItem(`${draftKey}:submission:v1`);
|
|
syncDraftRecoveryMarker(draftKey);
|
|
} catch {
|
|
// Ignore browser storage failures.
|
|
}
|
|
}
|
|
|
|
/**
|
|
* The exact comment request, kept so a send that failed transiently or lost
|
|
* its receipt can be resent with the same `attemptId`. The server dedupes by
|
|
* that ID and rejects it for different content, so the body must be the one
|
|
* originally sent, not the editor text.
|
|
*/
|
|
export interface ComposerSendRequest {
|
|
body: string;
|
|
reopen?: boolean;
|
|
reassignment?: { assigneeAgentId: string | null; assigneeUserId: string | null };
|
|
attachmentIds?: string[];
|
|
/** Composer run settings, passed back unchanged. */
|
|
runSettings?: Record<string, unknown>;
|
|
}
|
|
|
|
export interface ComposerDraftSubmission {
|
|
attemptId: string;
|
|
reviewed: boolean;
|
|
/** Start of text typed after the submitted body in a restored uncertain draft. */
|
|
nextDraftOffset?: number;
|
|
submittedAttachmentIds?: string[];
|
|
/** Present when the send can be replayed; older records have none. */
|
|
request?: ComposerSendRequest;
|
|
/** The account that made `request`; only that account may replay it (see `useDraftOwner`). */
|
|
requestOwner?: string;
|
|
}
|
|
|
|
/** The retained request, only for the account that made it: another account in this browser never replays it. */
|
|
export function replayableRequest(
|
|
submission: ComposerDraftSubmission | null | undefined,
|
|
owner: string | undefined,
|
|
): ComposerSendRequest | undefined {
|
|
const request = submission?.request;
|
|
if (owner === undefined || submission?.requestOwner !== owner || !request) return undefined;
|
|
if (request.reassignment !== undefined || request.runSettings !== undefined || request.reopen === true) return undefined;
|
|
return request;
|
|
}
|
|
|
|
function isNullableString(value: unknown): value is string | null {
|
|
return value === null || (typeof value === "string" && value.length <= 128);
|
|
}
|
|
|
|
export function isComposerSendRequest(value: unknown): value is ComposerSendRequest {
|
|
if (!value || typeof value !== "object" || Array.isArray(value)) return false;
|
|
const row = value as Record<string, unknown>;
|
|
if (!Object.keys(row).every((key) => ["body", "reopen", "reassignment", "attachmentIds", "runSettings"].includes(key))) return false;
|
|
if (typeof row.body !== "string") return false;
|
|
if (row.reopen !== undefined && typeof row.reopen !== "boolean") return false;
|
|
if (row.reassignment !== undefined) {
|
|
const reassignment = row.reassignment as Record<string, unknown> | null;
|
|
if (
|
|
!reassignment || typeof reassignment !== "object" || Array.isArray(reassignment) ||
|
|
!isNullableString(reassignment.assigneeAgentId) || !isNullableString(reassignment.assigneeUserId)
|
|
) return false;
|
|
}
|
|
if (
|
|
row.attachmentIds !== undefined &&
|
|
(!Array.isArray(row.attachmentIds) || row.attachmentIds.length > 256 ||
|
|
!row.attachmentIds.every((id) => typeof id === "string" && id.length <= 128))
|
|
) return false;
|
|
if (
|
|
row.runSettings !== undefined &&
|
|
(!row.runSettings || typeof row.runSettings !== "object" || Array.isArray(row.runSettings))
|
|
) return false;
|
|
return true;
|
|
}
|
|
|
|
/** Retained client request ID. It is not delivery proof until a matching
|
|
* server receipt is observed; use the same ID for submission and reconciliation. */
|
|
export function loadDraftSubmission(
|
|
draftKey: string,
|
|
): ComposerDraftSubmission | null {
|
|
try {
|
|
const raw = draftStorage(draftKey).getItem(`${draftKey}:submission:v1`);
|
|
if (!raw) return null;
|
|
const record = JSON.parse(raw);
|
|
return record?.version === 1 &&
|
|
record.draftKey === draftKey &&
|
|
Object.keys(record).every((key) => ["version", "draftKey", "attemptId", "reviewed", "nextDraftOffset", "submittedAttachmentIds", "request", "requestOwner"].includes(key)) &&
|
|
typeof record.attemptId === "string" &&
|
|
/^[0-9a-f]{8}-(?:[0-9a-f]{4}-){3}[0-9a-f]{12}$/i.test(record.attemptId) &&
|
|
typeof record.reviewed === "boolean" &&
|
|
(record.nextDraftOffset === undefined || (Number.isSafeInteger(record.nextDraftOffset) && record.nextDraftOffset >= 0)) &&
|
|
(record.submittedAttachmentIds === undefined || (Array.isArray(record.submittedAttachmentIds) && record.submittedAttachmentIds.length <= 256 && record.submittedAttachmentIds.every((id: unknown) => typeof id === "string" && id.length <= 128))) &&
|
|
(record.request === undefined || isComposerSendRequest(record.request)) &&
|
|
(record.requestOwner === undefined || (typeof record.requestOwner === "string" && record.requestOwner.length <= 256))
|
|
? { attemptId: record.attemptId, reviewed: record.reviewed,
|
|
...(record.nextDraftOffset !== undefined ? { nextDraftOffset: record.nextDraftOffset } : {}),
|
|
...(record.submittedAttachmentIds !== undefined ? { submittedAttachmentIds: record.submittedAttachmentIds } : {}),
|
|
...(record.request !== undefined ? { request: record.request } : {}),
|
|
...(record.requestOwner !== undefined ? { requestOwner: record.requestOwner } : {}),
|
|
}
|
|
: null;
|
|
} catch {
|
|
return null;
|
|
}
|
|
}
|
|
|
|
export function saveDraftSubmission(
|
|
draftKey: string,
|
|
submission: ComposerDraftSubmission,
|
|
) {
|
|
try {
|
|
// An old completion/review must not replace a different retained intent.
|
|
// This is a local guard, not cross-tab atomicity or server idempotency.
|
|
if (!mayWriteDraft(draftKey, submission.attemptId)) return;
|
|
draftStorage(draftKey).setItem(
|
|
`${draftKey}:submission:v1`,
|
|
JSON.stringify({ version: 1, draftKey, ...submission }),
|
|
);
|
|
syncDraftRecoveryMarker(draftKey);
|
|
} catch {
|
|
/* The composer also retains the fence in memory. */
|
|
}
|
|
}
|
|
|
|
export function clearDraftSubmission(draftKey: string, attemptId: string) {
|
|
try {
|
|
if (loadDraftSubmission(draftKey)?.attemptId === attemptId) {
|
|
draftStorage(draftKey).removeItem(`${draftKey}:submission:v1`);
|
|
syncDraftRecoveryMarker(draftKey);
|
|
}
|
|
} catch {
|
|
/* Disabled browser storage is supported in memory. */
|
|
}
|
|
}
|
|
|
|
/** A late response can settle only its own retained intent, never a newer draft. */
|
|
export function settleDraftSubmission(draftKey: string, attemptId: string, nextDraft?: string): boolean {
|
|
const submission = loadDraftSubmission(draftKey);
|
|
if (submission?.attemptId !== attemptId) return false;
|
|
nextDraft ??= submission.nextDraftOffset === undefined
|
|
? "" : loadDraft(draftKey).slice(submission.nextDraftOffset);
|
|
const nextAttachments = submission.submittedAttachmentIds === undefined ? []
|
|
: loadDraftAttachments(draftKey).filter(item => !submission.submittedAttachmentIds!.includes(item.attachmentId));
|
|
clearDraft(draftKey, attemptId);
|
|
if (nextDraft) saveDraft(draftKey, nextDraft);
|
|
if (nextAttachments.length) saveDraftAttachments(draftKey, nextAttachments);
|
|
return true;
|
|
}
|
|
|
|
export interface ComposerDraftAttachment {
|
|
attachmentId: string;
|
|
name: string;
|
|
size?: number;
|
|
inline: boolean;
|
|
contentPath: string;
|
|
}
|
|
|
|
function draftAttachments(value: unknown): ComposerDraftAttachment[] {
|
|
if (!Array.isArray(value) || value.length > 20) return [];
|
|
const seen = new Set<string>();
|
|
const result: ComposerDraftAttachment[] = [];
|
|
for (const item of value) {
|
|
if (!item || typeof item !== "object" || Array.isArray(item)) continue;
|
|
const row = item as Record<string, unknown>;
|
|
if (row.status !== undefined && row.status !== "attached") continue;
|
|
if (
|
|
typeof row.attachmentId !== "string" ||
|
|
!/^[0-9a-f]{8}-(?:[0-9a-f]{4}-){3}[0-9a-f]{12}$/i.test(
|
|
row.attachmentId,
|
|
) ||
|
|
seen.has(row.attachmentId)
|
|
)
|
|
continue;
|
|
if (
|
|
typeof row.name !== "string" ||
|
|
row.name.length === 0 ||
|
|
row.name.length > 512 ||
|
|
typeof row.inline !== "boolean"
|
|
)
|
|
continue;
|
|
if (row.contentPath !== `/api/attachments/${row.attachmentId}/content`)
|
|
continue;
|
|
if (
|
|
row.size !== undefined &&
|
|
(typeof row.size !== "number" ||
|
|
!Number.isSafeInteger(row.size) ||
|
|
row.size < 0)
|
|
)
|
|
continue;
|
|
seen.add(row.attachmentId);
|
|
result.push({
|
|
attachmentId: row.attachmentId,
|
|
name: row.name,
|
|
inline: row.inline,
|
|
contentPath: row.contentPath,
|
|
...(row.size === undefined ? {} : { size: row.size as number }),
|
|
});
|
|
}
|
|
return result;
|
|
}
|
|
|
|
/** Selection hints only. The server still rechecks task/company ownership and
|
|
* atomically binds the receipt; stored text or metadata never grants access. */
|
|
export function loadDraftAttachments(
|
|
draftKey: string,
|
|
): ComposerDraftAttachment[] {
|
|
try {
|
|
const raw = draftStorage(draftKey).getItem(`${draftKey}:attachments:v1`);
|
|
if (!raw || raw.length > 32_768) return [];
|
|
const value: unknown = JSON.parse(raw);
|
|
if (!value || typeof value !== "object" || Array.isArray(value)) return [];
|
|
const record = value as Record<string, unknown>;
|
|
return record.version === 1 && record.draftKey === draftKey
|
|
? draftAttachments(record.attachments)
|
|
: [];
|
|
} catch {
|
|
return [];
|
|
}
|
|
}
|
|
|
|
export function saveDraftAttachments(draftKey: string, attachments: unknown, attemptId?: string) {
|
|
try {
|
|
// Only the owning pending request may persist newly uploaded receipts.
|
|
// Generic effects and stale composer cleanups must not rewrite its snapshot.
|
|
if (!mayWriteDraft(draftKey, attemptId)) return;
|
|
const selected = draftAttachments(attachments);
|
|
if (selected.length)
|
|
draftStorage(draftKey).setItem(
|
|
`${draftKey}:attachments:v1`,
|
|
JSON.stringify({ version: 1, draftKey, attachments: selected }),
|
|
);
|
|
else draftStorage(draftKey).removeItem(`${draftKey}:attachments:v1`);
|
|
syncDraftRecoveryMarker(draftKey);
|
|
} catch {
|
|
/* Disabled/full browser storage must not break the composer. */
|
|
}
|
|
}
|
|
export function loadStructuredDraft<T>(draftKey: string, fallback: T): T {
|
|
try {
|
|
const value = draftStorage(draftKey).getItem(draftKey);
|
|
return value ? (JSON.parse(value) as T) : fallback;
|
|
} catch {
|
|
return fallback;
|
|
}
|
|
}
|
|
|
|
export function saveStructuredDraft(draftKey: string, value: unknown) {
|
|
try {
|
|
draftStorage(draftKey).setItem(draftKey, JSON.stringify(value));
|
|
} catch {
|
|
// Ignore browser storage failures.
|
|
}
|
|
}
|