mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-06 10:48:12 +02:00
<!-- Write all pull request text in Simplified Technical English (ASD-STE100). --> ## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - Task descriptions, comments, continuation data, skills, and execution rules enter several agent adapters. > - The same source can be rendered by more than one automatic input carrier. > - Failed resumes can also rebuild input from stale or compact context. > - This pull request gives each Paperclip-owned source one delivery owner and preserves the required transport boundaries. > - It adds deterministic adapter, interaction, runner, and browser tests for these boundaries. > - The benefit is more predictable context delivery with explicit evidence for later live qualification. ## Linked Issues or Issue Description Related: #13144 removes a duplicate environment payload and bounds wake lists. Related: #11360 addresses Hermes resume behavior. This pull request preserves compatible active-session formats while repairing context ownership and stale question creation. **What happened?** Task descriptions and comments could enter more than one automatic context block. Native transports could wrap a complete model input in a second task envelope. Some legacy and gateway adapters could omit the owned assignment on ordinary tasks or rebuild a failed resume with stale compact context. A continuation could also request a question after newer human comments had arrived. **Expected behavior** Each task or comment source has one automatic model-facing owner. Distinct comment IDs and repeated wording remain distinct. Fresh fallback attempts rebuild the required full context. A question request is rejected when newer queued human direction makes it stale. Harness access policy remains owned by execution configuration. **Steps to reproduce** 1. Build a task with a description and current comments. 2. Capture the actual adapter or runner input. 3. Compare source ownership and task-envelope nesting. 4. Queue a human comment before a continuation requests a question. 5. Trigger a failed resume and inspect the fresh retry input. 6. Run the focused adapter, interaction, runner, and browser checks. ## What Changed - Add shared prompt-section selection at the provider-attempt boundary. - Deliver owned assignment context through native, legacy CLI, ACP, gateway, cloud, Pi, Kimi, Grok, Gemini, OpenCode, Cursor, OpenClaw, and Hermes paths. - Rebuild full or compact context after resume recovery changes the attempt. Add native and Claude ACP tests of actual recovery requests. - Preserve custom templates, loaded instruction files, execution policies, and older active-session formats. - Record continuation source metadata and reject stale question creation under the issue-row lock. - Add explicit Product E2E context-integrity profiles, prerequisite gates, credential-isolation checks, and report fixtures. - Bypass service-worker forwarding for same-origin Vite development modules. A real Chromium test fails with resource exhaustion before the repair and passes after it. Production asset caching keeps its existing policy. - Add browser diagnostics and service-worker module-loading regressions. - Add an explicit zero-retry eval option. The default retry behavior remains unchanged. Each campaign records its effective policy. - Remove the model-facing working-directory sentence from four prompt builders. Existing workspace, sandbox, permission, and custom-template configuration remains unchanged. - Align the everyday workflow assertion with the current 47-entry catalog. Compared with current upstream master, the branch carries the context-ownership implementation and its tests, the explicit context-integrity catalog and evidence harness, and the focused browser regression checks. ## Verification **Merge assessment:** focused regression evidence supports merge. This is not full completion of the original broad qualification matrix. The maintainer has authorized merge after fresh verification of the master integration. - Current head: `bbd52f82114eabf09bc7b1a7e97d54a5b43bbc00`. This integrates current master `2f585ef26a1814fa209715242d1ca791b63e4c4e`. All 14 conflicts are resolved. Cancellation checks, workspace finalization, native Grok support, and both sets of tests are retained. - Current-head Greptile: **5/5**, with no blocking findings. The review names this exact commit. All **59 reported checks are terminal: 55 successful, 4 skipped, zero pending or failing**. This includes the full root general and serialized suites, separate runner checks, typecheck, build, canary, browser E2E, Docker, and security checks. The successful legacy security status is included in that total. - After integration: workspace typecheck and full build passed. Separate runner checks passed: **2,160 TypeScript tests (10 skipped), 582 Rust tests, and 39 preparation checks**. Other passing checks include 621 Product E2E harness units, 376 focused shared/adapter tests, 160 real-database/API tests, 86 Hermes tests, 18 browser-support checks, and Product E2E typechecking. The complete root suite passed in CI. The duplicate local monolithic root run was stopped after that CI result; it is not counted as a completed local pass. - New native recovery coverage retains full assignment, completion contract, and explicit skill selection after safe replacement, for old and prepared input formats. Full native session test file: **136/136 passed**. - New Claude ACP coverage captures actual fresh, resumed, and missing-session fallback requests. It verifies one assignment copy, comment order, identical text under distinct comment IDs, and full fallback context. Full file: **33/33 passed**. Both affected TypeScript checks passed. - Existing deterministic tests cover source revisions, approval and trust boundaries, completion validation, custom templates, compatible sessions, standalone driver wrapping, and maintained adapter transport requests. - Provider-free browser support: **17/17 passed** after the master merge. Service-worker unit tests: **33/33 passed**. The module-overload regression failed before the repair and passed after it in real Chromium. ### Fresh live comparisons The new batch ran exactly four Product E2E attempts. **All four passed on the first attempt; no retries.** Each has six terminal matchers plus the existing browser lifecycle and invariant checks. | Exact case ID | Control | Candidate | |---|---|---| | `core-compatibility.runner-codex.local.plan-revise-accept` | Passed | Passed | | `local-session-integrity.runner-acpx-claude.local.structured-question-restart-resume` | Passed | Passed | The plan case checks a revised canonical plan and revision-bound approval before completion. The question case restarts the server before submitting the answer, then verifies the continuation completes. Control source is `dfa4e1bda8d50a1a01746603251a9128dbe9d0d6`. Candidate source is `79fcdb5dece501d28064ea9da306603881b46f0c`. They use identical frozen definitions and provider versions: Codex `0.156.0` with `gpt-5.6-sol`; ACPX `0.13.1` / Claude ACP `0.73.0` with `claude-sonnet-5`. The September 24 head added master browser recovery and test-only changes. The September 28 head also integrates newer master changes, including cancellation, workspace finalization, and native Grok. These are frozen-source live results, not exact-head live runs. The candidate received one description copy where the control initially received three. The submitted initial plan envelopes were 7,969 versus 19,097 characters. Question envelopes were 7,592 versus 18,919. These are structural measurements, not whole-provider token or dollar savings. ### Earlier evidence and failed attempts - The preceding fresh batch has four effective passing pairs: OpenCode comment continuation and assigned skill, native Codex comment continuation, and native Claude comment continuation. It retains **11 attempts: eight passed and three failed**. - Original failures remain recorded: missing local PostgreSQL library links before task creation; host-sleep cleanup after task/page checks passed; and a Claude **control** session-open rejection before a model turn. Setup was repaired identically on both worktrees. The permitted unchanged infrastructure retries passed. The underlying Claude provider startup error was not retained and remains unknown. - Older R2 retains **17 passes and one failure** across 18 attempts, including eight both-pass native/legacy Codex/Claude pairs. Its OpenCode blank-page failure led to the service-worker repair. R2 is historical evidence: master changed the native fixed prompt and removed duplicate wake environment data afterward. - The September 24 CI run initially failed one unrelated preview readiness test (`ECONNREFUSED` on its local fixture). Its test and production code match master. Isolated local verification passed **28 tests, 3 skipped**. One unchanged CI retry passed the full shard: **831 passed, 1 skipped**, including all **31 preview-exposure tests**. The aggregate CI gate passed afterward. The precise startup cause remains unknown; a port race is a hypothesis, not a proved cause. ### Limits The original wider profile/workflow matrix, repeated trials, and remote Daytona qualification are incomplete. These results support a focused merge recommendation, not statistical equivalence or universal harness qualification. Some usage receipts are missing in both variants, so no token or dollar savings are claimed. The $500 ceiling was preserved using conservative allowances; failed attempts and unknown charges remain in the ledger. Reproduce the focused additions with `pnpm exec vitest run packages/adapters/claude-local/src/server/acp.test.ts` and `pnpm --filter @paperclipai/paperclip-runner exec vitest run src/native-session-runtime.test.ts`. Full checks use `pnpm -r typecheck`, `pnpm test:run`, `pnpm build`, and the separate runner checks. Paid evals require the frozen definitions, profiles, and credentials; do not use `--all` as a substitute for the selected cases. ## Risks - Context placement changes can affect model behavior. Deterministic checks cover the selected paths, but live qualification remains incomplete. - The stale-question guard can reject a request when queued human comments arrived during the run. This is intended. - New stored inputs and model envelopes retain compatibility readers for older active sessions. - Custom templates may intentionally repeat content. - Removing a model-facing working-directory sentence does not change filesystem, command, sandbox, or permission configuration. - The worker bypass applies only to same-origin development module paths. Cache-policy tests preserve private-response handling and production asset caching. Mounted HTTP fixture changes remain test-only. - This PR does not claim measured token savings or statistical equivalence across every harness. ## Model Used OpenAI Codex, exact model gpt-6-astra, with repository tools and code execution. Bounded supporting work used gpt-5.6-luna and gpt-6-luna. The serving context-window size is not exposed in this task. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have described the issue in-PR using the required issue fields - [x] I have not referenced internal/instance-local Paperclip issues or links - [x] My branch name describes the change and contains no internal ticket id - [x] I have run the focused local checks and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect these changes - [x] I have considered and documented risks above - [x] All current-head Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups for the current head - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
115 lines
5.7 KiB
Markdown
115 lines
5.7 KiB
Markdown
# Task context ownership contract
|
|
|
|
## Purpose
|
|
|
|
Paperclip assembles a task brief and a wake event for several adapter lanes.
|
|
Each task description or current comment has one automatic model-facing owner
|
|
when its source can be verified. This contract makes the source explicit while keeping the existing
|
|
task, wake, continuation, attachment, and custom-template fields intact.
|
|
|
|
## Ownership
|
|
|
|
Heartbeat-generated context carries an additive `paperclipTurnContext` object:
|
|
|
|
```ts
|
|
{
|
|
version: 1,
|
|
assignment: {
|
|
owner: "task_markdown",
|
|
description: { id: issueId, revision: sha256(trimmedSanitizedDescription) }
|
|
},
|
|
events: {
|
|
owner: "wake_prompt",
|
|
comments: [{ id: commentId, revision: sha256(trimmedSanitizedBody) }]
|
|
}
|
|
}
|
|
```
|
|
|
|
The ordered comment references preserve distinct comment IDs even when bodies
|
|
match. A revision is evidence for the exact source body used to assemble the
|
|
run context; it is not an authorization token. Current event rendering keeps
|
|
its trust, author, attachment, omission, ordering, and follow-up rules.
|
|
|
|
`buildPaperclipTaskMarkdown` defaults to its historical behavior for standalone
|
|
callers. Heartbeat full and compact assignment markdown selects assignment-only
|
|
rendering, while the structured wake prompt owns current comment bodies. Missing
|
|
ownership metadata uses the legacy wake behavior, which preserves third-party
|
|
contexts and old serialized runs.
|
|
|
|
Custom templates continue to receive their existing task markdown, wake prompt,
|
|
wake JSON, and context variables. Automatic gateway JSON is omitted only when
|
|
the wake prompt already owns the event; environment payloads and explicit
|
|
custom template inputs remain complete. Prepared local CLI sessions, ACP
|
|
sessions, and standalone gateway runs retain their prior session and fallback
|
|
contracts. A standalone caller that has no ownership metadata continues to
|
|
render its wake comments through the existing renderer.
|
|
|
|
Continuation rendering suppresses a current comment only when the continuation
|
|
is for the same issue, the message ID is present in the actually rendered
|
|
continuation selection, and the trimmed body matches. Edited bodies, missing
|
|
resume-delta messages, deleted messages, unrelated issue IDs, and distinct IDs
|
|
with equal bodies remain visible.
|
|
|
|
The continuation builder records `objectiveSource` when it selects the current
|
|
objective. A comment source uses its comment ID and update revision. A task
|
|
description or title uses its issue ID and a hash of the trimmed source text.
|
|
The renderer can then refer to the displayed source instead of repeating its
|
|
body. It retains the full objective for older envelopes, unknown or stale
|
|
revisions, a truncated brief, or a source absent from the selected resume delta.
|
|
This preserves changed task fields on compact resumes.
|
|
|
|
## Source and completion checks
|
|
|
|
Completion references may point to the task ID, description source ID and
|
|
revision, and ordered current comment IDs and revisions. A reference is valid
|
|
only when its source block was rendered into the model task prompt. Native
|
|
completion-only recovery restores the complete current criteria and removes
|
|
source references after replacing the task prompt; it must not infer ownership from text matching or
|
|
drop an unverified source.
|
|
|
|
## Compatibility and rollback
|
|
|
|
Schema identifiers `paperclip.native-execution-input.v5` and
|
|
`paperclip.native-model-envelope.v3` are public redaction discriminators; v4
|
|
and v2 remain supported for retained sessions and older checkpoints. Session
|
|
pinning must keep v4/v2 readers available while active sessions still reference
|
|
them.
|
|
|
|
If ownership assembly must be rolled back, first restore reader support for
|
|
active v5/v3 sessions and retain the v4/v2 readers. Then disable new ownership
|
|
metadata production and return automatic lanes to legacy wake rendering. Do
|
|
not delete checkpoints, invalidate active session pins, replay external
|
|
actions, or discard source comments. Existing runs must continue to read their
|
|
persisted schema and completion context until they reach a terminal state.
|
|
|
|
## Maintained harness selection repair (2026-09-22)
|
|
|
|
`selectPaperclipPromptSections` selects assignment and wake sections together.
|
|
Legacy CLI, ACP, cloud and gateway adapters use it. The native input builder uses
|
|
it for the full bootstrap. The native runner keeps its existing prepared input
|
|
and verified continuation rules. It does not import application adapter utilities.
|
|
|
|
The adapter selects sections for the same session attempt that it dispatches.
|
|
If that resume fails and the existing recovery policy permits a fresh retry,
|
|
the adapter selects the full brief, history, bootstrap and instructions again.
|
|
The repair does not add a retry or decide whether an external action is safe to
|
|
repeat. Existing session and recovery checks still make those decisions.
|
|
|
|
Pi carries its default Paperclip rules in its system extension. The user prompt
|
|
does not carry another default copy. Explicit custom templates retain their
|
|
existing carriers and variables. A gateway with a separate execution-contract
|
|
carrier can suppress the wake copy while retaining the current event delta.
|
|
|
|
Paperclip owns task content and its source authority. The harness and execution
|
|
environment own filesystem and command permissions. A working directory is not
|
|
filesystem confinement. The approved removal of the workspace-only prompt line
|
|
does not add confinement or change permission flags. Local harnesses retain the
|
|
access granted by their configuration. Sandboxed paths retain their enforced
|
|
boundaries. This repair must not replace that product choice with another prompt
|
|
restriction.
|
|
|
|
This follow-up changes no stored input version or session identifier. Rolling it
|
|
back does not require deleting sessions. Keep the v5/v3 reader compatibility
|
|
rules above when rolling back the earlier prepared-context change. Native Pi,
|
|
Kimi and Grok are not enabled by this repair.
|