mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-11-06 23:20:53 +01:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - Native Runner starts provider runtimes in remote execution environments. > - Sandbox images already contain qualified provider packs. > - Startup required the image pack to match the entire current app release manifest. > - An unrelated app commit could therefore cause pack verification, transfer, and installation again. > - This pull request selects protected packs by their provider interface and platform. > - The benefit is no extra pack probe, directory scan, version command, link, or upload on the compatible image path. ## Linked Issues or Issue Description **What happened?** Starting a remote task can reject a compatible image pack because its source revision or unrelated provider differs from the controller. Pack replacement added about 16 seconds in the investigated startup. Startup also repeated full content checks. **Expected behavior** Use an already qualified, protected pack when its selected provider interface and target platform are compatible. Keep the selected artifact identity for process launch and recovery. **Steps to reproduce** 1. Install a qualified provider pack in a sandbox image. 2. Start a controller built from another app commit. 3. Start a remote OpenCode task. The old complete-manifest comparison rejects the image pack even when the provider interface still works. Related repairs: #16493 reduced transfer cost. #17512 retained exact artifact authority during reattachment. This change preserves that recovery rule and changes fresh-launch pack selection. ## What Changed - Add explicit OpenCode and ACPX interface revisions to produced pack manifests. App Git SHAs and dependency pins remain provenance. - Read bounded protected-installation metadata in the existing final runner metadata query. Accept only root-owned paths that the execution user cannot write, including ancestors and manifest. Reject writable aliases. - Select and prepare the pack in server-owned environment setup before constructing the existing transport. Bind provider launch paths and digests from the selected installation. Save that identity for exact reattachment. - Keep full content verification for uploads, writable installations, and legacy packs. Reuse successful verification within one startup. Keep older attached runners compatible with the optional metadata request. - Seal image packs and document the one-time image refresh that enables reuse across later compatible releases. Keep selected ACPX agent qualification checks. ## Verification - Red/green regression: the old code rejects a protected pack from another app revision with `manifest mismatch`; the fixed path selects it without executing verification commands. - Native startup regression: select the installed pack's own Node digest with one existing runner metadata request and no pack verification or version commands. - Targeted pack, artifact, recovery, execution-driver, and Rust metadata tests pass. Incompatible interfaces/platforms, malformed identities, writable roots, path aliases, and exact reattachment are covered. - Final revision `91dc1676ff67bdbe5866c8586daac10240530cca`: workspace typecheck and build pass. All 53 current-head checks are successful, with no pending or failed checks. Greptile is 5/5 with no open findings. - The broad local `pnpm test:run` attempt reported a workspace-runtime conflict test failure; its isolated rerun passed. The broad run was stopped after that failure. Full CI now passes, including the server test shards. This is not a claim that the full local run passed. - Linux filesystem evidence: the production metadata functions read a real root-owned preinstalled pack as a non-root user in 16 microseconds median and 20 microseconds p95 across 100 warm reads. This measures metadata admission, not model or hosted response latency. - All 910 affected server tests and 57 Copilot attestation tests pass locally on the final implementation. Full CI covers the unchanged Runner transport. No provider qualification hash was refreshed. - Built the actual Linux daemon at `416e7ec7425d0d3565b4a5e1808002d650a60414` and ran its metadata command as UID 65534. The protected installation returned its real manifest with `immutable: true`; writable alias and missing-pack cases returned `immutable: false`. This is metadata/permission evidence, not provider execution. - Hosted rollout and a hosted end-to-end latency measurement have not run. ## Risks - Existing images need one rebuild to publish the compatibility declaration. Packs without it keep the legacy content-verification path. - Fast admission relies on image publication producing a qualified protected tree. Root execution and task-writable installations retain full verification. - Bump an interface revision when required runner/pack behavior changes incompatibly. Deploy a new image to roll out compatible runtime fixes or upgrades. - This removes provider-pack preparation delay. Other runner startup, context, model, and finalization costs remain separate. ## Model Used OpenAI Codex, configured model `gpt-6.1-sol`, reasoning effort `xhigh`, with tool use and code execution. The context-window size is not exposed in this session. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
181 lines
10 KiB
Markdown
181 lines
10 KiB
Markdown
# Paperclip Daytona runner image
|
||
|
||
Ordinary provider packs now include pinned Cursor assets for Linux x64; no
|
||
`--candidate-providers=cursor` flag is needed. Cursor admission is enabled after
|
||
the [production readiness gates](../../doc/plans/2026-10-03-cursor-production-readiness.md)
|
||
passed. The public CLI installation command is `paperclipai runtime setup cursor`;
|
||
it runs explicitly on the execution host and is never an npm installation hook.
|
||
|
||
This image is the Paperclip Cloud fleet sandbox image plus a source-built
|
||
`paperclip-runnerd` and immutable provider pack. The pack contains Node 24.11,
|
||
OpenCode 1.18.34, the compiled OpenCode proxy, ACPX 0.13.1 sidecar, qualified ACP
|
||
agents, and the production lockfile. Its manifest digests each executable bridge
|
||
and records the runner source revision as provenance. Its interface declaration
|
||
allows compatible app releases to reuse it without uploading or installing a pack.
|
||
|
||
The fleet pins are intentionally copied from
|
||
[`paperclip-cloud/fleet-sandbox-image/Dockerfile`](https://github.com/paperclipai/paperclip-cloud/blob/master/fleet-sandbox-image/Dockerfile).
|
||
Update both definitions together until the fleet base is published as a stable
|
||
image that this Dockerfile can extend directly.
|
||
|
||
## Harness versions
|
||
|
||
The October 2026 refreshes pin Codex 0.160.0, Claude Agent SDK
|
||
0.3.286 (Claude Code 2.1.286), and OpenCode 1.18.34 in the shared provider
|
||
pack. Claude Code 2.1.280 is the minimum for
|
||
[Opus 5.5](https://code.claude.com/docs/en/model-config) and 2.1.284 is the
|
||
minimum for Sonnet 5.5; the pinned runtime also supports Fable 5.1. Codex
|
||
0.160.0 ships bundled metadata for the current
|
||
[GPT-6.1 Sol, GPT-6 Sol, and GPT-6 Luna model IDs](https://learn.chatgpt.com/docs/models).
|
||
The same refresh pins Grok CLI 1.0.46, Gemini CLI 0.62.0, Kimi Code 2.1.1,
|
||
Cursor CLI 2026.10.01-e373342, and GitHub CLI 2.102.0 in the sandbox layer.
|
||
The native Cursor provider uses its separately verified distribution, pinned to
|
||
2026.09.26-dd393fe; it does not use the sandbox layer’s global Cursor executable.
|
||
Grok CLI 1.0.46 supports the current
|
||
[Grok 4.7](https://docs.x.ai/developers/grok-4-7) model family. Hermes stays
|
||
at 0.19.0, the newest release on PyPI.
|
||
|
||
Keep the patched ACP bridge versions separate from their CLI runtime pins.
|
||
Their executable digests do not change when only the runtime dependency
|
||
changes. Refresh the runtime executable digests from integrity-verified npm
|
||
release archives for every supported platform, and keep the native runner,
|
||
provider manifest, and remote controller version checks aligned.
|
||
|
||
## Build and verify
|
||
|
||
Run `pnpm --filter @paperclipai/paperclip-runner test:opencode:qualification`
|
||
after installing dependencies to exercise the actual pinned OpenCode executable.
|
||
It checks health/version, session creation and retrieval, SSE messages, an async
|
||
prompt, and session deletion against a loopback mock provider. It uses an
|
||
isolated home, starts no paid model request, and retires its process group.
|
||
Set `PAPERCLIP_TEST_OPENCODE_BINARY` to the materialized Linux executable when
|
||
qualifying an assembled provider pack.
|
||
|
||
|
||
The fleet image is currently amd64-only because the pinned Cursor and GitHub CLI
|
||
checksums cover amd64.
|
||
|
||
```bash
|
||
content_id="$(pnpm --silent test:e2e:runner:image-id)"
|
||
docker buildx build \
|
||
--platform linux/amd64 \
|
||
--build-arg PAPERCLIP_RUNNER_CONTENT_ID="${content_id}" \
|
||
--build-arg PAPERCLIP_RUNNER_SOURCE_REVISION="$(git rev-parse HEAD)" \
|
||
--tag "paperclip-daytona-runner:e2e-content-${content_id}" \
|
||
--load \
|
||
--file docker/daytona-runner/Dockerfile \
|
||
.
|
||
|
||
docker run --rm --platform linux/amd64 \
|
||
--entrypoint paperclip-runnerd \
|
||
"paperclip-daytona-runner:e2e-content-${content_id}" \
|
||
--build-metadata
|
||
```
|
||
|
||
The metadata must advertise `dial_ws_loopback`, `dial_wss`, and `listen_ws`.
|
||
The explicit entrypoint is needed only for this local probe because Daytona's
|
||
base image uses its own long-running sandbox entrypoint.
|
||
|
||
`test:e2e:runner:image-id` hashes the audited Docker build dependency closure,
|
||
target platform, the immutable Dockerfile syntax-frontend digest, and every
|
||
immutable `FROM` reference. It fails before the paid workflow can build when
|
||
the frontend or a base is not pinned to a sha256 digest. When updating the
|
||
syntax version, resolve and review its registry digest and update both values in
|
||
the first Dockerfile line. Git commits that do not change those inputs reuse the
|
||
same content tag.
|
||
|
||
`PAPERCLIP_RUNNER_SOURCE_REVISION` remains the full Git SHA that built the first
|
||
published copy and is retained as provenance rather than cache identity.
|
||
|
||
## Use in Paperclip
|
||
|
||
Publish the image to a registry Daytona can pull, or use the environment
|
||
editor's **Configure image** flow to produce a Daytona snapshot. Set the
|
||
environment image to that immutable tag or snapshot. Paperclip probes the
|
||
sandbox user's `PATH` for `paperclip-runnerd` and `codex` and checks
|
||
`/opt/paperclip-runner/provider-pack` for OpenCode and ACPX. It uses the pack
|
||
when its selected provider interface and platform are compatible. App source
|
||
revisions and unrelated provider pins do not force an update. Startup reads the
|
||
small manifest in the existing runner metadata query. It does not scan the pack,
|
||
run a version command, or transfer files on this path. Otherwise it stages the pack configured by
|
||
`PAPERCLIP_RUNNER_REMOTE_PROVIDER_PACK_PATH`. Remote OpenCode and ACPX never
|
||
fall back to host-local processes.
|
||
|
||
`src/live/provider-pack-contract.json` in the Runner package declares the
|
||
OpenCode and ACPX interface revisions. Change a revision only for an incompatible
|
||
runner/pack boundary change, and qualify the new pack before publishing it.
|
||
Dependency versions and Git SHAs remain build provenance. ACPX retains its
|
||
selected agent's qualified profile checks.
|
||
|
||
The image build makes the pack root-owned and non-writable to the execution user. Fast admission
|
||
requires protected ancestors and manifest, with no writable path alias. Task-owned
|
||
packs and older packs without an interface declaration keep full content
|
||
verification. An attached session retains the exact pack and daemon identity
|
||
admitted at launch. Publish one new image with the interface declaration to enable
|
||
reuse across later compatible app releases.
|
||
|
||
Do not promote `paperclip-runner-e2e-20260826-v2` for OpenCode or ACPX. Build a
|
||
new immutable image or snapshot from a clean committed revision and pass that
|
||
full Git SHA as `PAPERCLIP_RUNNER_SOURCE_REVISION`.
|
||
|
||
Do not bake provider credentials, Paperclip bootstrap tickets, or Daytona
|
||
preview tokens into this image. They remain per-run secret material.
|
||
|
||
The provider-pack build pins the official Linux x64 Node 24.21.0 image by
|
||
manifest digest. Its bundled Undici is 7.29.1, which fixes
|
||
[GHSA-3wwx-pv8p-q78v](https://github.com/advisories/GHSA-3wwx-pv8p-q78v).
|
||
Pi separately verifies its private Node executable and nested npm dependency;
|
||
changing the outer interpreter does not replace either provider-owned pin.
|
||
|
||
Provider CLI updates are manifest-only changes: repository CI owns the root
|
||
lockfile. Resolve the complete workspace manifest graph in the build context
|
||
before invoking Docker, matching CI when a source commit precedes the lockfile
|
||
bot. The trusted workflow supplies this resolved lockfile as an immutable artifact.
|
||
The complete resolved lockfile must match `PAPERCLIP_RUNNER_LOCK_SHA256` before
|
||
package installation or lifecycle execution. Review and refresh that digest
|
||
with source dependency changes; registry-time resolution drift fails closed.
|
||
The Product E2E workflow resolves one lockfile before the image build. It
|
||
verifies the downloaded artifact, then passes that artifact's SHA-256 as the
|
||
`PAPERCLIP_RUNNER_LOCK_SHA256` build argument. The Dockerfile checks the resolved
|
||
lock against this value before installation. The fixed Dockerfile default is
|
||
for standalone builds; it must not replace a campaign's verified lock digest.
|
||
Refresh the default from the clean tracked lockfile using the exact
|
||
`pnpm install --resolution-only --ignore-scripts --no-frozen-lockfile` command,
|
||
and verify a second resolution preserves the digest. A lockfile left by a
|
||
filtered or incremental install can retain stale importer patch identities.
|
||
Refresh exact runtime versions and qualification digests together; do not
|
||
download dependencies when a task starts.
|
||
|
||
## Candidate ACP qualification assets
|
||
|
||
Provider branches can build their pinned assets with
|
||
`node packages/paperclip-runner/scripts/build-provider-pack.mjs /absolute/pack --candidate-providers=cursor`
|
||
(or `copilot` or `pi`). The source revision must include the named provider's
|
||
builder. Assets are installed at build time under `provider-assets/<provider>/<platform>-<architecture>`.
|
||
The pack manifest binds each complete asset tree. Runtime admission separately
|
||
checks the provider's source-owned closure pins and copies a verified launch snapshot.
|
||
A pack with candidate assets does not qualify or enable that provider.
|
||
|
||
For an isolated Linux x64 Daytona qualification image, pass
|
||
`--build-arg PAPERCLIP_RUNNER_CANDIDATE_PROVIDERS=cursor` with the normal build arguments.
|
||
Compute its content ID with the same selection:
|
||
`pnpm --silent test:e2e:runner:image-id --candidate-providers=cursor`.
|
||
Candidate assets and the default pack have distinct image identities. Never reuse
|
||
the default image's content ID for a candidate build.
|
||
Use each provider branch's recorded version and explicit model. Keep credentials
|
||
out of images. Paid qualification requires bound provider and Daytona credentials,
|
||
inspectable spend, and the shared $100 ceiling recorded in the capability report.
|
||
|
||
The pack builder tests its copied Node interpreter after relocation. Use a
|
||
standalone Node distribution if the host interpreter depends on a package manager's
|
||
private shared libraries. Pi additionally pins its complete portable interpreter
|
||
and npm dependency graph.
|
||
Refresh exact runtime versions and qualification digests together; never download
|
||
dependencies when a task starts. Grok's additive native ACP profile keeps its
|
||
qualified 1.0.13 executable at the verified sandbox prerequisite path. It does not replace the
|
||
legacy adapter's `grok` command on PATH.
|
||
|
||
Native Grok is an image prerequisite at `/opt/paperclip/providers/grok/1.0.13/grok`.
|
||
Its checksum-verified provisioning is separate from the provider pack, which ships
|
||
only the built-in launcher. Public npm installation never downloads this binary.
|