Files
PaperClipAI/doc/grok-native-runner.md
Dotta 73eee2c0d6 docs: Pi core production readiness evidence (5/5) (#14956)
## Thinking Path

> - Paperclip manages AI agents and their work.
> - The experimental Runner owns provider processes and durable
sessions.
> - Pi needs working task execution and human controls.
> - The five-PR stack must preserve changes already on master.
> - The runtime implementation has merged in #14921; this layer carries
the next documentation changes.
> - This PR belongs to native GitHub stack #15602, ending at #14956.

## Linked Issues or Issue Description

Refs #14436, #14631, #14743 and #14956.

Ship Pi 1.0 through the experimental Paperclip Runner. The five PRs are
#14921, #14922, #14923, #14924 and #14956. The user authorized the
complete merge after checks pass. Existing `pi_local` execution is
unchanged. Accounting and wider provider/platform qualification remain
deferred.

## What Changed

- Record the seven source-bound Pi core passes and retained
failed-attempt provenance.
- Document agent-file artifacts, warm instruction-root recovery, final
task replies, and installed Runner verification.

## Verification

- Full local `pnpm -r typecheck` passes, including Runner Rust, server
and UI. Focused integration checks pass: 194 Runner
admission/environment tests, 63 profile/credential tests with one
expected skip, 152 Dot/UI configuration tests, and Pi transcript/notice
tests.
- Full local `pnpm build` passes on the final source.
- Fresh final-source checks pass: all 698 Rust workspace tests (32
binaries), 156 credential/profile/controller tests with one expected
skip, Runner TypeScript typecheck, and 20 package/setup/sandbox tests.
- The profile-21 Pi materializer passes on the native host with the
official pinned Node 24.21.0 and its npm. It verifies all 150 locked
packages, the patched dependency and the exact closure. Setup/package
bundle tests and UI token gates pass.
- The old hashes were reproduced for all three supported targets before
calculating the patched graph. New closure hashes are darwin-arm64
`282022db10150c6632b3444df421342e7d534bdf5d5fb1097a2e79d0625a2bcf`,
darwin-x64
`64e251e19009f755c0b04f73ce2138246faab71a961b0f13d75ebfcc34bef12e`, and
linux-x64
`713b1fdff42fb56a1518bdc084f181d70bee8ebadc3e4b1d76321ed9108c8410`.
Independent native platform execution is separate from graph identity
reproduction.
- Historical cloud qualification remains unchanged: all seven core cases
pass on shipping source `10dc43c9ec65d88c2f782d62afb296d09494f215`,
harness `1a4408a48cfb5a1f094a311141c257c92cd7a893`, image
`sha256:5b3a775b383591bda1b0c1889e509acc70ce7f37c53f09733c81d59037f02280`,
and accepted Sonnet 4.6/low fixture. All 215 canonical files and all
seven cleanup checks pass independent verification. These are profile-19
results and are not relabeled as fresh profile-22 runs.
- Current Pi digest:
`sha256:e92078bee3c23bec4100aa589013a44613d054cd686826534025d8019e9f39a9`.
[The readiness
plan](https://github.com/paperclipai/paperclip/blob/codex/pi-production-readiness/doc/plans/2026-10-02-pi-production-readiness.md)
preserves campaign and failed-attempt provenance.
- Merge only after every PR's current-head CI and fresh review pass.
Linux CI covers the full suites, build and browser tests. The local
embedded Postgres API-authority suite cannot start on this macOS/Node 26
host, so Linux CI must confirm that suite.

### Fresh profile-22 core qualification — 2026-10-08

All seven accepted core cases pass canonically on Pi profile 22, with
`openrouter/anthropic/claude-sonnet-4.6` and native-confirmed low
thinking. This model is a fixture; production accepts the caller's
explicit Pi provider/model.

Runtime/install source: `3241a992f2a7703e59e97ed0fd3e5d6405de4401`.
Frozen accepted harness: `1a4408a48cfb5a1f094a311141c257c92cd7a893`.
Immutable cloud image:
`ghcr.io/paperclipai/paperclip-daytona-runner@sha256:506f22db7edd78f37c0c40bec1cc084af1850455026dbf467194bfbb8fcef141`.
Pi digest:
`sha256:e92078bee3c23bec4100aa589013a44613d054cd686826534025d8019e9f39a9`.

[Hosted Linux image and clean-install
verification](https://github.com/paperclipai/paperclip/actions/runs/37868328023)
passes, including all 20 source-bound archives, normal CLI/Pi setup,
companion import and the production pack reader. This exact installation
source includes the latest master integration and the corrected Pi warm
instruction-root fence. Full local typecheck/build and current-head
hosted CI verify the final stack. All 13 focused real-root regressions
pass. The full local executor suite passed 662 tests; 15 database tests
could not start the Mac embedded PostgreSQL service. Hosted Linux CI
passes the full required verification and E2E checks. These fresh
results keep their own source identity; profile-19 results remain
historical.

| Core path | Canonical campaign | Retained archive SHA-256 |
| --- | --- | --- |
| File edit, validation, download and Done |
`pi-core22-replyfix-0-1791511228` | 23 files;
`a473e8603a3dd4737863291f8d3d1e392391f0b16d433c3e0e0e9d8baf7a97b0` |
| Pending question and controller restart |
`pi-core22-replyfix-1-1791511376` | 33 files;
`6b829c4eb74e1f32a89c692a4ae7130dbfc1c6d3cf13915effe2103d9e242c8e` |
| Three-turn session/process/workspace continuity |
`pi-core22-replyfix-2-1791511587` | 23 files;
`7a87021f8f9a3fdd3c58bb4467f8d82c635e3ea4795d6e75f144d9aa14818df8` |
| Four typed questions and browser reconnects |
`pi-core22-replyfix-3-1791511881` | 42 files;
`9e31755252be1f4f9cb0626c984c142d4d1ae5f5bee3a7af08444db8d12c280a` |
| Plan approval and completion | `pi-core22-replyfix-4-1791512031` | 22
files;
`a0383ce1aab38e7b5a25ce0e9dd3bebea5c037ebd96ae6b29dae19015da2ae2c` |
| Same-turn steering and permission denial |
`pi-core22-replyfix-5-1791512261` | 39 files;
`c929b8c7070f0b66aedc17e65ca46e6beab1e363926ac9f7e2a75fb250f05949` |
| Stop during pending permission | `pi-core22-replyfix-6-1791512390` |
33 files;
`7f0a58ae0f4d5bfc76149435f4e322537089c5bd16e7ffe9b5ad71f10a621a07` |

All 215 canonical files (28714587 bytes) are independently
hash-verified. All seven cleanup grades pass, with no owned runtime
process or temporary root after each case. Automatic retries are zero.
The owned cloud host stopped normally after retention. The prior
profile-22 warm attempt remains failed and separately retained: archive
SHA-256
`1e54eba5ec72b50cee1534b23d1d1d4f21a090006b8a64501ba70db972abfde5`. Its
original canonical classification is preserved. Diagnosis reproduced a
product bug comparing an agent-files root against an unset
checkpoint-only field. The fix stores the admitted physical root
separately from the adopted per-run collection capability. The real-root
regression fails before the fix and passes afterward, including
rejection of a changed physical root. Fixture, grader, model and all
seven accepted case IDs are unchanged; this fresh campaign tests
final-reply publication after file registration first. The intermediate
restart attempt also remains failed and retained: archive SHA-256
`5dcaefdf1d17cf4cd54fd4cf810f45e736667392339b8ce7caf08bb4e225277f`. Its
original canonical classification is preserved. Pi resumed, wrote the
verified answer and completed its task; exact runner suspension was
proven, but idle stop consumed about 5.2s and left under 3s for the
drain acknowledgement. The Pi-only default shutdown grace is now 15s,
preserving a full 5s drain round trip and a finite suspension reserve.
Explicit caller deadlines, other provider defaults, literal drain
receipts and exact suspension identity checks remain unchanged. The
timing regression fails before this correction and passes afterward; all
18 focused settlement tests and Runner typecheck pass. The final-source
file attempt is also preserved as failed (`candidate_failure`), archive
SHA-256
`db6767b6773ea618997927ac77bdb005a5ac81492c7b9c0ffbc900449f829bc9`.
Native edit, validation, exact downloadable artifact and Done/succeeded
all passed, and the exact final reply was durably recorded. A workspace
recovery owner completed before the live heartbeat reached presentation,
leaving that reply absent from task chat. Recovery now materializes only
a completed final reply from the accepted turn of an ordinary internal
Done task, preserving issue/run/contract binding, suppression,
external-chat authorization and same-run deduplication. The database
regression covers the generated file-preparation receipt, suppression,
unapproved external continuation and replay. Server typecheck and all 49
response-selection tests pass; hosted Linux verifies the database
regression because embedded PostgreSQL cannot start on this Mac.

The delayed-final-answer database regression passes on [the final
root-source Linux server
shard](https://github.com/paperclipai/paperclip/actions/runs/37868262553/job/113628594152),
alongside 1,108 passing tests. The first root Runner shard had one
unchanged durable-resume test exceed its 5-second timeout; the identical
top-source shard and the isolated exact test passed. One rerun of that
failed job and its required aggregate passed without source or test
changes. The original failed job log and the single-rerun receipt remain
retained.

### October 9 merge verification

Current merge head: `e77273aa0fce5991a5b5dd193734fd6b0a6542d3`. All
current-head checks pass, including `ci / verify` and `ci / e2e`;
exact-head Greptile review is 5/5 with no unresolved threads. Current
master conflicts are resolved. The user authorized the maintainer
override of the code-owner review gate after these checks. The seven
retained live core cases remain bound to source
`3241a992f2a7703e59e97ed0fd3e5d6405de4401` and its recorded cloud image.

## Risks

- The security correction changes the dependency closure and profile
identity. Old sessions must reopen on the new profile. Exact identities
and credential bindings fail closed.
- The runner remains experimental and requires explicit selection.
Legacy Pi Local is unchanged. Caller model IDs pass through; the E2E
model is a fixture.
- Accounting and the broad platform/provider matrix remain deferred.
This merge does not publish a release or deploy a service.

## Model Used

OpenAI GPT-6 through Codex assisted with reasoning, repository
inspection, editing and tool use. The exact serving ID and context
window are not exposed in this session. Final live qualification uses Pi
1.0.0 with `openrouter/anthropic/claude-sonnet-4.6` and native-confirmed
low thinking.

## Checklist

- [x] I have included a thinking path that traces from project context
to this change
- [x] I have specified the model used (with version and capability
details)
- [x] I have checked ROADMAP.md and confirmed this PR does not duplicate
planned core work
- [x] I have searched GitHub for duplicate or related PRs and linked
them above
- [x] I have either (a) linked existing issues with `Fixes: #` / `Closes
#` / `Refs #` OR (b) described the issue in-PR following the relevant
issue template
- [x] I have not referenced internal/instance-local Paperclip issues or
links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip`
URLs)
- [x] My branch name describes the change (e.g. `docs/...`, `fix/...`)
and contains no internal Paperclip ticket id or instance-derived details
- [x] I have run tests locally and they pass
- [x] I have added or updated tests where applicable
- [x] I have updated relevant documentation to reflect my changes
- [x] I have considered and documented any risks above
- [x] All Paperclip CI gates are green
- [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups
- [x] I will address all Greptile and reviewer comments before
requesting merge
2026-10-09 11:15:09 -05:00

8.2 KiB
Raw Permalink Blame History

Grok Build native runner

Select Grok Build in the native runner provider selector. The stored contract is adapterType: "paperclip_runner" with provider: "acpx", acpxAgent: "grok", and model: "grok-4.7". Existing grok_local agents keep their legacy adapter. New Grok runner agents default to Full auto (approve all) (acpxPermissionMode: "approve-all") in setup and the configuration form. API configurations that omit the permission mode use the same default. No additional permission setting is needed for unattended execution. Explicitly saved restrictions remain unchanged. On Cloud, an operator must enable enableNativeRunner for the instance before the new-agent picker or direct setup page offers the native runner.

Grok Build speaks ACP over stdio. The runner owns grok agent --no-leader stdio through ACPX, including session identity, cancellation, recovery and the authenticated Paperclip MCP bridge. ACP permission requests are approved by the runner under the default full-auto policy. It does not add --always-approve: permission decisions remain under the selected ACPX policy. Grok's ACP metadata cannot independently establish Paperclip tool authority, so explicitly selecting approve-paperclip or approve-reads returns the approval-required outcome; deny-all rejects requests. Full auto does not bypass Paperclip's company permissions, governed approvals, or execution-environment boundaries. Isolated ask rules override project allow rules, and compatible always-approve settings are locked off. Compatible hook/MCP discovery and shell login capture are disabled.

Installation and identity

Grok support ships inside the native runner and the public Paperclip server npm artifact. There is no separate Grok npm package, binary payload, or npm lifecycle download. The built-in launcher is identified as builtin:grok-acp version 1; its native runtime identity is native:grok version 1.0.13. The historical agentServerPackage/agentRuntimePackage wire fields carry these identities, not npm dependencies. Existing npm-backed ACP bridges retain their package pins.

Provision Grok Build 1.0.13 at /opt/paperclip/providers/grok/1.0.13/grok in the selected execution environment. The sandbox provisioning helper is explicit and is never run by npm:

sudo node packages/paperclip-runner/scripts/provision-grok.mjs /opt/paperclip/providers/grok/1.0.13/grok

The standard Daytona image provisions it separately from the provider pack. Custom images and local execution hosts must provide the same prerequisite. The runner verifies the native executable checksum before credential refresh or ACP startup; a missing prerequisite reports the required path and version. Only macOS arm64 and Linux x64 are qualified. No ambient grok from PATH is used. ACP must report the requested exact model; mismatches fail closed.

The distribution identity change deliberately rejects resume bindings from the former private-package profile. Start a fresh session after upgrading that unreleased profile; do not silently reinterpret its saved identity.

Instructions use Grok ACP session rules. Assigned skills live in the isolated Grok home. Steering and goals are unsupported. Token and cost values remain unknown when Grok does not report them; missing usage is not zero usage.

Authentication

Use the existing Grok company connection/login flow for subscription execution. An explicitly selected company-secret XAI_API_KEY selects paid API execution. There is no automatic subscription-to-API fallback. Remote execution cannot borrow the operator's home credentials. Local execution can use the operator's existing Grok login when no company login has been selected.

Only the selected credential is staged in the private runtime home. An ownership lease fences concurrent processes. Before ACP startup, an expiring subscription credential is refreshed through the verified Grok executable’s non-inference models command. This bounded step suppresses output and prevents Grok 1.0.13 from caching a pre-refresh model list. Exact model verification still precedes any prompt; refresh failure requires reconnecting Grok Build. After the provider exits, refreshed credentials are copied back through Grok's existing identity and refresh checks. Runtime credentials, refresh handoffs, and diagnostic logs are excluded from workspace backups and removed on close. Session history remains available for resume. Host configuration, other provider credentials and unselected keys are not forwarded to Grok.

Evaluation

The private paperclip-evals repository maintains live-acpx-grok-4.7.json and rosters/live-acpx-grok.json. The roster covers all 39 protocol cases. Its campaign lane remains disabled pending complete live qualification.

Product E2E exposes runner-acpx-grok in core local/Daytona compatibility and local session integrity. The explicit grok-qualification suite covers replies, planning approvals, structured questions, downloadable project revisions, stop/resume and continuation after controller restart in both environments. Run with --suite grok-qualification; it is excluded from scheduled --all. Use the canonical Product E2E dashboard and Evalbook reports.

The separate grok-subscription-qualification suite covers the same workflows with the explicit GROK_AUTH_JSON fixture credential. It seeds only the disposable company's private login home and supplies no API key. It does not exercise the interactive sign-in UI. Authentication mode remains part of the profile identity. After a subscription upgrade, a fresh grok login may be needed if the existing login still reports the previous entitlement through ACP.

packages/paperclip-runner/scripts/grok-native-smoke.mjs records explicit auth, model/binary identity, MCP outcome, durable resume and restrictive permissions. Pass --auth subscription --auth-file /private/path/auth.json --output /private/report.json or --auth api --output /private/report.json with an explicitly supplied key. Each attempt is retained; unknown usage and cost are null.

Qualification requires the full protocol roster, selected product workflows, subscription and API execution locally and on Daytona, and three successful repetitions of core tool, approval and resume cases. Deterministic tests or a single successful browser task do not establish that qualification.

Remote verification

Do not run Docker on a developer laptop when using remote verification. The Docker Runner check workflow offers maintainer-authorized manual Linux image builds and broad source checks without provider credentials. It records the source revision, resolved lock digest and immutable image reference. Paid Product E2E remains behind the protected default-branch workflow and environment.

The public npm consumer check uses a digest-pinned, unprivileged container with no checkout or credentials mounted. It downloads dependencies with lifecycle scripts disabled and freezes the resulting consumer lockfile. It completes the clean install with offline npm rebuild, running the deferred lifecycle hooks without re-resolving bundled optional dependencies. Networking stays disabled, the lockfile must remain unchanged, and a sentinel proves scripts actually ran. The pinned image includes native build tools and local Node headers so dependency hooks can compile without network access. Both executable admission probes run in the same isolation. The verification user provisions Grok inside the disposable test directory without privilege elevation or host /opt changes. Only the positive probe mounts that binary read-only at the canonical sandbox path.

The Cloud application image also carries the controller-owned provider pack and sets PAPERCLIP_RUNNER_REMOTE_PROVIDER_PACK_PATH. Remote ACPX execution verifies the sandbox against that pack before using it, or stages the matching pack when needed. The Cloud controller image does not install the native Grok executable; the selected sandbox image must provide the prerequisite above. Cloud builds must supply the full source SHA through PAPERCLIP_BUILD_COMMIT to produce that verified pack. Unstamped local Cloud builds still work for other features, but omit the pack and cannot start remote ACPX sessions.