mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-11-10 20:46:28 +01:00
fix(claude): prepare compatible sandbox runtimes during onboarding (#17259)
## Thinking Path > - Paperclip connects agent accounts and prepares their execution environments. > - A managed sandbox image can outlive the model defaults shipped by the app. > - Claude setup skipped installation whenever a CLI was already on PATH. > - The selected model then failed its minimum-version check after sign-in succeeded. > - This pull request prepares a compatible private CLI before testing or running it. > - Cloud onboarding also stops asking customers to run inaccessible shell commands. ## Linked Issues or Issue Description **What happened?** A new managed Cloud stack completed Claude subscription sign-in. Its environment test then failed because the snapshot contained Claude Code 2.1.263, while the selected `claude-opus-5-5` model requires 2.1.280. The screen displayed Manual debug commands that a hosted customer cannot run. **Expected behavior** Paperclip prepares its managed runtime before testing the selected account. A stale image CLI does not require the customer to upgrade a server package. Failed preparation still blocks hiring. Cloud does not display manual shell debugging. **Steps to reproduce** 1. Start a managed sandbox with Claude Code 2.1.263 on PATH. 2. Connect a Claude subscription and select `claude-opus-5-5` on the CLI lane. 3. Connect the agent. Installation is skipped because the command exists, then the version gate blocks the hello test. **Paperclip version or commit** Source baseline: `6204239cfc8c3be79fc185cf3f468ebaa0ab1e3e`. **Deployment mode** Authenticated managed Cloud with a Daytona named snapshot. The correction also applies to the default CLI in other managed sandbox transports. Related work: Refs #14993 sets model/runtime requirements; Refs #15993 changes native defaults on qualified targets. Neither prepares an outdated default sandbox CLI on this path. Searches found no open duplicate. ## What Changed - Check the actual default CLI against the selected model's existing minimum version. - When a sandbox's default command is outdated, install the exact required npm package into a private versioned workspace prefix. Reuse a compatible private installation. Keep the image's global CLI intact. - Verify the private executable and use that same command for the account hello test and normal CLI runs, with matching command metadata. Probe effort support after preparing that executable so the chosen effort is retained. Keep the model, account, engine and permissions unchanged. - Return safe preparation checks to environment tests and normal run logs, distinguishing installation failure causes without returning raw installer output or credential-bearing URLs. - Exclude provider and Paperclip credentials from the installer environment. Preserve the existing failing version gate if installation or verification cannot succeed. Local, SSH and explicit custom commands remain operator-managed. - Hide Manual debug and legacy operator check hints on Cloud and while deployment metadata is unknown; preserve check messages and details. Retain self-hosted help and the detailed failed checks. Cloud copy asks for a retry instead of asking the customer to repair the environment. - Add subprocess-backed runtime controls, an account-probe regression and mounted Cloud/self-hosted wizard controls. Update development guidance and the affected capability maps. ## Verification - Passed all Claude source suites and the server Claude execution suite on head `c941ae44c22d8dafec0df033a129e39ce4ebd966`: **412 passed**, one existing opt-in test skipped. These include the new command/effort ordering, safe installer diagnostics, environment forwarding and run-log regressions. - On final head `0ecae0e9304f495a57524158b3700b8e9bc21cb8`, passed **208 tests** across all 174 mounted onboarding wizard tests and 34 Claude execution tests. The failure fixture includes the real command-bearing hint, and execution asserts both metadata command fields agree. - Passed `pnpm -r typecheck`, `pnpm build`, `pnpm check:token-gates`, `node scripts/check-maps.mjs` and `git diff --check`. Full typecheck and build were repeated successfully on final head `0ecae0e9304f495a57524158b3700b8e9bc21cb8`. [Latest-head CI](https://github.com/paperclipai/paperclip/actions/runs/39879208694) is green: 54 checks passed and two skipped, including browser E2E and serialized database suites. - The new runtime controls execute real subprocesses with a controlled installer. They cover an old CLI, an already compatible CLI, failed or ineffective installation, local/custom commands, and an unknown version. The probe regression asserts that the hello call uses the private executable. - A separate non-root local subprocess check installed the real npm `@anthropic-ai/claude-code@2.1.280` package. Its private command reported 2.1.280, the simulated image CLI remained 2.1.263, and a second preparation reused the private copy. This ran on macOS ARM64. It did not use a provider account, send a model prompt, or prove live Daytona behavior. - Attempted `pnpm test:run`. Embedded PostgreSQL initialization failed after five attempts on this Mac with `Postgres init script exited with code null`. The unchanged native-session database cases then failed. Stopped only that full-suite process tree after recording the repeated startup failure. No full local-suite pass is claimed; Linux CI must cover those tests. - The first new subprocess fixture had a quoting syntax error. It was corrected before the passing focused runs. The one-off real-package script first required an ESM extension correction, then passed. Logs retain both attempts. A new execution assertion initially inspected the final sandbox cleanup shell instead of the launched command; it now checks execution metadata. A broader directory selection also picked up generated `dist` tests whose Markdown fixtures are not copied by the build (two ENOENT failures). The explicit source-suite run above passes; no generated-test pass is claimed. - Apex review: **5/5**, reviewed final head `0ecae0e9304f495a57524158b3700b8e9bc21cb8`, all five earlier findings addressed and resolved, no new findings. - Merge, deployment and a fresh live Cloud subscription test are still required. No customer account or production runtime was changed by this branch. ## Risks - An outdated sandbox needs npm registry access and up to 120 seconds for one bounded installation attempt. A failed or unverified install continues to block execution. - The versioned package uses sandbox workspace storage. Compatible cached copies avoid repeat installation within that workspace. Existing runtime cleanup and sandbox lifecycle still apply. - The compatible version comes from the adapter's existing model-version contract. This does not add a model fallback or change the selected execution engine. - No schema, credential, permission, workflow or lockfile change. ## Model Used OpenAI Codex, based on GPT-6, assisted with implementation and verification. The exact serving model ID and context-window limit are not exposed in this session. Capabilities used: code editing, shell execution, API inspection and test execution. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
This commit is contained in:
1 parent
650581b2f0
commit
c5ca29dbef
13 files changed
+409
-36
No files matched your search
@@ -96,6 +96,19 @@ testing an existing agent; interactive account login additionally requires a
|
||||
board user and owner-bound session. An agent's right to hire is not login or
|
||||
instance-environment administration authority.
|
||||
|
||||
Scoped source-only runtime preparation: the existing authorized adapter test
|
||||
prepares the default Claude CLI in its already acquired sandbox when the image
|
||||
version is too old for the selected model. It installs a pinned package into a
|
||||
workspace-private versioned prefix and verifies the executable before the hello
|
||||
test. This adds no installation API, account grant, environment authority or
|
||||
engine fallback. Cloud UI omits manual shell debugging and legacy operator hints
|
||||
while retaining check messages and details. Local, SSH and custom
|
||||
commands remain operator-managed. Controls:
|
||||
[runtime](../../packages/adapters/claude-local/src/server/sandbox-cli-version.test.ts),
|
||||
[probe](../../packages/adapters/claude-local/src/server/test.remote.test.ts), and
|
||||
[wizard](../../ui/src/components/OnboardingWizard.test.tsx). Live managed
|
||||
authorization and subscription execution remain `not-run` for this change.
|
||||
|
||||
For fresh managed Codex Auto setup, the wizard's explicit Connect path can call
|
||||
`POST /api/environments/{environmentId}/probe?companyId={companyId}` before
|
||||
selected-runtime testing, then refresh scoped adapter discovery. This reuses the
|
||||
|
||||
@@ -114,6 +114,16 @@ remaining operations before qualifying the whole capability.
|
||||
Gaps: Environment test path checks creation/configuration policy; missing provider auth
|
||||
must use its owner setup flow.
|
||||
|
||||
Scoped source-only Claude CLI preparation: both the selected environment test
|
||||
and normal CLI execution use
|
||||
[versioned sandbox preparation](../../packages/adapters/claude-local/src/server/sandbox-cli-version.ts).
|
||||
An outdated default sandbox command can use a private pinned compatible CLI;
|
||||
local, SSH and custom commands are not replaced. The selected model, engine,
|
||||
account and existing actor/company checks remain authoritative. Installer
|
||||
failure cannot turn an incompatible CLI into a passing probe. Local subprocess
|
||||
controls exercise version checks and installer outcomes; live agent and
|
||||
subscription access are `not-run` for this change.
|
||||
|
||||
Scoped Legacy Codex shell delivery: resolved task configuration can explicitly
|
||||
assign service-secret variables to shell tools through ACP or CLI execution.
|
||||
The existing configuration and secret-access checks still authorize that binding;
|
||||
|
||||
@@ -70,6 +70,16 @@ Use [runner validation](./runs-adapters.md#adapter-setup) and
|
||||
[environment qualification](./execution-environments.md#environment-settings)
|
||||
for the prerequisites; a successful login alone is insufficient.
|
||||
|
||||
For managed Cloud setup, an outdated default Claude CLI is prepared automatically
|
||||
in a private versioned runtime directory before its hello test. Verify that the
|
||||
selected model and account stay unchanged and that the compatible executable is
|
||||
actually used. A failed installation still blocks hiring. Cloud failures must
|
||||
not display Manual debug shell commands or legacy operator hints; self-hosted
|
||||
failures retain that help.
|
||||
[Wizard controls](../../ui/src/components/OnboardingWizard.test.tsx) and
|
||||
[runtime controls](../../packages/adapters/claude-local/src/server/sandbox-cli-version.test.ts)
|
||||
cover these boundaries. They do not establish live Cloud onboarding success.
|
||||
|
||||
For a new Claude agent on an explicit immutable sandbox image or a Daytona
|
||||
named snapshot, use Connect to
|
||||
qualify the selected environment through the existing permission-gated probe.
|
||||
|
||||
@@ -54,6 +54,13 @@ Claude native setup uses the existing Anthropic API-key or subscription connecti
|
||||
flow. Record the selected account separately from successful execution; unavailable
|
||||
models/authentication and unsupported Legacy-only options must fail visibly.
|
||||
|
||||
Claude CLI tests and runs also prepare a compatible private executable when a
|
||||
managed sandbox image's default CLI is too old for the selected model. Verify
|
||||
the command used for the hello test and task, reuse of a compatible private
|
||||
installation, and a blocking failure when installation cannot establish a valid
|
||||
version. Local, SSH and explicit custom commands retain operator management.
|
||||
Cloud onboarding must not offer shell commands the customer cannot run.
|
||||
|
||||
Manual: Select the intended adapter and account, refresh model choices, and run its environment test. Save, reload, then execute a small task. Repeat with a deliberately unavailable account and verify the failure remains visible.
|
||||
|
||||
For Legacy Codex, assign a service secret such as `SLACK_BOT_TOKEN` through agent
|
||||
|
||||
Reference in new issue
Block a user