mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-21 08:22:20 +02:00
Add Copilot Product qualification and fixture ownership checks
Reviewed partition of the current-master Copilot integration. Complete v30 live qualification is retained; current v31 recovery compatibility, CI and review are tracked explicitly. Co-Authored-By: Paperclip <noreply@paperclip.ing>
This commit is contained in:
1 parent
fcbb80554e
commit
c48b89618f
74 files changed
+13325
-58
No files matched your search
@@ -0,0 +1,262 @@
|
||||
# GitHub Copilot production readiness
|
||||
|
||||
Current release checklist, updated 2026-10-08 (America/Chicago).
|
||||
|
||||
## Current master qualification: v30
|
||||
|
||||
Master advanced to `bf9dbd18a8d9a539f79ca2e3ccb10b6df31c6334` on
|
||||
2026-10-08. Its two fixes merged cleanly into the integration: resumed turns
|
||||
receive an explicit instruction to obtain fresh accepted completion evidence,
|
||||
and fresh remote Codex runs resolve compatible models before launch. Copilot
|
||||
continues to require its exact authenticated model; Codex substitution does not
|
||||
apply to ACPX providers.
|
||||
|
||||
The bound native-execution source changed, so Copilot profile **v30** is newly
|
||||
minted as `sha256:e21c4a43a937ae84e94726ef93227e8b931fa5547876ff0c5ecff304656d81e9`.
|
||||
TypeScript/Rust admission and source hashes match. Other provider qualifications
|
||||
are unchanged. Copilot **1.0.88** and exact **gpt-5.6-luna** remain pinned.
|
||||
The v29 live results below remain historical evidence; they do not qualify v30.
|
||||
V29 paid launch and image publication are closed. Its pending image request is
|
||||
withdrawn; no v29 image was published.
|
||||
|
||||
Frozen source is `c4b5d40bcfd51e6cacccc1ea1343305b05735641`; protocol
|
||||
definitions are `b0ea2ebd2cc07dda180f61362a68662abb96c7d6`. Source hashes, exact
|
||||
model, all 20 Product definitions and all three platform artifacts are retained
|
||||
in the v30 freeze. No v29 launch or publication is allowed.
|
||||
|
||||
| Current v30 gate | Result |
|
||||
|---|---|
|
||||
| Runner protocol | **7/7 pass**, 46 assertions and cleanup; one current attempt per case |
|
||||
| Protocol launch prerequisite | The copied helper first selected the historical roster. Built-runtime admission rejected it before a provider session or prompt; the failure is retained and only its unused $0.50 reservation was released. Current helpers check the exact roster/config before reserving. |
|
||||
| Product local / Daytona | **20/20 pass: 10 local and 10 native Daytona**, saved-token binding, exact model/profile and independent cleanup; no automatic behavior retries |
|
||||
| Build / static checks | Full build, recursive typecheck, token gates, Product typecheck and exact Copilot model isolation pass |
|
||||
| Product offline | **2,349 Vitest cases pass**, two existing skips, plus maintained Node contracts |
|
||||
| Runner offline | All selected checks have passing evidence: 3,003 Vitest cases, 677 Rust assertions and 1,942 required real-HTTP assertions. Original Mac invocation retains two credential-home setup failures; unchanged isolated Linux runtime-host suite passes all 44 cases with cleanup. Original cause remains unconfirmed; no single all-green `check:all` invocation is claimed. |
|
||||
| Installed runtime / metadata | Native macOS ARM64, x64 under Rosetta and Linux x64 under Docker emulation initialize and exit; authenticated packaged metadata confirms 19 models and exact Luna with no prompt. Native Daytona Product and ordinary installed-runtime proof pass. |
|
||||
| Full repository suite | Current-source offline container full build passes; `pnpm test:run` is in progress. A single full-suite pass is not claimed. |
|
||||
| Normal installation / canaries | Fresh 18-package ordinary npm installation, startup, personal token setup, exact model, save/reopen metadata Test and local task canary pass. Downloaded bytes, accepted receipt, one final response and cleanup are independently verified. Daytona also passes: independently downloaded bytes, accepted receipt, one final response, native command exit and all 13 owned sandboxes absent. The manual metadata Test archive was intentionally retained for diagnostics and then deleted. |
|
||||
| Image publication | Full final image scan: 225,852 regular files, 18,360,132,191 bytes, zero selected credential matches. Exact OCI index `sha256:b0f81cd040f811b8ae7eeedd326e36a1c697de5116cd91db84694f21526de7d1` was explicitly approved, published, and anonymously verified; Linux x64 manifest is `sha256:2ccfe999e7794ea1577e581840743a466663143c4303a518e06b3f1e0faa58fb`. |
|
||||
| Review / CI / rollout | Four current-master branches have **99, 56, 64 and 73 files**. Their final tracked tree equals the frozen source. Template-complete drafts are unpublished; current-head CI, Greptile review and rollout remain pending. |
|
||||
|
||||
The ten Daytona cells and ordinary installed Daytona canary are complete.
|
||||
The remaining critical path is current-master compatibility, current-head CI,
|
||||
Greptile review and shipping. Master advanced to `2f0c485dec7ab036f0abf7d90d09ca5f84df26a7`: its saved-prompt recovery fix changes one bound runtime input, and its Slack migration takes number 0318. The review stack preserves that recovery fix and renumbers Copilot to 0319. Profile v31 binds the changed parser; the completed v30 evidence remains immutable. No new live pass is claimed for v31.
|
||||
Remote workloads use the maintained local controller; no separate source
|
||||
checkout or credential-file upload is needed.
|
||||
|
||||
Account reconciliation retains all historical attempts, infrastructure holds,
|
||||
other-provider exposure and a **$5 reporting-delay allowance**. GitHub reports
|
||||
153.34 included credits ($1.53 displayed equivalent), with additional paid usage
|
||||
disabled. Provider per-run USD remains unknown. The approved window now has
|
||||
**31.18 remaining**, with no active paid reservation. No budget
|
||||
reset or billing change was performed; every new attempt requires a reservation.
|
||||
|
||||
## Historical v29 current-master replay
|
||||
|
||||
Current master is frozen at `5717523b9ea7a2d76efbd6eb73414de9c06c6f96`.
|
||||
The reviewed merge preserves Dot setup, decision-model routes, credential cleanup,
|
||||
and other provider qualification. Current runtime source is
|
||||
`a0e23886e6bd532004252780dfd009b9b449ff0e`, profile **v29**,
|
||||
`sha256:ce118b64cd7a50a93c3ff538b596327bd8e8d172a1bc0bda5d3334948d5d8eb7`,
|
||||
Copilot **1.0.88**, exact **gpt-5.6-luna**. Runner definitions are frozen at
|
||||
`9fb438caa8e4389a53217b7e636b8a15a6d5da26`.
|
||||
Qualification source is `2003915896ee56eb42a74fddf1ba479d1855549a`.
|
||||
Its five changes from the runtime revision affect only the warm fixture,
|
||||
fixture tests, and documentation; retained equivalence proofs keep the runtime
|
||||
and the other 18 Product cell contracts unchanged.
|
||||
|
||||
| Current v29 gate | Retained result |
|
||||
|---|---|
|
||||
| Runner protocol | **7/7 pass**, 46 assertions and cleanup, one attempt per case |
|
||||
| Local Product workflows | **10/10 pass**, saved-token binding, exact native identity and complete cleanup |
|
||||
| Local warm continuation | Changed-fixture comparison passes all three turns and cleanup; original failure remains retained: the model wrote literal backslash-plus-n and verified its own wrong bytes |
|
||||
| Warm fixture repair | Prompts explicitly define LF byte 10 and independent byte verification; the original failure and all byte/process/workspace assertions remain; only the two warm cell contracts change |
|
||||
| Daytona Product workflows | **0/10 current passes**; exact image publication approval pending; maintained cells are prepared to run from a local controller against native Daytona |
|
||||
| Product support | **2,335 Vitest tests and 128 Node contracts pass**, 2 existing skips; typecheck and exact warm selector discovery pass |
|
||||
| Runner offline | **3,001 Vitest tests pass**, 11 existing skips; Rust, replay, conformance, protocol, kernel and real-HTTP authority checks pass |
|
||||
| Build / typecheck / token gates | Pass on the frozen runtime source |
|
||||
| Installed platform smoke | Actual ARM64 pass; actual x64 installation under Rosetta and actual Linux x64 installation under local Docker emulation pass; native Daytona still pending |
|
||||
| Full application suite | Original general-server run: **16,807 pass, 8 fail, 69 skip**. Corrected umask/reaper checks pass 9 tests; unchanged native Linux port-ownership and real 40,000-file Git stress checks pass. All three adapter timeout cases pass unchanged on native Linux, including same-version Claude MCP isolation. UI passes **7,810 tests**, CLI passes **517 tests**; a launcher teardown leak is repaired and independently verified. The deterministic bind-readiness fixture and complete Copilot catalog assertion pass. All **155 maintained route suites pass (2,979 assertions)** with descendant cleanup. All 14 remaining workspace projects now have passing evidence (**1,929 cases, 7 existing skips**). A Cursor fresh-lease fixture leaked the installed host CLI; an isolated PATH and execution guard fix the fixture while preserving all 18 assertions. Across maintained coverage, **32,689 cases have passing evidence, with 81 existing skips**. This combines original passes and explicit cause-repaired/native replays; the original failing invocation is unchanged, and a fresh single-invocation root pass is not claimed. Original failures remain retained; no full-root pass is claimed. |
|
||||
| Ordinary current installation / UI / local canary | Fresh 18-package npm install, first-use personal token connection, exact model selection, save/reopen metadata Test and local task completion pass without qualification overrides; downloaded bytes, accepted receipt, one final response, native exit and scratch cleanup independently verified |
|
||||
| Ordinary current Daytona canary | Pending |
|
||||
| Current-head CI / review / rollout | Four unpublished review branches contain **99, 56, 63 and 72 files**. Runtime and regression branches pass their focused checks and Runner typecheck. Saved-token setup/admission passes **1,380 focused tests**, recursive typecheck and token gates; its additive catalog follow-up passes all 16 schema tests. The assembled qualification branch passes recursive and Product typechecks. Live Daytona qualification, current-head CI, final review and rollout remain pending. |
|
||||
|
||||
The v29 runtime repair retires a typed ACP native-agent disconnect before turn
|
||||
finalization while retaining independent process-exit proof for cleanup.
|
||||
Controller-only disconnection preserves pending input; other providers are unchanged.
|
||||
The deterministic new regression fails on v28. Historical v28 ten local and seven
|
||||
protocol passes remain evidence, with closed launch gates. Its full application
|
||||
suite retained five failures, including embedded Postgres host-resource failures,
|
||||
fixture timeouts and a Git stress timeout; no failure was discarded or relabeled.
|
||||
|
||||
The v29 warm failure is model behavior, not a transport bug: the exact native
|
||||
command digest matches the recorded command, whose Python string contains bytes
|
||||
`5c 6e` rather than LF `0a`. The model's own two assertions checked the same wrong
|
||||
bytes. The changed fixture comparison keeps runtime/model/permission policy
|
||||
frozen and verifies that the other 18 Product cell contracts and all protocol
|
||||
definitions are unchanged. Copilot's migration is `0318_copilot_defaults.sql`.
|
||||
|
||||
## Historical qualified source
|
||||
|
||||
- Master baseline: `ceabc3bc880676c49eee907a8d736f961a1358eb`.
|
||||
- Integrated source: `8e35f57831fd449a777d49d2686496d543f37cbf`.
|
||||
- Application / Runner runtime source: `3073c062d47891cc275072de4eaaf049f5837839`.
|
||||
- Copilot CLI: **1.0.88**; exact model: **gpt-5.6-luna**.
|
||||
- Copilot profile: **v26**, `sha256:1a2a0c35764105e9a85112d05187fee0862af23eeb82a75569b5198e52eaba4f`.
|
||||
- Runner eval definitions: `c3c47a3c0d9c207e65713cd05be97cd02d811d89`.
|
||||
- The 19 later source paths change Product fixtures only. Application / Runner inputs and all 20 Product definition hashes remain unchanged. Source equivalence and each original result hash were verified before admission changed.
|
||||
- Other provider qualification and the user's dirty dependency lock remain unchanged.
|
||||
|
||||
## Historical v26 gates
|
||||
|
||||
| Gate | Result |
|
||||
|---|---|
|
||||
| Product workflows | **20/20 pass**, saved-token setup and native identity verified; all passing attempts have complete cleanup |
|
||||
| Runner protocol | **7/7 pass**, 46 assertions, complete cleanup |
|
||||
| macOS ARM64 installation | Actual installed runtime smoke passes; authenticated discovery includes the exact model without a prompt |
|
||||
| macOS x64 installation | Actual installed x64 runtime smoke passes under Rosetta; this does not claim a physical Intel-host test |
|
||||
| Linux x64 installation | Actual installed runtime smoke passes on the native private Daytona controller; authenticated discovery verifies the exact model |
|
||||
| Qualified runtime root checks | Recursive typecheck, build and token gates pass; 32,105 root tests pass with 107 existing skips |
|
||||
| Runner checks | 135 Node contracts, 2,964 Vitest tests and 659 Rust tests pass; matching-toolchain doctest compilation passes; 11 Vitest skips and 2 Rust ignores retained |
|
||||
| Latest Product fixture checks | 2,333 tests pass with 2 existing skips; Product typecheck passes; 152 focused native Linux tests pass |
|
||||
| Ordinary release admission / packaging | Normal admission and local / Daytona assets promoted; full build, recursive typecheck, token gates and focused admission / packaging regressions pass |
|
||||
| Fresh npm installation and saved-token UI journey | Fresh 18-package npm consumer passes installation scripts, installed-server import and startup; actual first-run token connection, explicit model selection, save / refresh and metadata test pass; corrected Apps form retested |
|
||||
| Ordinary local and Daytona canaries | Local passes on ordinary npm source `646408381eca28f795b1e7ede655572154648309`: one final response, accepted completion, exit 0 and owned sidecar / scratch cleanup; Daytona also passes on that source: one final response, accepted completion, exit 0, finalized workspace and automatic task-sandbox cleanup; metadata-probe archive removed by explicit owned test cleanup; no qualification overrides |
|
||||
| Focused PR stack / current-head CI / review | Pending; fewer than 100 files per PR; exclude the manual qualification lock delta |
|
||||
| Broader rollout | Pending canary and review |
|
||||
|
||||
The final UI suite passes **7,771 tests in 699 files** after correcting one stale
|
||||
assertion that still expected Copilot to be disabled. First-run inspection found
|
||||
and repaired a missing Copilot setup choice. The Apps form showed duplicated
|
||||
access controls; its corrected single form was verified in the installed UI.
|
||||
The normal release root suite retained five failed files: three embedded Postgres
|
||||
startup failures, a macOS Unicode descriptor-path failure, and an OAuth loopback
|
||||
fixture failure. Current-master serial verification passes 485 assertions in four
|
||||
files after official Postgres native postinstall and a Unicode locale repair;
|
||||
the custom-image file still hits this host's shared-memory limit. These failures
|
||||
remain retained; current-master full coverage is required before handoff.
|
||||
|
||||
## Retained evidence and failures
|
||||
|
||||
Evidence is retained under `/tmp/copilot-production-campaign-v26`. The current
|
||||
completion record is `current-product-campaign-completion-proof.json`; source
|
||||
and artifact identities are in `frozen-source.json` and
|
||||
`qualified-source-equivalence-death-key.json`. All original failed attempts,
|
||||
assertions, result hashes and cleanup grades remain preserved. No failed grade
|
||||
was relabeled as passing.
|
||||
|
||||
The earlier Daytona attached-command receipt failure is resolved in the pinned
|
||||
runtime and now passes live. Product fixture repairs separately corrected browser
|
||||
task-ID binding, installed asset setup, validated process-group peer retention,
|
||||
context-read permission origins, exact Linux process admission, immutable
|
||||
boot/start-tick ownership and cleanup against that captured process birth.
|
||||
Provider-death local attempt 3 passed its behavior assertions but failed cleanup;
|
||||
its corrected attempt 4 passes both. Regression evidence retains every failure.
|
||||
|
||||
Daytona provider-death attempt 1 failed before the behavior began because startup
|
||||
proc metadata was rejected. Its precise rejected record was not retained and its
|
||||
cause remains unconfirmed. Subsequent inspection, including roughly 7,000 proc
|
||||
reads, did not reproduce the rejection. The exact owned disposable sandbox was
|
||||
deleted and absence verified. One bounded fresh-environment attempt with identical
|
||||
source and assertions passes all behavior and cleanup checks. No further retry
|
||||
was made.
|
||||
|
||||
Host sleep interrupted two unchanged timing cases; exact power events and failed
|
||||
attempts were retained. Both cases pass under process-scoped sleep protection
|
||||
with unchanged assertions and deadlines. Native shared-memory exhaustion affected
|
||||
the parallel database tests; the exact serial replay passes all 47 files and 166
|
||||
tests. No foreign process, IPC segment or system setting was changed.
|
||||
|
||||
## Setup and release scope
|
||||
|
||||
Use first-run GitHub Copilot setup or Connectors → GitHub → Connect Copilot. The AI provider is
|
||||
`github`, authentication is `api_key`, and the selected saved credential is
|
||||
injected as `COPILOT_GITHUB_TOKEN`. Repository / MCP connections and grants stay
|
||||
separate. No ambient GitHub credentials are adopted. Verification uses a bounded
|
||||
metadata-only probe in the selected execution environment; it sends no model
|
||||
prompt and reports auth, entitlement, installation and unavailable-model errors
|
||||
separately. Saving and reopening must preserve ACPX / Copilot / the exact model.
|
||||
|
||||
Core local and Daytona workflows are completion, editing, questions, plans,
|
||||
controller restart, permission denial, attached-command settlement, warm
|
||||
continuation, Stop with pending permission and provider death. Native steering,
|
||||
native plan mode, detached commands and additional native event presentation
|
||||
remain outside this release. Session-scoped notices cannot establish completion,
|
||||
artifacts or charges. GitHub billing attribution remains; unknown USD cost is
|
||||
never converted to measured zero-dollar usage.
|
||||
|
||||
## Budget and owned resources
|
||||
|
||||
The renewed **$100** ceiling retains all prior spending and failed reservations.
|
||||
The conservative remaining allowance is **$29.55** after independently verifying
|
||||
the saved token's account and its current-month aggregate included-credit usage
|
||||
of **153.34 included AI credits ($1.53 displayed USD equivalent)**, with additional paid usage disabled. The prior $1.16 observation remains retained; its $0.37 increase fits the existing reporting-delay allowance and does not release reservations. Reconciliation preserves every
|
||||
original reservation and infrastructure hold and retains $5 for reporting delay.
|
||||
Historical ordinary canary reservations and the current ordinary local reservation are settled.
|
||||
No paid run is active. Native provider USD remains unknown. Reserve ordinary
|
||||
canaries before sending model prompts; do not reset the ledger or billing settings.
|
||||
The saved token expires **January 4, 2027**, America/Chicago.
|
||||
|
||||
The human's exact approval authorized public image
|
||||
`ghcr.io/paperclipai/paperclip-daytona-runner:copilot-qualification-70e2d894a067e7891ca7`,
|
||||
index `sha256:bda4b2793308fe394b8264dafe9d1f226036b5c9fe48d2386435b1950861415c`,
|
||||
source archive `sha256:78da5a0a06eb813a59edc738537766ab9a321d9877010b5f5d04190cdce2ca82`
|
||||
and the two selected credentials on the private controller
|
||||
`copilot-v26-native-private-controller-01`. Publication, anonymous retrieval and
|
||||
private handoff completed. Credentials are mode 0600. Later credential-free
|
||||
Product-only increments used the same approved private destination. Delete only
|
||||
owned resources after their evidence has been collected.
|
||||
|
||||
## Remaining critical path
|
||||
|
||||
1. Require fresh current-head CI. Maintained offline coverage has passing evidence for all selected cases; retain every original failure, environment diagnosis and explicit repaired/native comparison.
|
||||
2. Publish the exact credential-free image after approval, then run all ten maintained Daytona Product cells from the local harness, one at a time. Verify native Daytona installation/discovery and the ordinary Daytona canary.
|
||||
3. Publish the current qualification record, prepare focused PRs with fewer than 100 files each, and require current-head CI and review before broader rollout.
|
||||
|
||||
Rollback disables new Copilot admission and retains safe cancellation and recovery
|
||||
for existing runs. Production readiness requires the ordinary shipped-user path,
|
||||
not candidate test results alone.
|
||||
|
||||
The current credential-free v29 image is built and scanned locally:
|
||||
`ghcr.io/paperclipai/paperclip-daytona-runner:copilot-qualification-071a851bc57f464c32ec`,
|
||||
index `sha256:f39a27cc2fe7a83c2c07587fdc367df3307e13259ac50b5c47638559dab92008`.
|
||||
It has not been published. Automatic approval review rejected publication because
|
||||
earlier authorization covered different bytes. Exact current image publication
|
||||
approval is pending. The private controller returned 404 at
|
||||
`2026-10-08T07:32:25Z`; its disappearance cause is unconfirmed. The proposed
|
||||
current source archive, runtime delta, credential-file transfer and bootstrap were
|
||||
withdrawn before execution. No new source checkout or credential file is uploaded
|
||||
to a separate controller. The maintained local harness will drive disposable native
|
||||
Daytona task sandboxes using normal saved connections. Local evidence and the
|
||||
mode-0600 two-key credential file remain retained.
|
||||
|
||||
Normal Daytona plugin packaging and isolated installation pass in the fresh npm
|
||||
application. The existing Environments setting was enabled through its ordinary
|
||||
UI. The image-pinned Daytona setup form is prepared; no environment has yet been
|
||||
created or tested. No remote model prompt has been sent for this current build.
|
||||
|
||||
The current base still matches public `origin/master`, independently checked on
|
||||
2026-10-08. The review partition has **99, 56, 63 and 72 files**, respectively. Four
|
||||
verified fixture-only paths were added: the complete provider catalog assertion,
|
||||
CLI server ownership, bind readiness and fresh Cursor lease isolation. Every candidate path is assigned once. The user's dependency-lock changes remain
|
||||
uncommitted and byte-identical. Neither a full-suite pass nor production readiness
|
||||
is claimed while these gates remain open.
|
||||
|
||||
The saved-token review branch now ends at
|
||||
`be5735cffd6d67cb75ea0567ad16d28d6e489b59`. Its schema follow-up is
|
||||
`f36e035388811538a3eb91bb5773aee760c7a3b1`; the preceding product commit is
|
||||
`f61f81b084b4e4bd282609d51c20e54dc5680c4d`. The regression/evidence commit is
|
||||
`193ef12a7a3c4bd7ecc709dc910e2dd3f3adb498`. These review-only fixture changes and the setup-document correction
|
||||
do not change the frozen Copilot runtime, profile, model or Product definitions.
|
||||
The assembled `codex/copilot-qualification-v29` branch passes recursive
|
||||
typecheck and the Product definition typecheck. It remains unpublished while
|
||||
current live Daytona qualification, fresh current-head CI and review are open.
|
||||
|
||||
The qualification review includes initial commit
|
||||
`442da9569cb349862d384728ae9c093acfb0bcac` and Cursor fixture follow-up
|
||||
`abd8fb279ed171838761de1873c2e1b44253db45`. The follow-up changes test setup
|
||||
only: every test body and assertion stays byte-identical, and Cursor production
|
||||
code and qualification remain unchanged. Four template-complete PR bodies are
|
||||
prepared locally, with CI and review boxes left unchecked. Nothing has been
|
||||
pushed or published. Current credentials were scanned against all changed source
|
||||
bytes; no matches were found.
|
||||
File diff suppressed because it is too large.
Load diff
@@ -0,0 +1,739 @@
|
||||
{
|
||||
"schema": "paperclip.copilot.qualification-progress/v1",
|
||||
"status": "historical-core-covered-release-gated",
|
||||
"productionAdmission": "gated",
|
||||
"supersedes": "2026-10-03-copilot-qualification-v19.json",
|
||||
"runtimeSourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"productDefinitionsRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"evalsRevision": "3f7b26435f0c2d92dfeedf8c3d466dd94bf3ed4a",
|
||||
"copilotVersion": "1.0.88",
|
||||
"model": "gpt-5.6-luna",
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"productCells": [
|
||||
{
|
||||
"selector": "native-active-stop.runner-acpx-copilot.local.pending-permission-stop",
|
||||
"status": "passed",
|
||||
"definitionVersion": 17,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-local-pending-permission-stop",
|
||||
"status": "passed",
|
||||
"definitionVersion": 17,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-35-17-581Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "d8999808abb2a6ed4056059d0ecddc103c8679b5f218699e892e1a04eae68955",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:5586d5a024d22284546aba127c52ff661431fcfd6d01f35676d4ce64e49f7a70",
|
||||
"matcherCount": 8,
|
||||
"matcherPassCount": 8
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "native-active-stop.runner-acpx-copilot.daytona.pending-permission-stop",
|
||||
"status": "passed",
|
||||
"definitionVersion": 17,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-daytona-pending-permission-stop",
|
||||
"status": "passed",
|
||||
"definitionVersion": 17,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-35-59-876Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "d8999808abb2a6ed4056059d0ecddc103c8679b5f218699e892e1a04eae68955",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:6b271d35a4e4cf9771ea6c063a4c81c31118e9708a110d1b6db508b98b9efe3b",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "copilot-provider-death.runner-acpx-copilot.local.pending-permission-provider-death",
|
||||
"status": "passed",
|
||||
"definitionVersion": 15,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-local-pending-permission-provider-death",
|
||||
"status": "passed",
|
||||
"definitionVersion": 15,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-42-29-858Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "5ca6dcc424a8813aec3c7effa6f8abdc5af0bbd75ac23e525970661d023bea44",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:02cbd49cc4a7217ec3e190d97bc17fe75769ceb3b346e42db04803f9e0aabf90",
|
||||
"matcherCount": 8,
|
||||
"matcherPassCount": 8
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "copilot-provider-death.runner-acpx-copilot.daytona.pending-permission-provider-death",
|
||||
"status": "passed",
|
||||
"definitionVersion": 15,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-daytona-pending-permission-provider-death",
|
||||
"status": "passed",
|
||||
"definitionVersion": 15,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-43-33-030Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "5ca6dcc424a8813aec3c7effa6f8abdc5af0bbd75ac23e525970661d023bea44",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:1dcba2d5f1c4b545f9ead727e6f40cb04d5820af9bf01a56f91a23e49f5c5c40",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.local.native-permission-deny-write",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-local-native-permission-deny-write",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-44-41-932Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "794c0628644401b0e320278b6583b4e88cac255be0f5659dfcba98c803ed288a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:0695741e883f492d84c770c9ccca5bef0ce6151a834eaf938654076e5cceb037",
|
||||
"matcherCount": 10,
|
||||
"matcherPassCount": 10
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.local.attached-async-settlement",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-local-attached-async-settlement",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-45-25-306Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "794c0628644401b0e320278b6583b4e88cac255be0f5659dfcba98c803ed288a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:c295447bc374dd4ffd8ac56898cb2f1c1e70cbc675246215ec91a1cf23a34ff1",
|
||||
"matcherCount": 10,
|
||||
"matcherPassCount": 10
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.daytona.native-permission-deny-write",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-daytona-native-permission-deny-write",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-46-10-182Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "794c0628644401b0e320278b6583b4e88cac255be0f5659dfcba98c803ed288a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:a3921b59486a5bbc18d7d7c555a1d3c4eaeacfa13c559f454e1f38bf015a230e",
|
||||
"matcherCount": 11,
|
||||
"matcherPassCount": 11
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.daytona.attached-async-settlement",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-daytona-attached-async-settlement",
|
||||
"status": "passed",
|
||||
"definitionVersion": 19,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-47-09-753Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "794c0628644401b0e320278b6583b4e88cac255be0f5659dfcba98c803ed288a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:76eb9480361749221800123b69d3febe58b728db14730906fcf19dd27396c9c0",
|
||||
"matcherCount": 11,
|
||||
"matcherPassCount": 11
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "rich-acp-warm-continuity.runner-acpx-copilot.local.warm-three-turn",
|
||||
"status": "passed",
|
||||
"definitionVersion": 2,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-local-warm-three-turn",
|
||||
"status": "failed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-48-16-464Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "605f2893cfeffd44eda3e86d90b7695a54917b063fe586e75688f30d0832c960",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:81d6e397e47a702b3d23c086448a9397f372032c25d723208363ab686179ba85",
|
||||
"matcherCount": 9,
|
||||
"matcherPassCount": 9
|
||||
},
|
||||
{
|
||||
"label": "v20-warm-repair-local-warm-three-turn",
|
||||
"status": "passed",
|
||||
"definitionVersion": 2,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-06-02-656Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "55859de81a8d5d39308102f267f5824f2d24452dc922e69edfca1032661f92c8",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:e302a32039a70e4dda7d7946f79e31d85bdd2f46dc8db7ad3235cb6e9ef586ee",
|
||||
"matcherCount": 9,
|
||||
"matcherPassCount": 9
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "rich-acp-warm-continuity.runner-acpx-copilot.daytona.warm-three-turn",
|
||||
"status": "passed",
|
||||
"definitionVersion": 2,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-daytona-warm-three-turn",
|
||||
"status": "passed",
|
||||
"definitionVersion": 2,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-08-54-654Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "55859de81a8d5d39308102f267f5824f2d24452dc922e69edfca1032661f92c8",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:0ba63e880fd1bc39627527fd512fb6d04f1ad14f45c3d33d5bbc7f9c5e5268da",
|
||||
"matcherCount": 9,
|
||||
"matcherPassCount": 9
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.hello-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-local-hello-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-12-23-520Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:9a47f8f7a6421c793ec9569e7dfd5f6930cc9edab6bf328d88c4a66392834fd6",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.question-resume-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-local-question-resume-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-19-51-964Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:e78b8c9a1a422a7f6e53acc04e088c552b93724be0176c6f06161aef4a2c1f66",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.plan-approve-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-local-plan-approve-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-12-56-580Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:dae3d382178075163cb28625270dc9a56a803e455411663b12ed260c995e66c4",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.structured-question-restart-resume",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-local-structured-question-restart-resume",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-13-53-885Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:338e9bc2394406ff231a602c4fe187730f21b03703888aa4e52b02dc018b44ac",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.file-edit-validate",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-local-file-edit-validate",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-15-04-865Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:6d2c98462defbc8882192ab545ed479a3b18d39070ad94c12de5e3daabd8c11d",
|
||||
"matcherCount": 7,
|
||||
"matcherPassCount": 7
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.hello-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-daytona-hello-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-16-04-974Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:1b95a8ff41b515243885a51a431e9269734fb7b2dfab3810c261572b8a149686",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.question-resume-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-daytona-question-resume-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T03-31-54-286Z",
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:9c2906c0771ea54a806ba279ffec12b22a1c7b6cac6404ca09cb6f7001ef3462",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.plan-approve-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-daytona-plan-approve-complete",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-17-17-405Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:82efa2740a49341ca6aaf9102be09bd0617d1aa4a34cdf4a3eb76f255529f4a3",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.structured-question-restart-resume",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-daytona-structured-question-restart-resume",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-19-02-595Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:d6317f1ab6763ee2be4f43d54d2c5121a8420d0b9e626f2309139461671a24ce",
|
||||
"matcherCount": 6,
|
||||
"matcherPassCount": 6
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.file-edit-validate",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-warm-repair-final-daytona-file-edit-validate-bounded-infrastructure",
|
||||
"status": "passed",
|
||||
"definitionVersion": 1,
|
||||
"automaticRetries": 0,
|
||||
"resultId": "local-2026-10-05T04-25-04-379Z",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"definitionHash": "e75cb2222d2f52ec3a2a425211d195d36b95882de2cb9ed0ad93231b7c42768a",
|
||||
"cleanup": "passed",
|
||||
"resultSha256": "sha256:bd4057cc365ac430eb5d22e97f02d4f253078a902abe6c269ae2e26cd774702e",
|
||||
"matcherCount": 7,
|
||||
"matcherPassCount": 7
|
||||
}
|
||||
]
|
||||
}
|
||||
],
|
||||
"runnerProtocol": [
|
||||
{
|
||||
"caseId": "context-before-action",
|
||||
"status": "passed",
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-protocol-context-before-action",
|
||||
"caseId": "context-before-action",
|
||||
"status": "failed",
|
||||
"summarySha256": "sha256:5c1e944f54fdc116ed49591e23dae28b63b6ba3f3c69227dda04b4f0fffa870b",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"infrastructure_failure"
|
||||
],
|
||||
"profileVersion": 19,
|
||||
"profileDigest": "sha256:c2825f706f839071ce5aa9ddc2a058d785a55644964ff9c2ba878ac9ccc66fef",
|
||||
"unusedInferenceReservationReleasedUsd": 0.5
|
||||
},
|
||||
{
|
||||
"label": "v20-final-protocol-context-before-action-exact-profile",
|
||||
"caseId": "context-before-action",
|
||||
"status": "passed",
|
||||
"summarySha256": "sha256:af88322a116d90346a491bd41ffb13e1c792a699491723e3f8496f018d371058",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"passed"
|
||||
],
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"unusedInferenceReservationReleasedUsd": 0
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"caseId": "get-task-context",
|
||||
"status": "passed",
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-protocol-get-task-context",
|
||||
"caseId": "get-task-context",
|
||||
"status": "passed",
|
||||
"summarySha256": "sha256:9747b893fcd3e96bad17b97a8c12e74b0b7a1cd9a4dbd4fe2ca9b4b758593573",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"passed"
|
||||
],
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"unusedInferenceReservationReleasedUsd": 0
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"caseId": "create-task-document",
|
||||
"status": "passed",
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-protocol-create-task-document",
|
||||
"caseId": "create-task-document",
|
||||
"status": "passed",
|
||||
"summarySha256": "sha256:20b3d832ef12ad36820c34c541214b1d18d6924ab8da674ccb8e9d373a74d045",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"passed"
|
||||
],
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"unusedInferenceReservationReleasedUsd": 0
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"caseId": "finish-task",
|
||||
"status": "passed",
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-protocol-finish-task",
|
||||
"caseId": "finish-task",
|
||||
"status": "passed",
|
||||
"summarySha256": "sha256:e0272871319c712c518151efc3f1a8fff28a90cb3509040d4678b3c9a0f496d9",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"passed"
|
||||
],
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"unusedInferenceReservationReleasedUsd": 0
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"caseId": "request-human-confirmation",
|
||||
"status": "passed",
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-protocol-request-human-confirmation",
|
||||
"caseId": "request-human-confirmation",
|
||||
"status": "passed",
|
||||
"summarySha256": "sha256:0f92dd956c2ad963a9d24226bef8e8ff6512185e25cc8b796a8712d6eef7fa0a",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"passed"
|
||||
],
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"unusedInferenceReservationReleasedUsd": 0
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"caseId": "workflow-context-document-progress",
|
||||
"status": "passed",
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-protocol-workflow-context-document-progress",
|
||||
"caseId": "workflow-context-document-progress",
|
||||
"status": "passed",
|
||||
"summarySha256": "sha256:60c31ec37982b307d14ed502e84d61094a18674034b3abea51c8eabec7500d49",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"passed"
|
||||
],
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"unusedInferenceReservationReleasedUsd": 0
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"caseId": "workflow-governed-wait",
|
||||
"status": "passed",
|
||||
"attempts": [
|
||||
{
|
||||
"label": "v20-final-protocol-workflow-governed-wait",
|
||||
"caseId": "workflow-governed-wait",
|
||||
"status": "passed",
|
||||
"summarySha256": "sha256:35950a2454906d62b357ac3908fd84435a1646411d8dbba633b55ffc093c4860",
|
||||
"automaticRetries": 0,
|
||||
"dispositions": [
|
||||
"passed"
|
||||
],
|
||||
"profileVersion": 20,
|
||||
"profileDigest": "sha256:6ab53285d7cb0eaf79fafec9e0bf0f1a42044761b4b0cf129e0159c8c2fad539",
|
||||
"unusedInferenceReservationReleasedUsd": 0
|
||||
}
|
||||
]
|
||||
}
|
||||
],
|
||||
"installedRuntimeSmokes": {
|
||||
"macosArm64": "passed",
|
||||
"macosX64Rosetta": "passed",
|
||||
"linuxX64": "passed",
|
||||
"qualification": "Actual installed native binaries; macOS x64 ran under Rosetta, not on a physical Intel host."
|
||||
},
|
||||
"budget": {
|
||||
"ceilingUsd": 100,
|
||||
"priorSharedExposureUpperBoundUsd": 47.080380624,
|
||||
"combinedConservativeExposureUpperBoundUsd": 57.810304624,
|
||||
"remainingCeilingHeadroomUsd": 42.189695376,
|
||||
"nativeInferenceUsd": "unknown per run; included-credit aggregate valuation is not a measured per-run charge",
|
||||
"aggregateIncludedUsageDollarEquivalentUsd": 0.71,
|
||||
"reportingDelayContingencyUsd": 5,
|
||||
"releasedHistoricalInferenceContingencyUsd": 41.79,
|
||||
"billingControlsChanged": false,
|
||||
"accountBindingVerified": true,
|
||||
"billingProofSha256": "sha256:aed119f7635b7eb46bc89e3d43a9afd163a9ba9ee56671afbd3f0c6c7b16360a",
|
||||
"privateLedgerSha256": "sha256:c07258de0235b57fec9c09f06efd24c7d05c458996a10d152ffcd6003bf7a8f9",
|
||||
"budgetIncreaseRequestDisposition": "withdrawn-unneeded; original $100 ceiling retained"
|
||||
},
|
||||
"evidencePolicy": "Original failures are retained. Earlier-definition passes are not final frozen-definition passes. Native USD is unknown; conservative exposure is not measured spend. Local raw evidence is retained separately from this safe summary.",
|
||||
"updatedAt": "2026-10-05T15:53:48.410637+00:00",
|
||||
"integratedSourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"runnerArtifactsSourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"sourceFreezeSha256": "sha256:c2124432cc026857a3732d709f24c3c9589a1bc4115e47964585f22309a02f4a",
|
||||
"singleIntegratedSourceCampaignComplete": false,
|
||||
"sourceRepair": {
|
||||
"from": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"to": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"runtimeArtifactsChanged": false,
|
||||
"profileChanged": false,
|
||||
"cause": "Saved-token Copilot was forced into per-turn mode and lacked warm instruction-directory handoff. The local fixture also required Daytona leases.",
|
||||
"assertionsRetained": [
|
||||
"stable native session",
|
||||
"stable runner instance",
|
||||
"stable provider session",
|
||||
"stable process PID and start fingerprint",
|
||||
"stable project and execution workspace",
|
||||
"exact files and response order",
|
||||
"Daytona created/resumed/resumed leases"
|
||||
]
|
||||
},
|
||||
"artifacts": {
|
||||
"providerPackDigest": "sha256:109a5503059ab288e3ae27c7a9259508656de90780f140fafed24be5756f9768",
|
||||
"runnerPackageSha256": "sha256:8a5ac4330a984e12c18820d9c151692c274689d59d15a4557030736e8b0f8b9a",
|
||||
"runnerdSha256": "sha256:2262bba760163b44f61674e43e723c08c22b1618af8cfe286fc8699ba9e153ee",
|
||||
"runnerCliSha256": "sha256:bed6afbd86ab25c4bf90886a162e2b8a3e192005c77f50b597aee48a619dc3eb",
|
||||
"daytonaImageContentId": "d2efbefb0fd9b6bcab83ff012dfed48bed0a61980e2a2780cf85fae89e9a8808",
|
||||
"daytonaImageDigest": "sha256:92b52854065117926c73d81512c2220b5842d2c2bb0432cbc55563e9714ddcd4",
|
||||
"publishedIndexDigest": "sha256:2d29e804ecdf6e2c650d2a53adc8313ecf8ce740653a87be89c078a0c2b79c3a"
|
||||
},
|
||||
"installedSmokes": [
|
||||
{
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"providerPackDigest": "sha256:109a5503059ab288e3ae27c7a9259508656de90780f140fafed24be5756f9768",
|
||||
"platform": "darwin",
|
||||
"architecture": "arm64",
|
||||
"translatedIntel": false,
|
||||
"cleanExit": true,
|
||||
"promptSent": false,
|
||||
"inheritedCredentials": false,
|
||||
"evidenceSha256": "sha256:249b6741e2bc72ce79a892e8f1356f076ef938d010323e8cc7f9c22b052fc6be"
|
||||
},
|
||||
{
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"providerPackDigest": "sha256:fae748d8f054fd74548921b40a21bfd0532eea9a040d4f8581ffab161e2a6ee0",
|
||||
"platform": "darwin",
|
||||
"architecture": "x64",
|
||||
"translatedIntel": true,
|
||||
"cleanExit": true,
|
||||
"promptSent": false,
|
||||
"inheritedCredentials": false,
|
||||
"evidenceSha256": "sha256:9a7814123557ebc303f69b860d980f9ef6d1bc7ff904bf885f969e18c401938d"
|
||||
},
|
||||
{
|
||||
"sourceRevision": "e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"providerPackDigest": "sha256:ac3637fe8e48cf1ef36f0247b98b47e624a709643b8ba7a59f2a17a4dbffa902",
|
||||
"platform": "linux",
|
||||
"architecture": "x64",
|
||||
"translatedIntel": false,
|
||||
"cleanExit": true,
|
||||
"promptSent": false,
|
||||
"inheritedCredentials": false,
|
||||
"evidenceSha256": "sha256:777151bafd0dbdca279f9369a9a54d94dbf6aeb3cd5ecae9a28d2cb03af5ef60"
|
||||
}
|
||||
],
|
||||
"remainingReleaseGates": [
|
||||
"Finish the frozen integrated-source Product campaign; retain earlier source/result grades.",
|
||||
"Complete current-head verification and review.",
|
||||
"Enable normal Copilot admission and standard packaging only after qualification.",
|
||||
"Prove ordinary saved-token setup, installation and canary without qualification overrides."
|
||||
],
|
||||
"singleIntegratedSourceProductCoverage": {
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"passed": 10,
|
||||
"required": 20,
|
||||
"earlierSourcePassesRequireRepeat": 10
|
||||
},
|
||||
"qualificationScope": "All 20 selectors have passed on the v20 runtime artifacts. Ten are on the warm-repaired server source; ten predate that server repair. This does not yet qualify a single integrated release build.",
|
||||
"verification": {
|
||||
"runnerContracts": "passed at runtime source e8b0aaba234d0d2192807c7a41d4c85df087ba47; runtime artifacts unchanged by server warm repair",
|
||||
"warmCapabilityTests": 9,
|
||||
"warmDirectoryAndCredentialTests": 10,
|
||||
"catalogTests": 31,
|
||||
"recursiveTypecheck": "passed",
|
||||
"tokenGates": "passed",
|
||||
"fullTestRun": "failed at source 75592813ad7f2bb97ed84fda0e2f95276de78511 without diagnostic preload: 7 failing files, 5 failing tests, 15060 passing tests, 131 skipped tests; no assertions changed",
|
||||
"fullBuild": "passed",
|
||||
"retainedFullTestFailures": [
|
||||
{
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"status": "failed",
|
||||
"cause": "routines HTTP socket reset",
|
||||
"focusedRoutinesTestsPassed": 10
|
||||
},
|
||||
{
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"status": "failed",
|
||||
"cause": "one of 500 Git scan HTTP requests reset; diagnostic preload also broke four empty-stderr Discord assertions",
|
||||
"testsPassedBeforeFailure": 15106,
|
||||
"testsFailed": 5,
|
||||
"unhandledErrors": 1,
|
||||
"focusedTestsPassedWithoutPreload": 78,
|
||||
"assertionsChanged": false
|
||||
},
|
||||
{
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"status": "failed",
|
||||
"cause": "Five timeout/hook failures, one embedded database startup failure, and one run-status assertion across seven files. Narrow unchanged-assertion diagnosis is in progress.",
|
||||
"testsPassedBeforeFailure": 15060,
|
||||
"testsFailed": 5,
|
||||
"filesFailed": 7,
|
||||
"assertionsChanged": false
|
||||
}
|
||||
]
|
||||
},
|
||||
"savedTokenUiAcceptance": {
|
||||
"status": "passed",
|
||||
"sourceRevision": "75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"profileVersion": 20,
|
||||
"productionAdmission": "qualification-pending",
|
||||
"ordinaryProductionInstallation": false,
|
||||
"runtimeTest": {
|
||||
"status": "Connection successful",
|
||||
"details": "The verified Copilot runtime authenticated this account and accepted the selected model. No model prompt was sent.",
|
||||
"modelPromptSent": false
|
||||
},
|
||||
"screenshot": {
|
||||
"file": "saved-token-ui-v20.jpg",
|
||||
"sha256": "sha256:7f5bd9d6dd374faf73d37dfa5177a023c7bdf5a1507f9f72b485b6354a9cd81b"
|
||||
}
|
||||
},
|
||||
"sourceFreezePolicy": {
|
||||
"implementationAndEvalDefinitions": "immutable at 75592813ad7f2bb97ed84fda0e2f95276de78511",
|
||||
"runnerArtifacts": "immutable at e8b0aaba234d0d2192807c7a41d4c85df087ba47",
|
||||
"mutableEvidencePaths": [
|
||||
"doc/plans/2026-10-03-copilot-production-readiness.md",
|
||||
"doc/plans/2026-10-03-copilot-qualification-v20.json"
|
||||
],
|
||||
"reason": "Update current campaign results without changing executable source, profile, eval definitions, or artifacts."
|
||||
},
|
||||
"supersededBy": "2026-10-05-copilot-qualification-v21.json"
|
||||
}
|
||||
@@ -0,0 +1,576 @@
|
||||
{
|
||||
"schema": "paperclip.copilot.qualification-progress/v1",
|
||||
"status": "Historical v21 evidence; superseded by the unfrozen v22 master integration; production remains gated",
|
||||
"updatedAt": "2026-10-05T19:03:10.191470+00:00",
|
||||
"productionAdmission": "gated",
|
||||
"supersedes": "2026-10-03-copilot-qualification-v20.json",
|
||||
"upstreamTargetRevision": "59015846ae02f935411afc620e0867ce812378fb",
|
||||
"integratedSourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"sourceFreezeComplete": true,
|
||||
"copilotVersion": "1.0.88",
|
||||
"model": "gpt-5.6-luna",
|
||||
"profileVersion": 21,
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d",
|
||||
"profileIdentityFrozen": true,
|
||||
"profileChangeReason": "Bind native asset ownership and the installer, support the public server vendored layout, eliminate private workspace runtime imports, and preserve the latest mainline completion and shutdown settlement fixes.",
|
||||
"productCells": [
|
||||
{
|
||||
"selector": "native-active-stop.runner-acpx-copilot.local.pending-permission-stop",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "native-active-stop.runner-acpx-copilot.daytona.pending-permission-stop",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "copilot-provider-death.runner-acpx-copilot.local.pending-permission-provider-death",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "copilot-provider-death.runner-acpx-copilot.daytona.pending-permission-provider-death",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.local.native-permission-deny-write",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.local.attached-async-settlement",
|
||||
"status": "pending after two retained controller failures",
|
||||
"required": true,
|
||||
"retainedAttempts": [
|
||||
{
|
||||
"label": "copilot-v21-product-local-attached-settlement",
|
||||
"status": "failed-before-test-result",
|
||||
"failureClass": "transient_infrastructure",
|
||||
"error": "Playwright exited 1 before writing a result",
|
||||
"launcherObservation": "Playwright process received SIGKILL before any result was written; initial controller memory limit was 3 GiB. No assertion or model behavior result exists.",
|
||||
"evidence": "/tmp/copilot-production-campaign-v21/linux-product-results/local-2026-10-05T17-26-43-472Z/copilot-protection/runner-acpx-copilot/local/attached-async-settlement/attempt-1/result.json",
|
||||
"sha256": "sha256:0cd7e8c19c9ff8221b3f48d93295806f0f516e0e75a1255afeab2fbf41badca8",
|
||||
"automaticRetries": 0,
|
||||
"inferenceReservationRetainedUsd": 0.5
|
||||
},
|
||||
{
|
||||
"label": "copilot-v21-product-local-attached-settlement-attempt02",
|
||||
"status": "failed",
|
||||
"resultPath": "/tmp/copilot-production-campaign-v21/linux-product-results/local-2026-10-05T18-42-28-030Z/copilot-protection/runner-acpx-copilot/local/attached-async-settlement/attempt-1/result.json",
|
||||
"recordedFailureClass": "secret_leak",
|
||||
"underlyingBrowserFailure": "Page crashed; controller memory.events confirms oom_kill=1 at 6 GiB",
|
||||
"evidenceInspectionFailure": "unzip ENOENT: archives rejected and excluded from packaged evidence; recorded failure is preserved",
|
||||
"cleanup": "passed",
|
||||
"nativeInferenceUsd": "unknown; full $0.50 reservation retained",
|
||||
"controllerExitProof": "/tmp/copilot-production-campaign-v21/copilot-v21-product-local-attached-settlement-attempt02-controller-exit.json"
|
||||
}
|
||||
],
|
||||
"nextAction": "Wait for the full isolated suite to finish, then one bounded 6 GiB controller attempt with captured cgroup memory events and unchanged test assertions."
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.daytona.native-permission-deny-write",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "copilot-protection.runner-acpx-copilot.daytona.attached-async-settlement",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "rich-acp-warm-continuity.runner-acpx-copilot.local.warm-three-turn",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "rich-acp-warm-continuity.runner-acpx-copilot.daytona.warm-three-turn",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.hello-complete",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.question-resume-complete",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.plan-approve-complete",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.structured-question-restart-resume",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.local.file-edit-validate",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.hello-complete",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.question-resume-complete",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.plan-approve-complete",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.structured-question-restart-resume",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
},
|
||||
{
|
||||
"selector": "extended-harnesses.runner-acpx-copilot.daytona.file-edit-validate",
|
||||
"status": "pending",
|
||||
"required": true
|
||||
}
|
||||
],
|
||||
"runnerProtocol": [
|
||||
{
|
||||
"caseId": "context-before-action",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/copilot-v21-protocol-context-before-action-summary.json",
|
||||
"sha256": "sha256:beb87abfd68f93c3d4a4fda9a67ed370550ca8e693ad336253d0a536fa9e9d2d"
|
||||
},
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d",
|
||||
"automaticRetries": 0
|
||||
},
|
||||
{
|
||||
"caseId": "get-task-context",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/copilot-v21-protocol-get-task-context-summary.json",
|
||||
"sha256": "sha256:e7daec79864f0e0b61ee60d106416c5289d04ffc4273d65db16fc15fcdd4134c"
|
||||
},
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d",
|
||||
"automaticRetries": 0
|
||||
},
|
||||
{
|
||||
"caseId": "create-task-document",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/copilot-v21-protocol-create-task-document-summary.json",
|
||||
"sha256": "sha256:c2aa270aab6c1c0915d8271cf0402c33dced945329ecab49fffcceae6a04fd17"
|
||||
},
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d",
|
||||
"automaticRetries": 0
|
||||
},
|
||||
{
|
||||
"caseId": "finish-task",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/copilot-v21-protocol-finish-task-summary.json",
|
||||
"sha256": "sha256:a35e8310c7ab5da467c7f53d8ea6f71dd84e01b1621bdb7f80762dc1b485cf59"
|
||||
},
|
||||
"automaticRetries": 0,
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d"
|
||||
},
|
||||
{
|
||||
"caseId": "request-human-confirmation",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/copilot-v21-protocol-request-human-confirmation-summary.json",
|
||||
"sha256": "sha256:532414bd7490cfbe18a12b01a48d84d3a9acaa1ce95853de3094783a20f89bd0"
|
||||
},
|
||||
"automaticRetries": 0,
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d"
|
||||
},
|
||||
{
|
||||
"caseId": "workflow-context-document-progress",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/copilot-v21-protocol-workflow-context-document-progress-summary.json",
|
||||
"sha256": "sha256:d7c600f6fc0ec1acfcad0492f7aab4bced10cc63f22bee5b86277408f26daa1a"
|
||||
},
|
||||
"automaticRetries": 0,
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d"
|
||||
},
|
||||
{
|
||||
"caseId": "workflow-governed-wait",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/copilot-v21-protocol-workflow-governed-wait-summary.json",
|
||||
"sha256": "sha256:f169b83dfa4f60f59568833dc064a0d922f6449f4823d34b3045364f6653f7a1"
|
||||
},
|
||||
"automaticRetries": 0,
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d"
|
||||
}
|
||||
],
|
||||
"installedRuntimeSmokes": [
|
||||
{
|
||||
"platform": "darwin-arm64",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/installed-macos-arm64-smoke.json",
|
||||
"sha256": "sha256:4ff4712f675d2d70b8984bb1ddc0c55a32152177c929eb4a81a1d2849f251a76"
|
||||
},
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"promptSent": false
|
||||
},
|
||||
{
|
||||
"platform": "darwin-x64",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/installed-macos-x64-smoke.json",
|
||||
"sha256": "sha256:25f5b7d45c05dc3af8dc096ea4309874d58a6d41558c1f87ab5fab999947a1c5"
|
||||
},
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"promptSent": false
|
||||
},
|
||||
{
|
||||
"platform": "linux-x64",
|
||||
"status": "passed",
|
||||
"required": true,
|
||||
"evidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21-remote-qualified-source/linux-installed-smoke.json",
|
||||
"sha256": "sha256:11bbfa2e48bd5823667e26e06c0a75c2bb9c6f55db772e7c9d937b88fa445663"
|
||||
},
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"promptSent": false
|
||||
}
|
||||
],
|
||||
"singleIntegratedSourceCampaignComplete": false,
|
||||
"budget": {
|
||||
"ceilingUsd": 100,
|
||||
"priorSharedExposureUpperBoundUsd": 47.080380624,
|
||||
"combinedConservativeExposureUpperBoundUsd": 62.310304624,
|
||||
"remainingCeilingHeadroomUsd": 37.689695376,
|
||||
"nativeInferenceUsd": "unknown per run; included-credit aggregate valuation is not a measured per-run charge",
|
||||
"aggregateIncludedUsageDollarEquivalentUsd": 0.71,
|
||||
"reportingDelayContingencyUsd": 5,
|
||||
"releasedHistoricalInferenceContingencyUsd": 41.79,
|
||||
"billingControlsChanged": false,
|
||||
"accountBindingVerified": true,
|
||||
"billingProofSha256": "sha256:aed119f7635b7eb46bc89e3d43a9afd163a9ba9ee56671afbd3f0c6c7b16360a",
|
||||
"privateLedgerSha256": "sha256:5f8e6407b2d87ba30713bedfe06c6bafc3aefcb17f405168659dca95f8f0a2a8",
|
||||
"budgetIncreaseRequestDisposition": "withdrawn-unneeded; original $100 ceiling retained"
|
||||
},
|
||||
"verification": {
|
||||
"sourceOwnershipAndProfileTests": {
|
||||
"status": "passed",
|
||||
"tests": 31
|
||||
},
|
||||
"vendoredProbeAndRegistryTests": {
|
||||
"status": "passed",
|
||||
"tests": 64
|
||||
},
|
||||
"freshPublishedLayoutInstallerTests": {
|
||||
"status": "passed",
|
||||
"tests": 3,
|
||||
"modelPromptSent": false,
|
||||
"qualificationOverrides": false,
|
||||
"covers": [
|
||||
"fresh runner and public server asset installation",
|
||||
"idempotence",
|
||||
"corruption refusal with evidence retention",
|
||||
"linked asset directory refusal",
|
||||
"unbuilt source bootstrap",
|
||||
"incomplete published artifact refusal"
|
||||
]
|
||||
},
|
||||
"serverPackagingBuild": {
|
||||
"status": "passed",
|
||||
"log": "/tmp/copilot-v21-frozen-source-build.log",
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209"
|
||||
},
|
||||
"vendorRuntimeImportGraph": "passed including live/index.js",
|
||||
"recursiveTypecheck": {
|
||||
"status": "passed",
|
||||
"log": "/tmp/copilot-v21-final-recursive-typecheck-authorized.log"
|
||||
},
|
||||
"fullTestRun": {
|
||||
"status": "failed",
|
||||
"log": "/tmp/copilot-v21-frozen-source-full-test.log",
|
||||
"filesPassed": 570,
|
||||
"filesFailed": 42,
|
||||
"filesSkipped": 144,
|
||||
"testsPassed": 9826,
|
||||
"testsFailed": 5,
|
||||
"testsSkipped": 5377,
|
||||
"cause": "PostgreSQL fixture startup failures and skips under exhausted macOS shared-memory slots; retained Git streaming stress timeout. Isolated Linux verification is being prepared; no full-suite pass claimed."
|
||||
},
|
||||
"fullBuild": {
|
||||
"status": "passed",
|
||||
"log": "/tmp/copilot-v21-frozen-source-build.log",
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209"
|
||||
},
|
||||
"runnerContracts": {
|
||||
"status": "eval kernel, protocol and Rust passed; HTTP integration blocked by host PostgreSQL startup even when run alone",
|
||||
"log": "/tmp/copilot-v21-final-api-authority-serialized.log",
|
||||
"next": "Run maintained commands in isolated Linux controller with private IPC namespace."
|
||||
},
|
||||
"tokenGates": {
|
||||
"status": "passed",
|
||||
"log": "/tmp/copilot-v21-final-token-gates.log"
|
||||
},
|
||||
"runnerApiAuthorityIsolatedLinux": {
|
||||
"status": "passed",
|
||||
"testCount": 1852,
|
||||
"files": 3,
|
||||
"log": "/tmp/copilot-v21-isolated-linux/api-authority.log",
|
||||
"assertionsChanged": false
|
||||
},
|
||||
"fullTestIsolatedLinux": {
|
||||
"status": "failed-attempt-interrupted-after-environment-diagnosis",
|
||||
"log": "/tmp/copilot-v21-isolated-linux/full-test.log",
|
||||
"resources": {
|
||||
"memoryGiB": 6,
|
||||
"cpuSet": "0-3",
|
||||
"ipc": "private"
|
||||
},
|
||||
"modelCredentialsProvided": false,
|
||||
"foreignContainersChanged": false,
|
||||
"demonstratedEnvironmentCauses": [
|
||||
{
|
||||
"dependency": "lsof",
|
||||
"evidence": "Missing in initial private controller; unchanged listener-ownership implementation invokes lsof."
|
||||
},
|
||||
{
|
||||
"dependency": "jq",
|
||||
"evidence": "Missing in initial private controller; unchanged artifact-helper tests invoke jq."
|
||||
},
|
||||
{
|
||||
"dependency": "GLIBCXX_3.4.31",
|
||||
"evidence": "ldd of installed HEIC native binary reports this version missing in Debian 12 controller."
|
||||
}
|
||||
],
|
||||
"environmentRepair": "Private Ubuntu 24.04 controller with frozen source and assets is building; failed attempts and assertions retained.",
|
||||
"interruptionProof": "/tmp/copilot-v21-isolated-linux/full-test-first-attempt-interruption.json",
|
||||
"completeCoverage": false,
|
||||
"fullSuitePassClaimed": false,
|
||||
"next": "Run retained failed suites in repaired controller, then complete full maintained checks."
|
||||
},
|
||||
"isolatedControllerDependencies": {
|
||||
"status": "passed",
|
||||
"sourceFilesVerified": 8459,
|
||||
"sourceAndRuntimeUnchanged": true,
|
||||
"lsof": true,
|
||||
"jq": true,
|
||||
"heicNativeBindingLoaded": true,
|
||||
"proof": "/tmp/copilot-v21-isolated-linux/complete-test-tools-frozen-source-verification.json"
|
||||
},
|
||||
"environmentRegressionFollowup": {
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d",
|
||||
"imageId": "sha256:e22d05e9a9d28019a35f059ba5ca319a783cac0857d217b1307a856f44325204",
|
||||
"files": [
|
||||
"server/src/__tests__/workspace-runtime.test.ts",
|
||||
"server/src/services/workspace-runtime-exposure.test.ts",
|
||||
"server/src/__tests__/workspace-runtime-exposure-reservation.test.ts",
|
||||
"server/src/__tests__/photon/photon.test.ts",
|
||||
"server/src/__tests__/photon/channel.integration.test.ts",
|
||||
"server/src/__tests__/paperclip-skill-utils.test.ts"
|
||||
],
|
||||
"status": "failed",
|
||||
"exitCode": 1,
|
||||
"assertionsChanged": false,
|
||||
"modelCredentialsProvided": false,
|
||||
"startedAt": "2026-10-05T18:33:57.887520+00:00",
|
||||
"completedAt": "2026-10-05T18:39:48.841064+00:00",
|
||||
"testsPassed": 260,
|
||||
"testsFailed": 2,
|
||||
"filesPassed": 5,
|
||||
"filesFailed": 1,
|
||||
"log": "/tmp/copilot-v21-isolated-linux/environment-regressions.log",
|
||||
"remainingFailures": [
|
||||
{
|
||||
"name": "bind-race fixture assumes child readiness within 200 ms",
|
||||
"evidence": "/tmp/copilot-v21-isolated-linux/workspace-fixture-startup-timing.json",
|
||||
"measuredStartupMs": [
|
||||
221,
|
||||
221,
|
||||
207,
|
||||
207,
|
||||
218
|
||||
],
|
||||
"affectedCodeDiffFromPinnedMainline": "none"
|
||||
},
|
||||
{
|
||||
"name": "listener-ownership-unavailable fixture exceeds its 20-second deadline",
|
||||
"status": "unresolved release verification gate",
|
||||
"affectedCodeDiffFromPinnedMainline": "none"
|
||||
}
|
||||
]
|
||||
},
|
||||
"packageContractFinal": {
|
||||
"status": "passed",
|
||||
"tests": 10,
|
||||
"log": "/tmp/copilot-production-campaign-v21/final-package-contract.log",
|
||||
"qualificationOnlyAmendmentRecorded": true
|
||||
}
|
||||
},
|
||||
"remainingReleaseGates": [
|
||||
"Obtain exact approval of prepared private controller payload and public frozen image uploads, then execute qualification.",
|
||||
"Pass 20 Product selectors, seven Runner protocol cases and all three installed-runtime smokes on the frozen v21 source.",
|
||||
"Complete runner contracts, UI/connection regressions, token gates, recursive typecheck, full tests and build.",
|
||||
"Promote Copilot consistently while keeping Cursor/Pi qualification unchanged; verify fresh ordinary setup and a canary without qualification overrides.",
|
||||
"Publish current documentation and qualification evidence; require current-head CI and review before rollout."
|
||||
],
|
||||
"upstreamIntegrated": true,
|
||||
"mainlineIntegrationRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"rebasedVerification": [
|
||||
{
|
||||
"check": "Copilot profile generation and consistency",
|
||||
"status": "passed",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d"
|
||||
},
|
||||
{
|
||||
"check": "Product catalog and report support",
|
||||
"status": "passed",
|
||||
"testCount": 44,
|
||||
"log": "/tmp/copilot-v21-rebased-catalog-authorized.log"
|
||||
},
|
||||
{
|
||||
"check": "Runner TypeScript build",
|
||||
"status": "passed",
|
||||
"log": "/tmp/copilot-v21-rebased-ts-build.log"
|
||||
},
|
||||
{
|
||||
"check": "Copilot package contracts",
|
||||
"status": "passed",
|
||||
"testCount": 42,
|
||||
"log": "/tmp/copilot-v21-rebased-copilot-contracts.log"
|
||||
},
|
||||
{
|
||||
"check": "Mainline completion, shutdown and native executor regressions",
|
||||
"status": "passed",
|
||||
"testCount": 554,
|
||||
"log": "/tmp/copilot-v21-mainline-settlement-regressions.log"
|
||||
},
|
||||
{
|
||||
"check": "Database-dependent arbitration, project tools and workspace finalization",
|
||||
"status": "passed",
|
||||
"testCount": 24,
|
||||
"log": "/tmp/copilot-v21-postgres-recovered-diagnostic.log"
|
||||
},
|
||||
{
|
||||
"check": "Daytona immutable build content contract, including asset installer",
|
||||
"status": "passed",
|
||||
"testCount": 8,
|
||||
"log": "/tmp/copilot-v21-rebased-image-contract.log"
|
||||
}
|
||||
],
|
||||
"postgresDiagnostic": {
|
||||
"cause": "macOS 32 shared-memory slots exhausted; direct initdb stderr confirms shmget ENOSPC",
|
||||
"evidence": "/private/tmp/copilot-v21-pg-init-diagnostic-__8kvlko/stderr.log",
|
||||
"cleanup": "/tmp/copilot-production-campaign-v21/owned-postgres-ipc-cleanup.json",
|
||||
"scope": "one zero-attached IPC segment matched to campaign postmaster.pid and this worktree postmaster.opts; foreign segments retained",
|
||||
"rerunStatus": "24 tests passed across three formerly failing files; four other files pending current-source check"
|
||||
},
|
||||
"retainedBuildFailures": [
|
||||
{
|
||||
"attempt": "ARM64 provider pack after adding optional native dependencies",
|
||||
"status": "failed-before-inference",
|
||||
"cause": "pnpm native-platform .bin shim retained a temporary deployment path",
|
||||
"log": "/tmp/copilot-production-campaign-v21/arm-provider-pack-build.log",
|
||||
"fix": "Rewrite installed Copilot platform shims to pack-relative native launchers; retain the existing rejection for every remaining temporary path",
|
||||
"costUsd": 0,
|
||||
"modelPromptSent": false
|
||||
}
|
||||
],
|
||||
"frozenSourceEvidence": {
|
||||
"path": "/tmp/copilot-production-campaign-v21/frozen-source.json",
|
||||
"sha256": "sha256:de5c8eb7357f4f450fe6305a814bbe010e9d680880ea5cd3545e0a0ea79bf2c0"
|
||||
},
|
||||
"qualificationOnlyAmendments": {
|
||||
"packages/paperclip-runner/test/acpx-codex-package-contract.test.mjs": {
|
||||
"sha256": "sha256:97c0eef3c1261b5a931fa6c3fd1de6a3b5afd39dd6a88c8ed4dea1f82d5e713a",
|
||||
"patchPath": "/tmp/copilot-production-campaign-v21/qualification-package-contract-amendment.patch",
|
||||
"patchSha256": "sha256:003a101f0b66a7e2493d8de2a27f67b0bc191c6483e838a9bb00dea1c2c467ec",
|
||||
"scope": "Offline test assertion now requires exactly the three pinned Copilot optional dependencies. No executable or package input changed."
|
||||
}
|
||||
},
|
||||
"platformPacks": {
|
||||
"providerPackDigest": "sha256:e0cd86b31885353f3eba635a040ed53a9bf01526c88c75db4da69890a74c3f5f",
|
||||
"intelProviderPackDigest": "sha256:569cbc72e28a0c8459097ff6d96fbf81f445724fd8cf23f887d80d44ee0d6159",
|
||||
"runnerPackageSha256": "sha256:4ba7a1436afa7a4efb59dfe0a79237861e8fccc337238873dbd7e4932df24c34"
|
||||
},
|
||||
"daytonaImage": {
|
||||
"imageTag": "ghcr.io/paperclipai/paperclip-daytona-runner:copilot-qualification-7842dba3e92257219da8",
|
||||
"expectedIndexDigest": "sha256:d228ee6bd84717410e2fcc79a62cc781f92b787a9d09781786b7ac19aae45899",
|
||||
"status": "Built and Linux installed smoke passed. Public upload not executed; exact upload approval is pending after two automatic approval review rejections."
|
||||
},
|
||||
"isolatedControllerEnvironment": {
|
||||
"sourceRevision": "1d4bc65c3cf4c3a74da59f82f306a718e3180209",
|
||||
"profileDigest": "sha256:3bd433d9835ab6998ee712da41cad724006bb85d444f0cf96550708565605b7d",
|
||||
"providerPackDigest": "sha256:7a4f2c6fdfa395a5f45857781ebfa08cc118cbd38548d9de185ba80eef660150",
|
||||
"runnerdSha256": "sha256:fcaaccaba6f85ec9870fe2f8eeeedf48ffab68cc0f6d9dc348ee0e39ac092bc3",
|
||||
"nodeSha256": "sha256:7fde7b8afa198da66257f42ee2001d874c7355631e6d1579a5fb5ef1f246df4c",
|
||||
"imageId": "sha256:e22d05e9a9d28019a35f059ba5ca319a783cac0857d217b1307a856f44325204",
|
||||
"imageIndexDigest": "sha256:e22d05e9a9d28019a35f059ba5ca319a783cac0857d217b1307a856f44325204",
|
||||
"publication": "private local controller only",
|
||||
"credentialsIncluded": false,
|
||||
"sourceTreeProofSha256": "sha256:8506e9b8456d571b2f170ed6db25db7d895b5f240c24099078d44626337feecd",
|
||||
"ipcNamespace": "private",
|
||||
"testEnvironmentAmendment": {
|
||||
"reason": "Install lsof, jq and compatible C++ runtime required by unchanged regression tests",
|
||||
"productionSourceChanged": false,
|
||||
"previousImageId": "sha256:f59ad48e11957c717da81b76aae8c036853c173ae7b646d732ece03b30a0ddd8",
|
||||
"proofPath": "/tmp/copilot-v21-isolated-linux/complete-test-tools-frozen-source-verification.json",
|
||||
"proofSha256": "sha256:9c5f2354431325a44337e674882d17e164fc36c230cb771e9d10537526f10e3b"
|
||||
}
|
||||
},
|
||||
"nativePrivateController": {
|
||||
"status": "prepared; upload rejected by automatic approval review; exact user approval pending",
|
||||
"payloadProof": "/tmp/copilot-v21-native-controller/payload-proof.json",
|
||||
"payloadSha256": "sha256:4f6af192e8c60c3de910c097be4dd07d543b6dc116c518a711fe34ab997f23bf",
|
||||
"payloadBytes": 1016912183,
|
||||
"knownCredentialMatches": 0,
|
||||
"filesScanned": 14300,
|
||||
"destination": "copilot-v21-native-private-controller-01, private Daytona sandbox, public=false",
|
||||
"sandboxCreated": false,
|
||||
"payloadUploaded": false,
|
||||
"plannedInfrastructureReservationUsd": 3,
|
||||
"reservationActuallyCreated": false,
|
||||
"plannedTtlMinutes": 450,
|
||||
"purpose": "Native x64 qualification controller; frozen workload image and application source remain unchanged."
|
||||
},
|
||||
"productionPromotionDraft": {
|
||||
"applied": false,
|
||||
"proofPath": "/tmp/copilot-production-campaign-v21/promotion-draft-provenance.json",
|
||||
"files": 6,
|
||||
"requiresQualificationPasses": true,
|
||||
"transportAdmission": "Ordinary server will explicitly admit the validated qualified Copilot descriptor internally; no qualification environment override required."
|
||||
},
|
||||
"historicalStatus": "Awaiting exact payload/destination approval; no active paid run; production admission remains gated",
|
||||
"supersededAt": "2026-10-06",
|
||||
"supersededBy": {
|
||||
"checklist": "2026-10-03-copilot-production-readiness.md",
|
||||
"upstreamTargetRevision": "a6306ba606eb87c89b9ef0344e9fe8e0025580f9",
|
||||
"profileVersion": 22,
|
||||
"sourceFreezeComplete": false,
|
||||
"historicalPassesQualifyCurrentSource": false
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,70 @@
|
||||
{
|
||||
"schema": "paperclip.copilot.qualification-summary/v1",
|
||||
"recordedAt": "2026-10-08T12:31:43.458335+00:00",
|
||||
"sourceRevision": "c4b5d40bcfd51e6cacccc1ea1343305b05735641",
|
||||
"profileVersion": 30,
|
||||
"profileDigest": "sha256:e21c4a43a937ae84e94726ef93227e8b931fa5547876ff0c5ecff304656d81e9",
|
||||
"copilotVersion": "1.0.88",
|
||||
"model": "gpt-5.6-luna",
|
||||
"product": {
|
||||
"passed": 20,
|
||||
"local": 10,
|
||||
"daytona": 10,
|
||||
"cleanupPassed": true,
|
||||
"automaticRetries": 0,
|
||||
"resultHashes": {
|
||||
"copilot-protection.runner-acpx-copilot.local.attached-async-settlement": "sha256:08ca542b48656ef60a36f4c700f29df59607b830574e1b88f0c603927a25e0c9",
|
||||
"copilot-protection.runner-acpx-copilot.local.native-permission-deny-write": "sha256:146c01ce7ab530b8c5f5217a18b9d1982fae3b0750a6f98eb9ca62133949aa12",
|
||||
"native-active-stop.runner-acpx-copilot.local.pending-permission-stop": "sha256:7033b9d8f82a3af9b6ba18a5d1a8b561222c59ec110de2c3c050599eea6e3e4a",
|
||||
"copilot-provider-death.runner-acpx-copilot.local.pending-permission-provider-death": "sha256:68877ebd94c1e71e8b8993fb4b6430a163b8bec344442b8e32f11a7ec3cb018e",
|
||||
"rich-acp-warm-continuity.runner-acpx-copilot.local.warm-three-turn": "sha256:7e9a282cee656b1732440f3b2c2a3f46d20616d6ae361e3a2fca28aff9a4b9e1",
|
||||
"extended-harnesses.runner-acpx-copilot.local.hello-complete": "sha256:6ef6ffbc1095a4eb8b6bf3d12d1a4bd992d9cbb950cbaafdaad3def717958a24",
|
||||
"extended-harnesses.runner-acpx-copilot.local.file-edit-validate": "sha256:c5f566b8ac29569313d6f37de1b48b27f39eb82f9b3f7f0f25f4e125c32d0d0b",
|
||||
"extended-harnesses.runner-acpx-copilot.local.question-resume-complete": "sha256:7670ab0eec5d4c561658c2aa6341809357d8e2d0edd1cf1d3a48d1a02fd9249a",
|
||||
"extended-harnesses.runner-acpx-copilot.local.plan-approve-complete": "sha256:f2a277571046f33032c53d9e9726720280f03d9383573b8bc1342ff7d3249612",
|
||||
"extended-harnesses.runner-acpx-copilot.local.structured-question-restart-resume": "sha256:e1acb10539eb006a6974ac1366fe3395c1fe742fc8d85da2ad766dd0f2f1f261",
|
||||
"copilot-protection.runner-acpx-copilot.daytona.attached-async-settlement": "sha256:fd219eadb5d5a70ec9d192a194064b529c6a8a709272cb24f7cf78905e683e7c",
|
||||
"copilot-protection.runner-acpx-copilot.daytona.native-permission-deny-write": "sha256:9243b5b4c2ee04cae99855443df579ba14923f29f14108f0dd05c94076f88e8d",
|
||||
"native-active-stop.runner-acpx-copilot.daytona.pending-permission-stop": "sha256:f8f7e07016d450ea0476154c266b482fcfd9feee41bf0f39eb9d297e5fa13cf0",
|
||||
"copilot-provider-death.runner-acpx-copilot.daytona.pending-permission-provider-death": "sha256:979a95e226c1ab5ef31178b70961de5fb4c6a54dfc5979166bc6f2d2983cc583",
|
||||
"rich-acp-warm-continuity.runner-acpx-copilot.daytona.warm-three-turn": "sha256:cea972b23f46ed063d49582788d634d628ee86e2dc870d87e5ae0085f0a20fae",
|
||||
"extended-harnesses.runner-acpx-copilot.daytona.hello-complete": "sha256:7eaaed3c36257773b05c6701edd29d1ae5636b0892b6f64e503224453ff21766",
|
||||
"extended-harnesses.runner-acpx-copilot.daytona.file-edit-validate": "sha256:9d06532c52675743a1481675dc28e5e7c8052faed4007d3c0bcdeb7860c4cac3",
|
||||
"extended-harnesses.runner-acpx-copilot.daytona.question-resume-complete": "sha256:ecc1c077842cb841888fad0ad492e02f4736e41170b33f00917220acdb074cdc",
|
||||
"extended-harnesses.runner-acpx-copilot.daytona.plan-approve-complete": "sha256:e092f188a545135cb7c715fa8ce5b86c9d987dd1ca1e0e0d37545c8f79b1cc9d",
|
||||
"extended-harnesses.runner-acpx-copilot.daytona.structured-question-restart-resume": "sha256:951b248c0ba78c134dbb96fbf359eb173fe0c37637797ff2b6efbff4e7c8abef"
|
||||
}
|
||||
},
|
||||
"protocol": {
|
||||
"passed": 7,
|
||||
"assertions": 46,
|
||||
"cleanupPassed": true
|
||||
},
|
||||
"ordinaryInstallationCanaries": {
|
||||
"local": {
|
||||
"passed": true,
|
||||
"qualificationOverrides": []
|
||||
},
|
||||
"daytona": {
|
||||
"passed": true,
|
||||
"qualificationOverrides": [],
|
||||
"artifactSha256": "sha256:f027a4aa09e216e60de84748477ecefcc10e46fa8efd80340316fbf6641edfe0",
|
||||
"allOwnedSandboxesAbsent": true,
|
||||
"oneFinalResponse": true,
|
||||
"acceptedCompletionEvidence": true
|
||||
}
|
||||
},
|
||||
"publicImage": "ghcr.io/paperclipai/paperclip-daytona-runner@sha256:2ccfe999e7794ea1577e581840743a466663143c4303a518e06b3f1e0faa58fb",
|
||||
"billingEntity": "github",
|
||||
"nativeUsd": null,
|
||||
"retainedFailures": [
|
||||
"Historical roster prerequisite rejected before provider launch",
|
||||
"Daytona controller-local artifact path prerequisite rejected before provider launch",
|
||||
"Local evidence collector initially read only its first event page",
|
||||
"Manual metadata Test intentionally archived its sandbox; the owned archive was subsequently deleted"
|
||||
],
|
||||
"ciPassed": false,
|
||||
"reviewPassed": false,
|
||||
"shipped": false,
|
||||
"scope": "Completed v30 qualification. Master recovery compatibility is evaluated separately; this record does not qualify changed runtime bytes."
|
||||
}
|
||||
Reference in new issue
Block a user