Checkpoint first passed initial and unaffected sequential batch

doc/plans/2026-10-26-chat-catalog-eval-progress.md

@@ -7,8 +7,8 @@ Updated: 2026-10-27. This is the single progress record for [the saved goal](202
 - **244 scenarios / 35 areas / 191 capabilities**, frozen inventory digest `9dc9cf6a5426cf1b56bc30a3571851f233f9dd5e93a1292eaee414d33b52df77`. All original queries, contexts and expected outcomes remain unchanged. **196 passes required**; blocked, partial, unsupported and unrun remain in the denominator.
 - **229 authored: 220 without declared coverage gaps, 9 partial, 15 unimplemented** at exact committed-source metadata checkpoint `32b472dfa5640987e199c2e0aa21b2c7c02555c6`. There are 227 concrete lazy descriptors plus two legacy task cases. Actual callbacks, bounds, policies and source dependencies were reconciled from this one Git archive; newer area work remains pending. These are authoring counts, not acceptance.
 - Five partial definitions contain concrete executable supported-surface/context blocker probes: two access grants, subscription provenance, skill-use authority/context and genuine prior-day routine history. Four have unfinished required branches: the Grok origin integration closure, named ChatGPT setup, team installer failures and private-repository after-grant completion. **225 authoring-resolved; 4 unfinished; 15 absent.** Only actual reserved execution can process a concrete blocker; offline probes/calibrations do not establish processing. Incomplete conditions cannot pass.
-- **Seven scenarios attempted; eight actual measurements; zero first-attempt passes and zero final passes (0/244 for both rates).** Goal-tree is exhausted after two failures. Alignment and purpose each retain one failed initial attempt and one allowed correction/rerun remaining.
-- **No live launcher or provider process is running.** Broken-link ordinal 1 failed from qualified immutable6be after a deduplicated fixture alias caused the distractor reread to return404. Packaging additionally caught/redacted a real fixture invitation token in the product HTTP request log and withheld the affected blob. Cleanup passed/Docker removed; admissions stopped for this shared privacy issue. Profile and the next12 approved initials remain unreserved. All original failures and final-B holds remain unchanged.
+- **9 scenarios admitted; 10 launched measurements; 9 terminal measurements; 1 real first-attempt pass, pending final current-identity eligibility.** Running: `tasks.delegate-announcement`. Original failures remain unchanged; goal-tree exhausted and all final-B retries held.
+- **The approved unaffected11 initial batch is running sequentially from qualified immutable6be**, maxParallel1/retries0. Profile and quick-search remain unreserved/quarantined because their selected setup accepts invitations; other selected callbacks do not execute that credential-bearing route. No scanner exception or test logging adapter was added. Separate isolated core fixes are manager-owned; measured product baseline remains8373.
 - Current recovery: semaphore cleanup approval is still pending and no set has been removed. Read-only discovery verified an already running local Docker Linux/arm64 engine; an explicit owned PostgreSQL18.6 lane is being qualified. Its one infrastructure-only health check at `772c29dad9` failed before container start because Docker Desktop represents the exact host password bind with `/host_mnt`; no Paperclip, native or model work began. The initial failed cleanup receipt is preserved; separate authorized cleanup verified exact container/volume absence and removed only its password. The separately authorized corrected infrastructure-only health at `325af67e3d` passed PostgreSQL18.6, normal onboarding/migrations/API and zero work; exact owned resources were removed with no cleanup failures. The Docker lane is qualified; host IPC cleanup is no longer required. AgentMail/GitHub read-only discovery is authorized/completed; designated self-email and repository choices remain pending.
 - Production baseline `8373d7867963674ff960d2345d0d28086f799bc7`; branch `codex/chat-catalog-evals`. PR #17794 merged via `2ee36a4`. No eval/core PR has been created. No merge is eligible.
 
@@ -263,3 +263,9 @@ Broken-link ordinal1 then ran as `catalog-initial-2026-10-27T07-35-44-803Z-navig
 Separately, diagnostic privacy evidence shows the registered setup human invitation token in the ordinary product HTTP URL `POST /invites/[REDACTED]/accept202`. The stream/report safeguards redacted both text sinks and omitted the affected blob; no raw credential value was inspected for diagnosis. All admissions stopped on this shared privacy finding despite cleanup passing and exact Docker status removed. Profile plus the approved12 initial list remain unreserved, with no rerun or final-B measurement. Bounded diagnosis: `broken-link-6be-diagnosis.json`.
 
 The separately authorized registered-artifact transport fix `cbb6593441` uses the existing authenticated `getAttachmentContent` path, retaining attachment origin/size/hash gates.33 focused controls and scoped tsc passed; no executed archive was modified. Selection-summary provenance sidecar explicitly retains historical snapshot4/5 counts versus current ledger7/8 and the previously acknowledged external-fixture source overlap.
+
+### Unaffected initial batch resumed
+
+After actual selected-setup review, only profile and quick-search invoke `enrollAuthenticatedPerson` among the pending13. They remain unreserved. The manager authorized continuing the other11 from unchanged6be; `initial-invite-setup-disposition-6beacfe0a9.json` records exact disposition. Create-backlog ordinal1 **passed** with1native/346,471tokens and confirmed cleanup/Docker removal. Original passed measurement is preserved. `initial-pass-identity-review-tasks.create-backlog.json` records actual changed selected source hashes, not a new Git SHA alone; affected final eligibility waits for the single allowed coherentB measurement. Delegation began next with its declared3-native bound.
+
+The area-only broken-link fixture correction `61c863364a` uses a distinct similarly named replacement and independent saved ID/project readback guard before deletion;10 controls plus scoped tsc pass. It preserves the original request/oracle and failed initial; its correction measurement stays held forB. Shared artifact transport correction remains separate `cbb6593441`. Source metadata for runtime067f unknown-email and later external callbacks is queued until this batch naturally ends.

tests/runner-e2e/chat-campaign-manifest.json

@@ -6177,7 +6177,58 @@
       "readiness": "implemented",
       "executionId": "chat-features.runner-codex-subscription.local.create-backlog",
       "blocker": null,
-      "attempts": [],
+      "attempts": [
+        {
+          "ordinal": 1,
+          "outcome": "passed",
+          "executionId": "chat-features.runner-codex-subscription.local.create-backlog",
+          "startedAt": "2026-10-27T07:48:02.705Z",
+          "finishedAt": "2026-10-27T07:49:36.818Z",
+          "sourceRevision": "6beacfe0a94e87b9b834f0f1d46d42e8ec7aec42",
+          "workingTreeDigest": "53640393f175333461cda9166a04dd4d99895eacf646cfd14838e579cc12ba57",
+          "definitionDigest": "29bdc2510b0d747e1d78be8d4598cfd2d1ca428d8bb36279da9d852a708a915a",
+          "suiteDefinitionDigest": "87540a2990ac4e8af4ec918da2550547cc10e18fc0ec557941d427080951430a",
+          "graderDigest": "29bdc2510b0d747e1d78be8d4598cfd2d1ca428d8bb36279da9d852a708a915a",
+          "model": "gpt-5.6-sol",
+          "profile": "runner-codex-subscription",
+          "environment": "local",
+          "automaticRetries": 0,
+          "correction": null,
+          "classification": "provisional_initial_pass_pending_final_closure",
+          "observedFailure": null,
+          "evidencePaths": [
+            "tests/runner-e2e/results/chat-catalog-campaign/admitted-initials-6beacfe0a9.json",
+            "tests/runner-e2e/results/catalog-initial-2026-10-27T07-48-02-705Z-tasks-create-backlog/chat-features/runner-codex-subscription/local/create-backlog/attempt-1/result.json",
+            "tests/runner-e2e/results/chat-catalog-campaign/active-tasks.create-backlog.json"
+          ],
+          "usage": {
+            "costUsd": null,
+            "tokens": 346471,
+            "coverage": "Actual heartbeat usage receipts, including cache; subscription cost unpriced unless complete billing; fixture costs excluded."
+          },
+          "cleanup": "passed",
+          "corePrDependencies": [],
+          "databaseLane": {
+            "lane": "owned-docker-postgres",
+            "image": "postgres@sha256:74935e72241653ca55e0414067e6d8763aceb8a810eb51b452253ec3dcfc4336",
+            "imageId": "sha256:74935e72241653ca55e0414067e6d8763aceb8a810eb51b452253ec3dcfc4336",
+            "version": "18.6-1.pgdg13+2"
+          },
+          "productIdentity": {
+            "kind": "source-build",
+            "productionSourceRevision": "8373d7867963674ff960d2345d0d28086f799bc7",
+            "snapshotSourceRevision": "6beacfe0a94e87b9b834f0f1d46d42e8ec7aec42",
+            "nativeBinarySha256": "9d8af6b85b836a03092ade2273be6f29f5c2f6ec67ee891d83ee9693ba39d3b4",
+            "workspaceBuildDigest": "222e10a8a2a20d3015ec4470b952e2dd9b927dfe9390c4a5ed1e19d740c0e35b",
+            "receiptPaths": [
+              "tests/runner-e2e/results/chat-catalog-campaign/snapshot-6beacfe0a9.json",
+              "tests/runner-e2e/results/chat-catalog-campaign/snapshot-10d0ce63610.json",
+              "tests/runner-e2e/results/chat-catalog-campaign/snapshot-0fdcb539a8.json"
+            ],
+            "coreCandidate": false
+          }
+        }
+      ],
       "qualifyingDefinitionDigest": null,
       "qualifyingGraderDigest": null,
       "productPolicy": {
@@ -6205,9 +6256,58 @@
       "readiness": "implemented",
       "executionId": "chat-features.runner-codex-subscription.local.delegate-announcement",
       "blocker": null,
-      "attempts": [],
-      "qualifyingDefinitionDigest": null,
-      "qualifyingGraderDigest": null,
+      "attempts": [
+        {
+          "ordinal": 1,
+          "outcome": "running",
+          "executionId": "chat-features.runner-codex-subscription.local.delegate-announcement",
+          "startedAt": "2026-10-27T07:49:37.766Z",
+          "finishedAt": null,
+          "sourceRevision": "6beacfe0a94e87b9b834f0f1d46d42e8ec7aec42",
+          "workingTreeDigest": "53640393f175333461cda9166a04dd4d99895eacf646cfd14838e579cc12ba57",
+          "definitionDigest": "d008f0db4ad68402292e33b61dcaa71ce1a4fd93d21d355fe249191821e8be07",
+          "suiteDefinitionDigest": "87540a2990ac4e8af4ec918da2550547cc10e18fc0ec557941d427080951430a",
+          "graderDigest": "d008f0db4ad68402292e33b61dcaa71ce1a4fd93d21d355fe249191821e8be07",
+          "model": "gpt-5.6-sol",
+          "profile": "runner-codex-subscription",
+          "environment": "local",
+          "automaticRetries": 0,
+          "correction": null,
+          "classification": null,
+          "observedFailure": null,
+          "evidencePaths": [
+            "tests/runner-e2e/results/chat-catalog-campaign/admitted-initials-6beacfe0a9.json"
+          ],
+          "usage": {
+            "costUsd": null,
+            "tokens": null,
+            "coverage": "pending actual native usage receipts"
+          },
+          "cleanup": "pending",
+          "corePrDependencies": [],
+          "databaseLane": {
+            "lane": "owned-docker-postgres",
+            "image": "postgres@sha256:74935e72241653ca55e0414067e6d8763aceb8a810eb51b452253ec3dcfc4336",
+            "imageId": "sha256:74935e72241653ca55e0414067e6d8763aceb8a810eb51b452253ec3dcfc4336",
+            "version": "18.6-1.pgdg13+2"
+          },
+          "productIdentity": {
+            "kind": "source-build",
+            "productionSourceRevision": "8373d7867963674ff960d2345d0d28086f799bc7",
+            "snapshotSourceRevision": "6beacfe0a94e87b9b834f0f1d46d42e8ec7aec42",
+            "nativeBinarySha256": "9d8af6b85b836a03092ade2273be6f29f5c2f6ec67ee891d83ee9693ba39d3b4",
+            "workspaceBuildDigest": "222e10a8a2a20d3015ec4470b952e2dd9b927dfe9390c4a5ed1e19d740c0e35b",
+            "receiptPaths": [
+              "tests/runner-e2e/results/chat-catalog-campaign/snapshot-6beacfe0a9.json",
+              "tests/runner-e2e/results/chat-catalog-campaign/snapshot-10d0ce63610.json",
+              "tests/runner-e2e/results/chat-catalog-campaign/snapshot-0fdcb539a8.json"
+            ],
+            "coreCandidate": false
+          }
+        }
+      ],
+      "qualifyingDefinitionDigest": "d008f0db4ad68402292e33b61dcaa71ce1a4fd93d21d355fe249191821e8be07",
+      "qualifyingGraderDigest": "d008f0db4ad68402292e33b61dcaa71ce1a4fd93d21d355fe249191821e8be07",
       "productPolicy": {
         "lane": "source-build",
         "sourceBaselineRevision": "8373d7867963674ff960d2345d0d28086f799bc7"