From 390ef983d6c640b62e2e7a3697274a009875cac3 Mon Sep 17 00:00:00 2001 From: Dotta <34892728+cryppadotta@users.noreply.github.com> Date: Thu, 5 Nov 2026 16:05:01 -0600 Subject: [PATCH] test(evals): pin coherent secure-entry and team repairs (#19346) ## Thinking Path > - Paperclip manages AI agents and their work. > - The protected TestOps catalog selects one immutable source revision. > - The current pin predates reviewed secure-entry and Team observation repairs. > - A new run must use the qualified source and its exact descriptor bytes. > - This PR updates only the source pin, retained descriptor snapshot, and expected-target test. > - Existing failures remain failures until a new native run proves the feature. ## Linked Issues or Issue Description Refs: #19333, #19084, #18971, #19112. **What happened?** The current catalog points to the earlier source. It does not include the reviewed personal entry-dialog observer, visible secure-entry guidance, company menu navigation, Team claim attribution, or completion-link guidance changes. **Expected behavior** The protected catalog must select the qualified immutable source and verify its exact descriptor snapshot. Model, original queries, run counts, clocks, private transfer interfaces, and retries must remain fixed. **Steps to reproduce** Read the manifest target and candidate descriptor digest. Compare them with source `7ccfc33bf074e37d8fd901a6e8453d1b45307e82` and its committed descriptor bytes. ## What Changed - Pin source `7ccfc33bf074e37d8fd901a6e8453d1b45307e82`, tree `5afa0cf2e8ad8d17b7563e62378b0994f7777c67`. - Store the exact candidate descriptor snapshot with SHA256 `e1b7de947567569d96fcc9dca607ef5807ffaba4bf994562c0c7ab46d1856df6`. - Update current version and source-file provenance while retaining the original anchors and prior conditions. - Update one expected-target assertion. This PR changes exactly three metadata/test files. The final target-only successor retains the previous pin commit and its CI results; descriptor bytes do not change. ## Verification - 41 model-free manifest, adapter, reconciliation, and CLI controls pass. Another 42 chat-admission controls pass. - Initial source qualification: 268 focused controls, five explicit offline Chromium controls, and full E2E types pass. The first six-path Company/Team amendment passes 233 affected controls and full E2E types. The final reviewed six-path followup passes 271 affected controls, two offline browser canaries and full E2E types. Unchanged source inputs reuse the prior qualification. The accepted completion-feedback core patch has 22 real PostgreSQL controls from its owner. - All 244 scenario YAML definitions and all 242 descriptor run counts, clocks, authentication, and setup policy remain unchanged from the previous source. Seven descriptor rows change only versions or source-file lists. - SDK506 inputs and registry `efa70621` remain unchanged. Launcher SHA256 `2b9a6953` and private transfer interfaces remain fixed. - Fresh-main reporting installation passes with pnpm9.15.4, frozen lockfile, ignore-scripts, and offline mode. The unchanged reviewed report policy returns `already-reviewed`. No lock or workflow change is included. - Repo-wide build/typecheck were not repeated for this three-file metadata update. Normal PR CI remains required. ## Risks - Both secret journeys require independent review of the actual native handoff before any PASS credit. Unsafe value requests cannot count as a feature pass even if an oracle accepts them. Two additional unexercised adversarial wording guards (comma-only plaintext destinations and mixed reference/password requests) are being hardened separately in #19093. They are not included in this source pin. No current native PASS is claimed. - This pin includes reviewed source changes whose separate core/catalog PRs remain unmerged. This PR does not merge those features into master. - New native measurements remain required. The prior personal failure remains failed; its first native took 580602ms, and completion within the unchanged 660s remains unproven. - The plain-comment save acknowledgment fixes a downstream phase that the failed attempt did not reach. Component checks do not prove native completion. ## Model Used OpenAI Codex, GPT-6.1 Sol (`gpt-6.1-sol`), with code execution and repository tools. The runtime does not expose its context-window size. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge --- .../chat-full-catalog-testops-manifest.json | 56 ++++++++++--------- ...hat-full-catalog-testops-manifest.test.mjs | 2 +- .../chat-repair-candidate-descriptors.json | 16 +++--- 3 files changed, 41 insertions(+), 33 deletions(-) diff --git a/tests/runner-e2e/chat-full-catalog-testops-manifest.json b/tests/runner-e2e/chat-full-catalog-testops-manifest.json index dcecd680263..ab3dc58cc82 100644 --- a/tests/runner-e2e/chat-full-catalog-testops-manifest.json +++ b/tests/runner-e2e/chat-full-catalog-testops-manifest.json @@ -1,6 +1,6 @@ { "schema": "paperclip.chat-full-catalog-testops-manifest/v1", - "targetSha": "ab0f5246f765058af702b93d9b6637f2ef5b83cd", + "targetSha": "7ccfc33bf074e37d8fd901a6e8453d1b45307e82", "metadataSourceSha": "de0941835cc8f0d01c982574ee258e110babdbeb", "profile": "runner-opencode", "model": "openrouter/deepseek/deepseek-v4.1-flash-1017", @@ -172,7 +172,7 @@ "baseTargetSha": "3b66c3c144360ddf32714a0742fd774b8ceafb16", "previousTargetSha": "ab2019e976076ec0eb60b026844f3d9211cb0208", "definitionSourceSha": "de0941835cc8f0d01c982574ee258e110babdbeb", - "candidateDescriptorSha256": "0b57bba133a5c15860ca77b804f7282b5314d7feb8efbfd6f11fca42cdbdee49", + "candidateDescriptorSha256": "e1b7de947567569d96fcc9dca607ef5807ffaba4bf994562c0c7ab46d1856df6", "changedDefinitionFiles": [ { "path": "tests/runner-e2e/chat-scenarios/companies.yaml", @@ -199,7 +199,7 @@ "sha256": "91a9ddc4f5357f19a2cdc73ff8a090c741d14780e4ed502c856ebd557986f7e1" } ], - "conditions": "Historical qualification conditions (retained; statements that all requests or sourceFiles remain fixed refer to those earlier successors): New candidate measurements only. Original definitions, prior failed attempts and source6 ab201 remain historical. This target retains that catalog and integrates merged runtime fixes #18711, #18713 and #18718, with the prior-run restoration condition adapted to its existing owner. It adds the reviewed previous-question locator, attributed human-only denial and conditional-outcome oracle, and actor-sensitive timeline narrative/recorded-reassignment fixes. Closed finish diagnostics retain an effective schema digest, hashed call correlation and bounded type/category enums only. Historical MCP timeout and continuation-shape causes remain unresolved; no new all-ten PASS is claimed. Queries, model, human/native counts and original clocks remain fixed; the earlier Studio144 explicit 2..3 accounting stays. Core PRs18717/18734/18742 are now merged. SDK115 completion remains UNKNOWN and the other five SDK cases remain held. Full244 runtime catalog is not merged to master and the196/244 gate is unchanged. This successor binds the seven reviewed scenario repairs plus framework evidence: canonical skill navigation, original announcement phase clock, attributed timeline context, bound hire revision history, credential warning and configuration-question admission, completed team visibility, and canonical private framework evidence. Twelve declaration fields across eleven cases change only oracle versions and skill source-file provenance. All original requests, setup, human/native bounds, model and clocks remain fixed. Historical failed attempts and missing-original UNKNOWN grades remain unchanged; no uniform-ten PASS is claimed. The existing SDK506/efa qualification is reused only for byte-identical registered source inputs. This next successor adds reviewed question-surface observation, grounded scenario grading and safe credential-guidance boundaries after the retained uniform attempt. Eleven existing oracle-version leaves advance; all sourceFiles declarations, requests, setup, counts, clocks, model, launcher and private protocol helpers remain fixed. Component qualification does not attest a new uniform-ten pass.\n\nPrevious successor conditions (retained): This successor measures five reviewed repairs at the retained original model and bounds. Exactly one request is clarified: multipart53 now explicitly asks to walk through the visible form; its original broad request and failures4623/4717 remain historical. The previous inventory0cf530 is retained and the disclosed clarified inventory is814bb363. Other243 catalog requests are unchanged. The company-secret second human message now references the actual saved non-secret metadata instead of repeating the initial request; native continuation must remain attributed to the actual agent. Five oracle-version leaves and four source-file additions change; launcher, private helpers, SDK506/efa, identities, counts, clocks and the196/244 gate remain fixed. All five successor journeys remain unrun; component proof is not a PASS. For Team610, independently saved canonical skill/version/member proof establishes recovery; no required recovery-success phrase is imposed. A contradictory current denial still fails. If the required skill remains missing, truthful disclosure of that condition remains required.\n\nCurrent successor conditions: This target adds the reviewed personal secure-entry confirmation handoff, the typographic team partial-warning observer correction, and the company-secret authorization fix from unmerged core PR #19325. Personal v10 retains two declared logical human actions: one canonical chat request plus one independently verified same-human secure-save confirmation handoff. Raw chat comments remain one. Team v5 accepts the actual named-skill warning with a typographic apostrophe; saved-state, repeat, runtime, link, and false-success checks remain required. The company route returns scoped 403 guidance before malformed-body validation and preserves board-only creation. Its effect on the unfinished native turn is unproven. The three affected journeys are unrun on this target. Existing failed attempts remain failed. All queries, expected outcomes, native and human bounds, clocks, profile, model, launcher, private protocol, SDK506/efa, and the 196/244 admission gate remain fixed, including the recorded case53 query clarification. Local component proof is not native feature qualification or main/core merge credit.", + "conditions": "Historical qualification conditions (retained; statements that all requests or sourceFiles remain fixed refer to those earlier successors): New candidate measurements only. Original definitions, prior failed attempts and source6 ab201 remain historical. This target retains that catalog and integrates merged runtime fixes #18711, #18713 and #18718, with the prior-run restoration condition adapted to its existing owner. It adds the reviewed previous-question locator, attributed human-only denial and conditional-outcome oracle, and actor-sensitive timeline narrative/recorded-reassignment fixes. Closed finish diagnostics retain an effective schema digest, hashed call correlation and bounded type/category enums only. Historical MCP timeout and continuation-shape causes remain unresolved; no new all-ten PASS is claimed. Queries, model, human/native counts and original clocks remain fixed; the earlier Studio144 explicit 2..3 accounting stays. Core PRs18717/18734/18742 are now merged. SDK115 completion remains UNKNOWN and the other five SDK cases remain held. Full244 runtime catalog is not merged to master and the196/244 gate is unchanged. This successor binds the seven reviewed scenario repairs plus framework evidence: canonical skill navigation, original announcement phase clock, attributed timeline context, bound hire revision history, credential warning and configuration-question admission, completed team visibility, and canonical private framework evidence. Twelve declaration fields across eleven cases change only oracle versions and skill source-file provenance. All original requests, setup, human/native bounds, model and clocks remain fixed. Historical failed attempts and missing-original UNKNOWN grades remain unchanged; no uniform-ten PASS is claimed. The existing SDK506/efa qualification is reused only for byte-identical registered source inputs. This next successor adds reviewed question-surface observation, grounded scenario grading and safe credential-guidance boundaries after the retained uniform attempt. Eleven existing oracle-version leaves advance; all sourceFiles declarations, requests, setup, counts, clocks, model, launcher and private protocol helpers remain fixed. Component qualification does not attest a new uniform-ten pass.\n\nPrevious successor conditions (retained): This successor measures five reviewed repairs at the retained original model and bounds. Exactly one request is clarified: multipart53 now explicitly asks to walk through the visible form; its original broad request and failures4623/4717 remain historical. The previous inventory0cf530 is retained and the disclosed clarified inventory is814bb363. Other243 catalog requests are unchanged. The company-secret second human message now references the actual saved non-secret metadata instead of repeating the initial request; native continuation must remain attributed to the actual agent. Five oracle-version leaves and four source-file additions change; launcher, private helpers, SDK506/efa, identities, counts, clocks and the196/244 gate remain fixed. All five successor journeys remain unrun; component proof is not a PASS. For Team610, independently saved canonical skill/version/member proof establishes recovery; no required recovery-success phrase is imposed. A contradictory current denial still fails. If the required skill remains missing, truthful disclosure of that condition remains required.\n\nPrevious retained successor conditions: This target adds the reviewed personal secure-entry confirmation handoff, the typographic team partial-warning observer correction, and the company-secret authorization fix from unmerged core PR #19325. Personal v10 retains two declared logical human actions: one canonical chat request plus one independently verified same-human secure-save confirmation handoff. Raw chat comments remain one. Team v5 accepts the actual named-skill warning with a typographic apostrophe; saved-state, repeat, runtime, link, and false-success checks remain required. The company route returns scoped 403 guidance before malformed-body validation and preserves board-only creation. Its effect on the unfinished native turn is unproven. The three affected journeys are unrun on this target. Existing failed attempts remain failed. All queries, expected outcomes, native and human bounds, clocks, profile, model, launcher, private protocol, SDK506/efa, and the 196/244 admission gate remain fixed, including the recorded case53 query clarification. Local component proof is not native feature qualification or main/core merge credit.\n\nPrevious retained successor conditions: This target repairs personal secure-entry observation and truthful human acknowledgment, company secure-entry language and ordinary visible menu navigation, team current-skill claim attribution, and native completion feedback that asks for usable product links. Personal v11 expands visible Details before entry when needed, binds the exact value-entry dialog instead of the underlying definition sheet, and sends a truthful secure-save acknowledgment on the plain-comment path. The latter path was not reached by the prior failed attempt. Company v9 and the four shared-language consumers v5 keep explicit non-chat exclusions local to secure entry. Team v6 retains independent saved-state proof and rejects contradictory current claims. The source includes the separately reviewed, unmerged completion-feedback core hunk. All affected native journeys remain unrun on this target; original failures remain failed. The prior personal first native took580602ms, so completion within the unchanged660s remains unproven. Queries, counts, clocks, model, retries, SDK506/efa, launcher and private transfer interfaces are unchanged from the previous target; the recorded case53 clarification remains retained. Local control proof is not native PASS or a core merge.\n\nPrevious retained successor conditions: This unrun successor adds only the reviewed Company reference, credential-request and actor-boundary corrections plus Team current-assertion temporal scoping. Canonical server default reference metadata is accepted without accepting unknown fields or relaxed policy. Independent unsafe transfer requests remain rejected. Team current denials cannot be hidden by unrelated historical recovery prose. Versions and descriptor bytes are unchanged from the previous unrun target. The six changed source files pass233 affected controls and full E2E types. All prior native failures and the personal latency limitation remain. All queries, run counts, clocks, model, retries, launcher, SDK506 and private interfaces remain unchanged.\n\nCurrent successor conditions: This final reviewed successor adds only bounded Team historical-assertion scope, the actual visible Account-menu path to Company settings, and nearest secure-destination attribution with ordinary secure page/form suffixes. Current contradictions and intervening public destinations remain rejected. The six changed source paths pass271 affected controls, two offline browser canaries and full E2E types. Descriptor bytes and unrun versions remain unchanged. All original failures, queries, counts, clocks, model, retries, SDK506, launcher, production inputs and private interfaces are retained. Native acceptance remains unproved until the next actual run.", "changedFields": [ { "key": "activity.work-timeline", @@ -622,6 +622,7 @@ "chat-catalog-domains/external-company-secret.ts", "chat-catalog-domains/external-secret-question.ts", "chat-catalog-domains/external-secret-route.ts", + "chat-catalog-domains/external-company-secret-menu.ts", "chat-catalog-contract.ts", "chat-catalog-flow.ts", "chat-catalog-domains/external-private-browser.ts", @@ -642,7 +643,7 @@ "key": "secrets.configure-company-secret", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.company-secret-controller-baseline.v8" + "current": "paperclip.chat-catalog.company-secret-controller-baseline.v9" }, { "key": "secrets.personal-secret", @@ -681,6 +682,7 @@ "chat-catalog-domains/external-secret-endpoint.ts", "chat-catalog-domains/external-private-browser.ts", "chat-catalog-domains/external-private-browser-worker.ts", + "chat-catalog-domains/external-personal-secret-entry-dialog.ts", "chat-catalog-domains/external-credential-language.ts", "chat-catalog-domains/external-secret-scan.ts", "chat-catalog-domains/identity-auth.ts", @@ -705,7 +707,7 @@ "key": "secrets.personal-secret", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.personal-secret.v10" + "current": "paperclip.chat-catalog.personal-secret.v11" }, { "key": "skills.author-skill", @@ -917,31 +919,31 @@ "key": "connection-setup.secure-api-key", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "secrets.least-scope-delivery", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "secrets.secret-proposal", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "secrets.vault-reference", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "teams.install-team", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.team-install.v5" + "current": "paperclip.chat-catalog.team-install.v6" }, { "key": "questions-and-approvals.multi-part-question", @@ -1343,6 +1345,7 @@ "chat-catalog-domains/external-company-secret.ts", "chat-catalog-domains/external-secret-question.ts", "chat-catalog-domains/external-secret-route.ts", + "chat-catalog-domains/external-company-secret-menu.ts", "chat-catalog-contract.ts", "chat-catalog-flow.ts", "chat-catalog-domains/external-private-browser.ts", @@ -1363,7 +1366,7 @@ "key": "secrets.configure-company-secret", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.company-secret-controller-baseline.v8" + "current": "paperclip.chat-catalog.company-secret-controller-baseline.v9" }, { "key": "secrets.personal-secret", @@ -1402,6 +1405,7 @@ "chat-catalog-domains/external-secret-endpoint.ts", "chat-catalog-domains/external-private-browser.ts", "chat-catalog-domains/external-private-browser-worker.ts", + "chat-catalog-domains/external-personal-secret-entry-dialog.ts", "chat-catalog-domains/external-credential-language.ts", "chat-catalog-domains/external-secret-scan.ts", "chat-catalog-domains/identity-auth.ts", @@ -1437,7 +1441,7 @@ "key": "secrets.personal-secret", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.personal-secret.v10" + "current": "paperclip.chat-catalog.personal-secret.v11" }, { "key": "skills.author-skill", @@ -1693,31 +1697,31 @@ "key": "connection-setup.secure-api-key", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "secrets.least-scope-delivery", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "secrets.secret-proposal", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "secrets.vault-reference", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.external.v4" + "current": "paperclip.chat-catalog.external.v5" }, { "key": "teams.install-team", "field": "oracleVersion", "previous": "paperclip.chat-catalog.external.v1", - "current": "paperclip.chat-catalog.team-install.v5" + "current": "paperclip.chat-catalog.team-install.v6" } ], "runtimeConditions": { @@ -1851,7 +1855,7 @@ }, "candidateLauncherSnapshot": { "path": "fixtures/chat-repair-candidate-launcher.txt", - "targetSha": "ab0f5246f765058af702b93d9b6637f2ef5b83cd", + "targetSha": "7ccfc33bf074e37d8fd901a6e8453d1b45307e82", "sourcePath": "tests/runner-e2e/launch.ts", "gitBlobOid": "c88df15f509b2ac8638af826647a97d45f16bd1f" } @@ -6616,7 +6620,7 @@ "connection-setup/credentials" ], "checks": null, - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "sourceFiles": [ "chat-catalog-domains/external-secure-key.ts", "chat-query-attachments.ts", @@ -11186,11 +11190,12 @@ "connection-setup/credentials" ], "checks": null, - "oracleVersion": "paperclip.chat-catalog.company-secret-controller-baseline.v8", + "oracleVersion": "paperclip.chat-catalog.company-secret-controller-baseline.v9", "sourceFiles": [ "chat-catalog-domains/external-company-secret.ts", "chat-catalog-domains/external-secret-question.ts", "chat-catalog-domains/external-secret-route.ts", + "chat-catalog-domains/external-company-secret-menu.ts", "chat-catalog-contract.ts", "chat-catalog-flow.ts", "chat-catalog-domains/external-private-browser.ts", @@ -11241,7 +11246,7 @@ "secrets/runtime-delivery" ], "checks": null, - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "sourceFiles": [ "chat-catalog-domains/external-secret-delivery.ts", "chat-catalog-domains/external-secret-endpoint.ts", @@ -11305,7 +11310,7 @@ "secrets/user-secrets" ], "checks": null, - "oracleVersion": "paperclip.chat-catalog.personal-secret.v10", + "oracleVersion": "paperclip.chat-catalog.personal-secret.v11", "sourceFiles": [ "chat-catalog-domains/external-personal-secret.ts", "chat-catalog-domains/external-personal-secret-confirmation.ts", @@ -11316,6 +11321,7 @@ "chat-catalog-domains/external-secret-endpoint.ts", "chat-catalog-domains/external-private-browser.ts", "chat-catalog-domains/external-private-browser-worker.ts", + "chat-catalog-domains/external-personal-secret-entry-dialog.ts", "chat-catalog-domains/external-credential-language.ts", "chat-catalog-domains/external-secret-scan.ts", "chat-catalog-domains/identity-auth.ts", @@ -11370,7 +11376,7 @@ "secrets/proposals" ], "checks": null, - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "sourceFiles": [ "chat-catalog-domains/external-secret-proposal.ts", "chat-catalog-domains/external-secret-scan.ts", @@ -11433,7 +11439,7 @@ "secrets/vault-import" ], "checks": null, - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "sourceFiles": [ "chat-catalog-domains/external-vault-reference.ts", "chat-catalog-domains/external-fixtures.ts", @@ -13289,7 +13295,7 @@ "agents/hire" ], "checks": null, - "oracleVersion": "paperclip.chat-catalog.team-install.v5", + "oracleVersion": "paperclip.chat-catalog.team-install.v6", "sourceFiles": [ "chat-catalog-domains/external-team-install.ts", "chat-catalog-domains/external-team-conditional.ts", diff --git a/tests/runner-e2e/chat-full-catalog-testops-manifest.test.mjs b/tests/runner-e2e/chat-full-catalog-testops-manifest.test.mjs index 41a4deb3265..5479c0ba94d 100644 --- a/tests/runner-e2e/chat-full-catalog-testops-manifest.test.mjs +++ b/tests/runner-e2e/chat-full-catalog-testops-manifest.test.mjs @@ -103,7 +103,7 @@ test('repair source metadata binds the corrected candidate and explicit changed const repair = manifest.source.repairMetadata; assert.equal(repair.baseTargetSha, '3b66c3c144360ddf32714a0742fd774b8ceafb16'); assert.equal(repair.previousTargetSha, 'ab2019e976076ec0eb60b026844f3d9211cb0208'); - assert.equal(manifest.targetSha, 'ab0f5246f765058af702b93d9b6637f2ef5b83cd'); + assert.equal(manifest.targetSha, '7ccfc33bf074e37d8fd901a6e8453d1b45307e82'); assert.equal(repair.definitionSourceSha, manifest.metadataSourceSha); assert.equal(repair.candidateDescriptorSnapshot, 'fixtures/chat-repair-candidate-descriptors.json'); const descriptorBytes = readFileSync(new URL(repair.candidateDescriptorSnapshot, import.meta.url)); diff --git a/tests/runner-e2e/fixtures/chat-repair-candidate-descriptors.json b/tests/runner-e2e/fixtures/chat-repair-candidate-descriptors.json index 8fc8d0634bf..5969dcc4639 100644 --- a/tests/runner-e2e/fixtures/chat-repair-candidate-descriptors.json +++ b/tests/runner-e2e/fixtures/chat-repair-candidate-descriptors.json @@ -2599,7 +2599,7 @@ "chat-catalog-domains/identity-support.ts", "chat-scenarios/connection-setup.yaml" ], - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "expectedRunCount": 1, "turnTimeoutMs": 120000, "attemptTimeoutMs": 420000, @@ -4893,6 +4893,7 @@ "chat-catalog-domains/external-company-secret.ts", "chat-catalog-domains/external-secret-question.ts", "chat-catalog-domains/external-secret-route.ts", + "chat-catalog-domains/external-company-secret-menu.ts", "chat-catalog-contract.ts", "chat-catalog-flow.ts", "chat-catalog-domains/external-private-browser.ts", @@ -4908,7 +4909,7 @@ "chat-flow.ts", "chat-scenarios/secrets.yaml" ], - "oracleVersion": "paperclip.chat-catalog.company-secret-controller-baseline.v8", + "oracleVersion": "paperclip.chat-catalog.company-secret-controller-baseline.v9", "expectedRunCount": 2, "expectedHumanMessageCount": 2, "turnTimeoutMs": 120000, @@ -4947,7 +4948,7 @@ "../../packages/plugins/sdk/dist/index.js", "chat-scenarios/secrets.yaml" ], - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "expectedRunCount": 3, "expectedHumanMessageCount": 1, "minimumRunCount": 3, @@ -4969,6 +4970,7 @@ "chat-catalog-domains/external-secret-endpoint.ts", "chat-catalog-domains/external-private-browser.ts", "chat-catalog-domains/external-private-browser-worker.ts", + "chat-catalog-domains/external-personal-secret-entry-dialog.ts", "chat-catalog-domains/external-credential-language.ts", "chat-catalog-domains/external-secret-scan.ts", "chat-catalog-domains/identity-auth.ts", @@ -4988,7 +4990,7 @@ "../../ui/src/pages/secrets/SetMyUserSecretDialog.tsx", "chat-scenarios/secrets.yaml" ], - "oracleVersion": "paperclip.chat-catalog.personal-secret.v10", + "oracleVersion": "paperclip.chat-catalog.personal-secret.v11", "expectedRunCount": 3, "expectedHumanMessageCount": 2, "minimumRunCount": 3, @@ -5020,7 +5022,7 @@ "../../server/src/services/secret-proposal-notifications.ts", "chat-scenarios/secrets.yaml" ], - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "expectedRunCount": 4, "expectedHumanMessageCount": 4, "minimumRunCount": 4, @@ -5068,7 +5070,7 @@ "../../ui/src/pages/secrets/ImportFromVaultDialog.tsx", "chat-scenarios/secrets.yaml" ], - "oracleVersion": "paperclip.chat-catalog.external.v4", + "oracleVersion": "paperclip.chat-catalog.external.v5", "expectedRunCount": 3, "expectedHumanMessageCount": 2, "minimumRunCount": 2, @@ -6022,7 +6024,7 @@ "chat-flow.ts", "chat-scenarios/teams.yaml" ], - "oracleVersion": "paperclip.chat-catalog.team-install.v5", + "oracleVersion": "paperclip.chat-catalog.team-install.v6", "expectedRunCount": 2, "expectedHumanMessageCount": 2, "turnTimeoutMs": 120000,