mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-11-04 19:28:46 +01:00
Reconcile frozen catalog and retain first 43 measurements
This commit is contained in:
Dotta committed
1 parent
f457fa84b0
commit
ccf69b1743
3 files changed
+1603
-114
No files matched your search
@@ -4,13 +4,14 @@ Updated: 2026-10-27. This is the single progress record for [the saved goal](202
|
||||
|
||||
## Current state
|
||||
|
||||
- **244 scenarios / 35 areas / 191 capabilities**, frozen inventory digest `9dc9cf6a5426cf1b56bc30a3571851f233f9dd5e93a1292eaee414d33b52df77`. All original queries, contexts and expected outcomes remain unchanged. **196 passes required**; blocked, partial, unsupported and unrun remain in the denominator.
|
||||
- **229 authored: 220 without declared coverage gaps, 9 partial, 15 unimplemented** at exact committed-source metadata checkpoint `32b472dfa5640987e199c2e0aa21b2c7c02555c6`. There are 227 concrete lazy descriptors plus two legacy task cases. Actual callbacks, bounds, policies and source dependencies were reconciled from this one Git archive; newer area work remains pending. These are authoring counts, not acceptance.
|
||||
- Five partial definitions contain concrete executable supported-surface/context blocker probes: two access grants, subscription provenance, skill-use authority/context and genuine prior-day routine history. Four have unfinished required branches: the Grok origin integration closure, named ChatGPT setup, team installer failures and private-repository after-grant completion. **225 authoring-resolved; 4 unfinished; 15 absent.** Only actual reserved execution can process a concrete blocker; offline probes/calibrations do not establish processing. Incomplete conditions cannot pass.
|
||||
- **27 scenarios admitted; 28 launched measurements; 27 terminal measurements; 4 real first-attempt passes, pending final current-identity eligibility.** Running at this checkpoint: `projects.project-defaults`. Original failures remain unchanged; goal-tree exhausted and all final-B retries held.
|
||||
- **The approved unaffected11 batch completed; the next24 independent initials are running sequentially from qualified immutable6be**, maxParallel1/retries0. The original next25 selection excludes `projects.project-work` before reservation because its exact-same-title fixture reproduces the known public creation deduplication alias. Initial passes: create-backlog, delegate-announcement, rename-company and list-model-options; all retain their measured identities and remain provisional until final current-closure verification. Profile and quick-search remain unreserved/quarantined because their selected setup accepts invitations; other selected callbacks do not execute that credential-bearing route. No scanner exception or test logging adapter was added. Separate isolated core fixes are manager-owned; measured product baseline remains8373.
|
||||
- Current recovery: semaphore cleanup approval is still pending and no set has been removed. Read-only discovery verified an already running local Docker Linux/arm64 engine; the explicit owned PostgreSQL18.6 lane is qualified. Its one infrastructure-only health check at `772c29dad9` failed before container start because Docker Desktop represents the exact host password bind with `/host_mnt`; no Paperclip, native or model work began. The initial failed cleanup receipt is preserved; separate authorized cleanup verified exact container/volume absence and removed only its password. The separately authorized corrected infrastructure-only health at `325af67e3d` passed PostgreSQL18.6, normal onboarding/migrations/API and zero work; exact owned resources were removed with no cleanup failures. The Docker lane is qualified; host IPC cleanup is no longer required. AgentMail/GitHub read-only discovery is authorized/completed; designated self-email and repository choices remain pending.
|
||||
- Production baseline `8373d7867963674ff960d2345d0d28086f799bc7`; branch `codex/chat-catalog-evals`. PR #17794 merged via `2ee36a4`. No eval PR has been created. Separate unmerged core fixes are [invite URL logging #17848](https://github.com/paperclipai/paperclip/pull/17848) and [doctor DATABASE_URL handling #17847](https://github.com/paperclipai/paperclip/pull/17847); neither changes the measured8373 baseline. No merge is eligible.
|
||||
- **Frozen inventory:244 scenarios /35areas /191capabilities;196 eligible passes required.** Inventory digest `9dc9cf6a5426cf1b56bc30a3571851f233f9dd5e93a1292eaee414d33b52df77`. Original queries, contexts and outcomes remain unchanged; blocked, partial and unrun cases stay in the denominator.
|
||||
- **All244 callbacks authored** at closed metadata source `406eb610dd95604079838220f29fb765977a8910`:235 without declared gaps,9 partial,0 absent (242 lazy definitions +2 legacy). **241 authoring-resolved:**235 complete and6 concrete executable blocker probes. **3 unfinished:**named ChatGPT setup, private GitHub after-grant completion and Grok operator closure. Grok's later area-only `f457fa84b0` completion is queued for the next metadata checkpoint, not silently mixed into this archive. Source-only controls are not live acceptance.
|
||||
- **42 scenarios processed /43 completed measurements:8 initial passes and35 failures;0 running;0 final eligible passes.** Actual retained native usage:17,478,933 tokens; subscription dollars remain unpriced. The latest24-case batch finished5passed/19failed, with verified cleanup and exact Docker removal for all24. The authoritative closed summary is `tests/runner-e2e/results/chat-catalog-campaign/closed-initial-checkpoint-42-43.json`. Two older cleanup uncertainties remain unresolved; later partial PID/container absence evidence does not rewrite them.
|
||||
- **Single coherent final-B retry set remains held.** Goal-tree exhausted its two measurements. Every original failure/result/digest is preserved. Eight real initial passes retain their proof but need final current-closure eligibility review. First-failure triage (34 first failures; goal-tree's extra final failure excluded):setup/fixture11, locator/oracle9, harness/startup4, native execution2, unsupported context1, model output1, unknown/untriaged6. Setup-stage uncertainty and native timeouts are not assumed product/vendor defects.
|
||||
- **Next30 initial-only proposal ready for manager review**, immutable source `efbbb88a70dc6bcd0e6893702d8a482e46753fdf`, baseline8373, maxParallel1/retries0,38 declared native runs/32 source-chat human turns. Source archive typecheck and84 focused controls passed; actual list244, all30 fingerprints have narrow closures and replay after private-file cleanup is unnecessary/null identity verified. Five broad CLI/plugin closures are explicitly deferred because they include unrelated eval source. No next-batch reservation has been made. Known invitation-acceptance and same-title-alias fixtures remain quarantined/unreserved.
|
||||
- **Infrastructure is qualified:**owned local Docker PostgreSQL18.6 at the pinned installed image, normal onboarding/migrations/API and final persisted-state scan passed with zero model/native/scenario work; exact resources removed. No further infrastructure health is needed for the unchanged lane. The proposed host SysV cleanup was never performed and is no longer needed. Source/build/native bytes remain bound to production baseline `8373d7867963674ff960d2345d0d28086f799bc7`; no core candidate is used as benchmark proof.
|
||||
- **Separate core PRs remain OPEN/unmerged, auto-merge off.** Manager's fresh checkpoint: [doctor #17847](https://github.com/paperclipai/paperclip/pull/17847), head `a042fb4a28f2e1574972798ed80de2e616daf9fc`; [invite URL logging #17848](https://github.com/paperclipai/paperclip/pull/17848), head `98a2432f88c33afacff2e014bd8c30630b26b339`. Both53checks successful, only verify/e2e pending,0 failures; Greptile5/5 and0 unresolved threads at those heads. They do not change this campaign's measured baseline. No eval PR or merge is eligible.
|
||||
- **Genuine missing inputs:**AgentMail/GitHub read-only discovery was authorized and completed; designated self-mail/recipient and repository choices remain pending. Standard provider-key source references exist, but validity and disposable remote/operator targets remain unqualified. No provider send, remote setup or account discovery is implied by authoring coverage.
|
||||
|
||||
## Current measured continuation and held corrections
|
||||
|
||||
|
||||
File diff suppressed because it is too large.
Load diff
@@ -526,7 +526,10 @@
|
||||
"botId",
|
||||
"endpoint",
|
||||
"challengeMethod",
|
||||
"credentialEnvName"
|
||||
"credentialEnvName",
|
||||
"operatorRef",
|
||||
"botAuthorizationRef",
|
||||
"operatorMode"
|
||||
]
|
||||
},
|
||||
"scenarioId": "agents.existing-grok-bot",
|
||||
@@ -709,7 +712,9 @@
|
||||
"chat-scenarios/agents.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.runtime.v2",
|
||||
"coverageGaps": [],
|
||||
"coverageGaps": [
|
||||
"supported-two-visible-instruction-history-versions"
|
||||
],
|
||||
"expectedRunCount": 1,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 300000,
|
||||
@@ -1410,6 +1415,157 @@
|
||||
"modulePath": "./chat-catalog-domains/external-slack-file.js",
|
||||
"exportName": "slackFileExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "slack",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"channelId",
|
||||
"senderUserId",
|
||||
"botUserId",
|
||||
"appId",
|
||||
"registeredWebhookOrigin",
|
||||
"webhookRelayPort",
|
||||
"botTokenEnv",
|
||||
"senderTokenEnv",
|
||||
"signingSecretEnv",
|
||||
"configurationTokenEnv",
|
||||
"slackBrowserSessionEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "chat-channels.connect-slack",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-slack-setup.ts",
|
||||
"chat-catalog-domains/external-slack-fixture.ts",
|
||||
"chat-catalog-domains/external-slack-provider.ts",
|
||||
"chat-catalog-domains/external-slack-relay.ts",
|
||||
"chat-catalog-domains/external-slack-human.ts",
|
||||
"chat-catalog-domains/external-slack-human-worker.ts",
|
||||
"chat-catalog-domains/external-slack-human-contract.ts",
|
||||
"chat-catalog-domains/external-private-browser.ts",
|
||||
"chat-catalog-domains/external-private-browser-worker.ts",
|
||||
"chat-catalog-domains/external-slack-setup-private-contract.ts",
|
||||
"chat-catalog-domains/external-slack-identity-contract.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-catalog-domains/identity-support.ts",
|
||||
"chat-slack-ingress.ts",
|
||||
"../../ui/src/pages/apps/chat/ChatEndpointSetup.tsx",
|
||||
"../../ui/src/pages/apps/chat/SlackIdentityStep.tsx",
|
||||
"../../ui/src/pages/apps/chat/slack/OwnSlackAppSetup.tsx",
|
||||
"../../server/src/services/chat-channels/setup-probes.ts",
|
||||
"../../server/src/services/chat-channels/slack/commands.ts",
|
||||
"../../server/src/services/chat-channels/slack/identity-links.ts",
|
||||
"../../server/src/services/chat-channels/identity-links.ts",
|
||||
"../../server/src/services/chat-channels.ts",
|
||||
"chat-scenarios/chat-channels.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 3,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"minimumRunCount": 3,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 900000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-slack-setup.js",
|
||||
"exportName": "slackSetupExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "slack",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"channelId",
|
||||
"senderUserId",
|
||||
"botUserId",
|
||||
"appId",
|
||||
"registeredWebhookOrigin",
|
||||
"webhookRelayPort",
|
||||
"botTokenEnv",
|
||||
"senderTokenEnv",
|
||||
"signingSecretEnv",
|
||||
"configurationTokenEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "chat-channels.link-sender",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-slack-identity.ts",
|
||||
"chat-catalog-domains/external-slack-fixture.ts",
|
||||
"chat-catalog-domains/external-slack-provider.ts",
|
||||
"chat-catalog-domains/external-slack-relay.ts",
|
||||
"chat-catalog-domains/external-slack-identity-contract.ts",
|
||||
"chat-catalog-domains/external-private-browser.ts",
|
||||
"chat-catalog-domains/external-private-browser-worker.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-catalog-domains/identity-support.ts",
|
||||
"../../server/src/routes/chat-channels.ts",
|
||||
"../../server/src/services/chat-channels/setup-probes.ts",
|
||||
"../../server/src/services/chat-channels/identity-links.ts",
|
||||
"../../server/src/services/chat-channels/inbound/authorization.ts",
|
||||
"../../server/src/services/chat-channels.ts",
|
||||
"../../server/src/services/chat-channels/activity.ts",
|
||||
"../../ui/src/pages/apps/chat/ChatEndpointDetail.tsx",
|
||||
"../../ui/src/pages/apps/chat/ChatIdentityConfirm.tsx",
|
||||
"chat-slack-ingress.ts",
|
||||
"chat-scenarios/chat-channels.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 3,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"minimumRunCount": 3,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 720000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-slack-identity.js",
|
||||
"exportName": "slackIdentityExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "agentmail",
|
||||
"fields": [
|
||||
"inboxId",
|
||||
"recipient",
|
||||
"recipientAuthorization",
|
||||
"apiTokenEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "chat-channels.outbound-email",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/runtime-email-outbound.ts",
|
||||
"chat-catalog-domains/runtime-email.ts",
|
||||
"chat-catalog-domains/runtime-email-private.ts",
|
||||
"chat-catalog-domains/runtime-email-private-worker.ts",
|
||||
"chat-catalog-domains/runtime-email-duplicate.ts",
|
||||
"chat-catalog-domains/runtime-email-fault.ts",
|
||||
"server-entry.ts",
|
||||
"chat-query-bindings.ts",
|
||||
"../../server/src/services/email-channels.ts",
|
||||
"../../server/src/services/agentmail-api.ts",
|
||||
"../../server/src/services/connectors/agentmail.ts",
|
||||
"chat-scenarios/chat-channels.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.runtime.v2",
|
||||
"coverageGaps": [],
|
||||
"expectedRunCount": 5,
|
||||
"setupHumanMessageCount": 1,
|
||||
"expectedHumanMessageCount": 3,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 1020000,
|
||||
"authentication": "human-session",
|
||||
"queryBindings": [
|
||||
{
|
||||
"catalogToken": "reviewer@example.test",
|
||||
"stateKey": "emailRecipient",
|
||||
"resourceKind": "agentmail-recipient",
|
||||
"valueField": "email"
|
||||
}
|
||||
],
|
||||
"modulePath": "./chat-catalog-domains/runtime-email-outbound.js",
|
||||
"exportName": "runtimeOutboundEmailCases"
|
||||
},
|
||||
{
|
||||
"scenarioId": "chat-channels.provider-disabled",
|
||||
"sourceFiles": [
|
||||
@@ -1426,6 +1582,63 @@
|
||||
"modulePath": "./chat-catalog-domains/external-chat-channels.js",
|
||||
"exportName": "chatChannelExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "slack",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"channelId",
|
||||
"senderUserId",
|
||||
"botUserId",
|
||||
"appId",
|
||||
"registeredWebhookOrigin",
|
||||
"webhookRelayPort",
|
||||
"botTokenEnv",
|
||||
"senderTokenEnv",
|
||||
"signingSecretEnv",
|
||||
"configurationTokenEnv",
|
||||
"slackBrowserSessionEnv",
|
||||
"botTokenExpiresAt",
|
||||
"repairBotTokenEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "chat-channels.repair-endpoint",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-slack-repair.ts",
|
||||
"chat-catalog-domains/external-slack-authorization.ts",
|
||||
"chat-catalog-domains/external-slack-fixture.ts",
|
||||
"chat-catalog-domains/external-slack-provider.ts",
|
||||
"chat-catalog-domains/external-slack-relay.ts",
|
||||
"chat-catalog-domains/external-slack-human.ts",
|
||||
"chat-catalog-domains/external-slack-human-worker.ts",
|
||||
"chat-catalog-domains/external-slack-human-contract.ts",
|
||||
"chat-catalog-domains/external-private-browser.ts",
|
||||
"chat-catalog-domains/external-private-browser-worker.ts",
|
||||
"chat-catalog-domains/external-slack-setup-private-contract.ts",
|
||||
"chat-catalog-domains/external-slack-identity-contract.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-catalog-domains/identity-support.ts",
|
||||
"chat-slack-ingress.ts",
|
||||
"../../ui/src/pages/apps/chat/ChatEndpointSetup.tsx",
|
||||
"../../ui/src/pages/apps/chat/SlackIdentityStep.tsx",
|
||||
"../../server/src/services/chat-channels/configuration.ts",
|
||||
"../../server/src/services/chat-channels/slack/credentials.ts",
|
||||
"../../server/src/services/chat-channels/slack/commands.ts",
|
||||
"../../server/src/services/chat-channels.ts",
|
||||
"chat-scenarios/chat-channels.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 3,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"minimumRunCount": 3,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 1500000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-slack-repair.js",
|
||||
"exportName": "slackRepairExternalCases"
|
||||
},
|
||||
{
|
||||
"slackIngress": {
|
||||
"kind": "native-slack-thread",
|
||||
@@ -1480,6 +1693,46 @@
|
||||
"modulePath": "./chat-catalog-domains/external-slack-thread.js",
|
||||
"exportName": "slackThreadExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "agentmail",
|
||||
"fields": [
|
||||
"inboxId",
|
||||
"recipient",
|
||||
"recipientAuthorization",
|
||||
"apiTokenEnv",
|
||||
"reviewerAddress",
|
||||
"reviewerAuthorization",
|
||||
"senderCredentialEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "chat-channels.reply-to-email",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/runtime-email-reply.ts",
|
||||
"chat-catalog-domains/runtime-email.ts",
|
||||
"chat-catalog-domains/runtime-email-outbound.ts",
|
||||
"chat-catalog-domains/runtime-email-private.ts",
|
||||
"chat-catalog-domains/runtime-email-private-worker.ts",
|
||||
"chat-catalog-domains/runtime-email-fault.ts",
|
||||
"chat-catalog-domains/runtime-email-duplicate.ts",
|
||||
"server-entry.ts",
|
||||
"../../server/src/services/email-channels.ts",
|
||||
"../../server/src/services/agentmail-api.ts",
|
||||
"../../server/src/services/connectors/agentmail.ts",
|
||||
"chat-scenarios/chat-channels.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.runtime.v2",
|
||||
"coverageGaps": [],
|
||||
"expectedRunCount": 9,
|
||||
"setupHumanMessageCount": 1,
|
||||
"expectedHumanMessageCount": 4,
|
||||
"minimumRunCount": 6,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 1500000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/runtime-email-reply.js",
|
||||
"exportName": "runtimeReplyEmailCases"
|
||||
},
|
||||
{
|
||||
"scenarioId": "cli-operations.choose-cli-context",
|
||||
"sourceFiles": [
|
||||
@@ -1775,6 +2028,62 @@
|
||||
"modulePath": "./chat-catalog-domains/identity-company-lifecycle.js",
|
||||
"exportName": "companyLifecycleIdentityCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "slack",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"channelId",
|
||||
"senderUserId",
|
||||
"botUserId",
|
||||
"appId",
|
||||
"registeredWebhookOrigin",
|
||||
"webhookRelayPort",
|
||||
"botTokenEnv",
|
||||
"senderTokenEnv",
|
||||
"signingSecretEnv",
|
||||
"configurationTokenEnv",
|
||||
"slackBrowserSessionEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "connection-setup.channel-prerequisites",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-slack-setup.ts",
|
||||
"chat-catalog-domains/external-slack-fixture.ts",
|
||||
"chat-catalog-domains/external-slack-provider.ts",
|
||||
"chat-catalog-domains/external-slack-relay.ts",
|
||||
"chat-catalog-domains/external-slack-human.ts",
|
||||
"chat-catalog-domains/external-slack-human-worker.ts",
|
||||
"chat-catalog-domains/external-slack-human-contract.ts",
|
||||
"chat-catalog-domains/external-private-browser.ts",
|
||||
"chat-catalog-domains/external-private-browser-worker.ts",
|
||||
"chat-catalog-domains/external-slack-setup-private-contract.ts",
|
||||
"chat-catalog-domains/external-slack-identity-contract.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-catalog-domains/identity-support.ts",
|
||||
"chat-slack-ingress.ts",
|
||||
"../../ui/src/pages/apps/chat/ChatEndpointSetup.tsx",
|
||||
"../../ui/src/pages/apps/chat/SlackIdentityStep.tsx",
|
||||
"../../ui/src/pages/apps/chat/slack/OwnSlackAppSetup.tsx",
|
||||
"../../server/src/services/chat-channels/setup-probes.ts",
|
||||
"../../server/src/services/chat-channels/slack/commands.ts",
|
||||
"../../server/src/services/chat-channels/slack/identity-links.ts",
|
||||
"../../server/src/services/chat-channels/identity-links.ts",
|
||||
"../../server/src/services/chat-channels.ts",
|
||||
"chat-scenarios/connection-setup.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 3,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"minimumRunCount": 3,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 900000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-slack-setup.js",
|
||||
"exportName": "slackSetupExternalCases"
|
||||
},
|
||||
{
|
||||
"scenarioId": "connection-setup.choose-provider",
|
||||
"sourceFiles": [
|
||||
@@ -1885,6 +2194,281 @@
|
||||
"modulePath": "./chat-catalog-domains/external-connection-setup.js",
|
||||
"exportName": "connectionSetupExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "notion",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"workspaceName",
|
||||
"recentPageId",
|
||||
"olderPageId",
|
||||
"mcpUrl",
|
||||
"apiVersion",
|
||||
"apiTokenEnv",
|
||||
"recentMarker",
|
||||
"olderMarker",
|
||||
"recentFactJson",
|
||||
"olderFactJson",
|
||||
"oauthBrowserSessionEnv",
|
||||
"oauthHumanEmailEnv",
|
||||
"expiredAuthorizationEnv",
|
||||
"authorizationExpiresAt",
|
||||
"authorizationFailureKind"
|
||||
]
|
||||
},
|
||||
"scenarioId": "connection-setup.notion-expired",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-notion-setup.ts",
|
||||
"chat-catalog-domains/external-notion-oauth.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-worker.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-contract.ts",
|
||||
"chat-catalog-domains/external-notion-provider.ts",
|
||||
"chat-catalog-domains/external-notion-semantics.ts",
|
||||
"chat-catalog-domains/external-public-signin.ts",
|
||||
"chat-catalog-domains/external-public-signin-worker.ts",
|
||||
"chat-catalog-domains/external-public-signin-contract.ts",
|
||||
"public-mcp-flow.ts",
|
||||
"chat-public-origin.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-scenarios/connection-setup.yaml",
|
||||
"../../ui/src/features/connections/ConnectionSetupFlow.tsx",
|
||||
"../../ui/src/features/connections/ConnectionIntentInteractionBody.tsx",
|
||||
"../../server/src/routes/tool-access.ts",
|
||||
"../../server/src/services/tool-access/oauth/direct-callback.ts",
|
||||
"../../scripts/smoke/notion-generic-live.mjs",
|
||||
"chat-catalog-domains/external-notion-expired.ts",
|
||||
"chat-catalog-domains/external-notion-expiry.ts",
|
||||
"chat-catalog-domains/identity-support.ts",
|
||||
"chat-flow.ts",
|
||||
"../../server/src/services/tool-access.ts"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 4,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"minimumRunCount": 4,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 1500000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-notion-expired.js",
|
||||
"exportName": "notionExpiredExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "notion",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"workspaceName",
|
||||
"recentPageId",
|
||||
"olderPageId",
|
||||
"mcpUrl",
|
||||
"apiVersion",
|
||||
"apiTokenEnv",
|
||||
"recentMarker",
|
||||
"olderMarker",
|
||||
"recentFactJson",
|
||||
"olderFactJson",
|
||||
"oauthBrowserSessionEnv",
|
||||
"oauthHumanEmailEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "connection-setup.notion-missing",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-notion-setup.ts",
|
||||
"chat-catalog-domains/external-notion-oauth.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-worker.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-contract.ts",
|
||||
"chat-catalog-domains/external-notion-provider.ts",
|
||||
"chat-catalog-domains/external-notion-semantics.ts",
|
||||
"chat-catalog-domains/external-public-signin.ts",
|
||||
"chat-catalog-domains/external-public-signin-worker.ts",
|
||||
"chat-catalog-domains/external-public-signin-contract.ts",
|
||||
"public-mcp-flow.ts",
|
||||
"chat-public-origin.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-scenarios/connection-setup.yaml",
|
||||
"../../ui/src/features/connections/ConnectionSetupFlow.tsx",
|
||||
"../../ui/src/features/connections/ConnectionIntentInteractionBody.tsx",
|
||||
"../../server/src/routes/tool-access.ts",
|
||||
"../../server/src/services/tool-access/oauth/direct-callback.ts",
|
||||
"../../scripts/smoke/notion-generic-live.mjs",
|
||||
"chat-catalog-domains/identity-support.ts"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 2,
|
||||
"expectedHumanMessageCount": 1,
|
||||
"minimumRunCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 900000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-notion-setup.js",
|
||||
"exportName": "notionSetupExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "notion",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"workspaceName",
|
||||
"recentPageId",
|
||||
"olderPageId",
|
||||
"mcpUrl",
|
||||
"apiVersion",
|
||||
"apiTokenEnv",
|
||||
"recentMarker",
|
||||
"olderMarker",
|
||||
"recentFactJson",
|
||||
"olderFactJson",
|
||||
"oauthBrowserSessionEnv",
|
||||
"oauthHumanEmailEnv",
|
||||
"sharedWorkspaceId",
|
||||
"sharedApiTokenEnv",
|
||||
"sharedMcpTokenEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "connection-setup.notion-wrong-account",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-notion-setup.ts",
|
||||
"chat-catalog-domains/external-notion-oauth.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-worker.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-contract.ts",
|
||||
"chat-catalog-domains/external-notion-provider.ts",
|
||||
"chat-catalog-domains/external-notion-semantics.ts",
|
||||
"chat-catalog-domains/external-public-signin.ts",
|
||||
"chat-catalog-domains/external-public-signin-worker.ts",
|
||||
"chat-catalog-domains/external-public-signin-contract.ts",
|
||||
"public-mcp-flow.ts",
|
||||
"chat-public-origin.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-scenarios/connection-setup.yaml",
|
||||
"../../ui/src/features/connections/ConnectionSetupFlow.tsx",
|
||||
"../../ui/src/features/connections/ConnectionIntentInteractionBody.tsx",
|
||||
"../../server/src/routes/tool-access.ts",
|
||||
"../../server/src/services/tool-access/oauth/direct-callback.ts",
|
||||
"../../scripts/smoke/notion-generic-live.mjs",
|
||||
"chat-catalog-domains/identity-support.ts"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 2,
|
||||
"expectedHumanMessageCount": 1,
|
||||
"minimumRunCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 900000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-notion-setup.js",
|
||||
"exportName": "notionSetupExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "notion",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"workspaceName",
|
||||
"recentPageId",
|
||||
"olderPageId",
|
||||
"mcpUrl",
|
||||
"apiVersion",
|
||||
"apiTokenEnv",
|
||||
"recentMarker",
|
||||
"olderMarker",
|
||||
"recentFactJson",
|
||||
"olderFactJson",
|
||||
"oauthBrowserSessionEnv",
|
||||
"oauthHumanEmailEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "connection-setup.return-from-login",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-notion-setup.ts",
|
||||
"chat-catalog-domains/external-notion-oauth.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-worker.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-contract.ts",
|
||||
"chat-catalog-domains/external-notion-provider.ts",
|
||||
"chat-catalog-domains/external-notion-semantics.ts",
|
||||
"chat-catalog-domains/external-public-signin.ts",
|
||||
"chat-catalog-domains/external-public-signin-worker.ts",
|
||||
"chat-catalog-domains/external-public-signin-contract.ts",
|
||||
"public-mcp-flow.ts",
|
||||
"chat-public-origin.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-scenarios/connection-setup.yaml",
|
||||
"../../ui/src/features/connections/ConnectionSetupFlow.tsx",
|
||||
"../../ui/src/features/connections/ConnectionIntentInteractionBody.tsx",
|
||||
"../../server/src/routes/tool-access.ts",
|
||||
"../../server/src/services/tool-access/oauth/direct-callback.ts",
|
||||
"../../scripts/smoke/notion-generic-live.mjs",
|
||||
"chat-catalog-domains/identity-support.ts"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 2,
|
||||
"expectedHumanMessageCount": 1,
|
||||
"minimumRunCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 900000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-notion-setup.js",
|
||||
"exportName": "notionSetupExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "notion",
|
||||
"fields": [
|
||||
"workspaceId",
|
||||
"workspaceName",
|
||||
"recentPageId",
|
||||
"olderPageId",
|
||||
"mcpUrl",
|
||||
"apiVersion",
|
||||
"apiTokenEnv",
|
||||
"recentMarker",
|
||||
"olderMarker",
|
||||
"recentFactJson",
|
||||
"olderFactJson",
|
||||
"oauthBrowserSessionEnv",
|
||||
"oauthHumanEmailEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "connection-setup.save-and-resume",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-notion-setup.ts",
|
||||
"chat-catalog-domains/external-notion-oauth.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-worker.ts",
|
||||
"chat-catalog-domains/external-notion-oauth-contract.ts",
|
||||
"chat-catalog-domains/external-notion-provider.ts",
|
||||
"chat-catalog-domains/external-notion-semantics.ts",
|
||||
"chat-catalog-domains/external-public-signin.ts",
|
||||
"chat-catalog-domains/external-public-signin-worker.ts",
|
||||
"chat-catalog-domains/external-public-signin-contract.ts",
|
||||
"public-mcp-flow.ts",
|
||||
"chat-public-origin.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-scenarios/connection-setup.yaml",
|
||||
"../../ui/src/features/connections/ConnectionSetupFlow.tsx",
|
||||
"../../ui/src/features/connections/ConnectionIntentInteractionBody.tsx",
|
||||
"../../server/src/routes/tool-access.ts",
|
||||
"../../server/src/services/tool-access/oauth/direct-callback.ts",
|
||||
"../../scripts/smoke/notion-generic-live.mjs",
|
||||
"chat-catalog-domains/identity-support.ts"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 2,
|
||||
"expectedHumanMessageCount": 1,
|
||||
"minimumRunCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 900000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-notion-setup.js",
|
||||
"exportName": "notionSetupExternalCases"
|
||||
},
|
||||
{
|
||||
"scenarioId": "connection-setup.secure-api-key",
|
||||
"sourceFiles": [
|
||||
@@ -3746,6 +4330,86 @@
|
||||
"modulePath": "./chat-catalog-domains/runtime-infrastructure.js",
|
||||
"exportName": "runtimeInfrastructureCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "agentmail",
|
||||
"fields": [
|
||||
"inboxId",
|
||||
"recipient",
|
||||
"recipientAuthorization",
|
||||
"apiTokenEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "recovery.unknown-email-outcome",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/runtime-email.ts",
|
||||
"chat-catalog-domains/runtime-email-fault.ts",
|
||||
"chat-catalog-domains/runtime-email-private.ts",
|
||||
"chat-catalog-domains/runtime-email-private-worker.ts",
|
||||
"../../server/src/services/email-channels.ts",
|
||||
"../../server/src/services/agentmail-api.ts",
|
||||
"../../server/src/services/connectors/agentmail.ts",
|
||||
"server-entry.ts",
|
||||
"chat-scenarios/recovery.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.runtime.v2",
|
||||
"coverageGaps": [],
|
||||
"expectedRunCount": 4,
|
||||
"setupHumanMessageCount": 1,
|
||||
"expectedHumanMessageCount": 3,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 900000,
|
||||
"authentication": "human-session",
|
||||
"setupPolicy": {
|
||||
"readiness": "preserve-scenario",
|
||||
"invariantCheckIds": [
|
||||
"real-original-email-uncertain-with-no-public-provider-receipt"
|
||||
]
|
||||
},
|
||||
"modulePath": "./chat-catalog-domains/runtime-email.js",
|
||||
"exportName": "runtimeEmailRecoveryCases"
|
||||
},
|
||||
{
|
||||
"requiredCredentials": [
|
||||
"DAYTONA_API_KEY"
|
||||
],
|
||||
"externalInput": {
|
||||
"provider": "daytona",
|
||||
"fields": [
|
||||
"imageDigest",
|
||||
"imageRef",
|
||||
"region",
|
||||
"disposableNamespace",
|
||||
"qualifiedHarness"
|
||||
]
|
||||
},
|
||||
"scenarioId": "recovery.workspace-repair",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/runtime-workspace-repair.ts",
|
||||
"chat-catalog-domains/runtime-daytona-target.ts",
|
||||
"chat-catalog-domains/runtime-support.ts",
|
||||
"registered-artifact.ts",
|
||||
"../../server/src/services/workspace-recovery.ts",
|
||||
"../../server/src/services/native-runtime/native-workspace-sync.ts",
|
||||
"../../ui/src/components/WorkspaceExportRecovery.tsx",
|
||||
"chat-scenarios/recovery.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.runtime.v2",
|
||||
"coverageGaps": [],
|
||||
"expectedRunCount": 3,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 1500000,
|
||||
"authentication": "human-session",
|
||||
"setupPolicy": {
|
||||
"readiness": "preserve-scenario",
|
||||
"invariantCheckIds": [
|
||||
"actual-board-owned-failed-export-newer-destination-held"
|
||||
]
|
||||
},
|
||||
"modulePath": "./chat-catalog-domains/runtime-workspace-repair.js",
|
||||
"exportName": "runtimeWorkspaceRepairCases"
|
||||
},
|
||||
{
|
||||
"browserTimezone": "America/Chicago",
|
||||
"scenarioId": "routines.create-daily-brief",
|
||||
@@ -4158,6 +4822,54 @@
|
||||
"modulePath": "./chat-catalog-domains/external-secret-proposal.js",
|
||||
"exportName": "secretProposalExternalCases"
|
||||
},
|
||||
{
|
||||
"externalInput": {
|
||||
"provider": "vault",
|
||||
"fields": [
|
||||
"provider",
|
||||
"region",
|
||||
"deploymentId",
|
||||
"kmsKeyId",
|
||||
"secretReference",
|
||||
"accessKeyIdEnv",
|
||||
"secretAccessKeyEnv",
|
||||
"sessionTokenEnv",
|
||||
"expectedValueEnv"
|
||||
]
|
||||
},
|
||||
"scenarioId": "secrets.vault-reference",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-vault-reference.ts",
|
||||
"chat-catalog-domains/external-fixtures.ts",
|
||||
"chat-catalog-domains/external-secret-endpoint.ts",
|
||||
"chat-catalog-domains/external-secret-scan.ts",
|
||||
"chat-catalog-domains/external-credential-language.ts",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-catalog-domains/identity-support.ts",
|
||||
"chat-vault-private-server.ts",
|
||||
"harness-env.ts",
|
||||
"server.ts",
|
||||
"chat-private-inputs.ts",
|
||||
"run-observations.ts",
|
||||
"../../server/src/routes/secrets.ts",
|
||||
"../../server/src/services/secrets.ts",
|
||||
"../../server/src/secrets/aws-secrets-manager-provider.ts",
|
||||
"../../server/src/services/native-runtime/native-session-executor.ts",
|
||||
"../../ui/src/pages/Secrets.tsx",
|
||||
"../../ui/src/pages/secrets/ImportFromVaultDialog.tsx",
|
||||
"chat-scenarios/secrets.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"expectedRunCount": 3,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"minimumRunCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 720000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-vault-reference.js",
|
||||
"exportName": "vaultReferenceExternalCases"
|
||||
},
|
||||
{
|
||||
"scenarioId": "skills.author-skill",
|
||||
"sourceFiles": [
|
||||
@@ -5018,6 +5730,11 @@
|
||||
"scenarioId": "teams.install-team",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/external-team-install.ts",
|
||||
"chat-catalog-domains/external-team-conditional.ts",
|
||||
"../../server/src/services/teams-catalog.ts",
|
||||
"../../server/src/services/company-skills.ts",
|
||||
"../../server/src/services/company-portability.ts",
|
||||
"../../packages/teams-catalog/generated/catalog.json",
|
||||
"chat-catalog-domains/external-support.ts",
|
||||
"chat-catalog-domains/internal-support.ts",
|
||||
"chat-catalog-domains/identity-support.ts",
|
||||
@@ -5025,13 +5742,11 @@
|
||||
"chat-scenarios/teams.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.external.v1",
|
||||
"coverageGaps": [
|
||||
"installer-conflict-and-partial-failure-branches"
|
||||
],
|
||||
"expectedRunCount": 2,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 480000,
|
||||
"authentication": "human-session",
|
||||
"modulePath": "./chat-catalog-domains/external-team-install.js",
|
||||
"exportName": "teamInstallExternalCases"
|
||||
},
|
||||
@@ -5206,5 +5921,56 @@
|
||||
],
|
||||
"modulePath": "./chat-catalog-domains/runtime-workspace-repositories.js",
|
||||
"exportName": "runtimeWorkspaceRepositoryCases"
|
||||
},
|
||||
{
|
||||
"requiredCredentials": [
|
||||
"DAYTONA_API_KEY"
|
||||
],
|
||||
"externalInput": {
|
||||
"provider": "daytona",
|
||||
"fields": [
|
||||
"imageDigest",
|
||||
"imageRef",
|
||||
"region",
|
||||
"disposableNamespace",
|
||||
"qualifiedHarness"
|
||||
]
|
||||
},
|
||||
"scenarioId": "workspaces.recover-lost-sandbox",
|
||||
"sourceFiles": [
|
||||
"chat-catalog-domains/runtime-lost-sandbox.ts",
|
||||
"chat-catalog-domains/runtime-workspace-repair.ts",
|
||||
"chat-catalog-domains/runtime-daytona-target.ts",
|
||||
"chat-catalog-domains/runtime-daytona-destroy.ts",
|
||||
"chat-catalog-domains/runtime-daytona-destroy-worker.ts",
|
||||
"remote-native-bootstrap.ts",
|
||||
"registered-artifact.ts",
|
||||
"../../server/src/services/native-runtime/native-workspace-reconstruction.ts",
|
||||
"../../server/src/services/workspace-recovery.ts",
|
||||
"../../ui/src/components/WorkspaceReconstructionRecovery.tsx",
|
||||
"chat-scenarios/workspaces.yaml"
|
||||
],
|
||||
"oracleVersion": "paperclip.chat-catalog.runtime.v2",
|
||||
"coverageGaps": [],
|
||||
"expectedRunCount": 4,
|
||||
"expectedHumanMessageCount": 2,
|
||||
"turnTimeoutMs": 120000,
|
||||
"attemptTimeoutMs": 1800000,
|
||||
"authentication": "human-session",
|
||||
"setupPolicy": {
|
||||
"readiness": "preserve-scenario",
|
||||
"invariantCheckIds": [
|
||||
"real-failed-destroyed-sandbox-and-attributed-surviving-attachment"
|
||||
]
|
||||
},
|
||||
"runPolicy": {
|
||||
"kind": "terminal-counts",
|
||||
"terminalStatusCounts": {
|
||||
"failed": 1,
|
||||
"succeeded": 3
|
||||
}
|
||||
},
|
||||
"modulePath": "./chat-catalog-domains/runtime-lost-sandbox.js",
|
||||
"exportName": "runtimeLostSandboxCases"
|
||||
}
|
||||
]
|
||||
Reference in new issue
Block a user