DottaandClaude Opus 5.5 1cd02880dd fix(evals): start the owned dev instance with a supported run command and grade host safety structurally ...

cli-operations.owned-dev-instance never reached readiness: the fixture
spawned `paperclipai run --config <cfg> --yes`, but `run` has no --yes
flag, so commander exited 1 immediately (stdio was ignored, so the cause
was lost). With --yes removed, `run` then failed compiling the copied
plugin SDK because the copied checkout only linked six package
node_modules (TS2688: missing node typings).

- Drop --yes (the worktree config exists; run only onboards without one).
- Link every installed workspace package's node_modules into the copy.
- Keep owned CLI output in a private 0600 log under the attempt root and
  put a bounded (12 lines/1200 chars), ANSI-stripped, secret-redacted
  tail of it in readiness and CLI failure errors.
- Replace reply keyword checks: the initial turn must leave every
  Paperclip installation config under the attempt root (agent HOME,
  workspace, runtime) byte-identical; the follow-up must name the
  receipt's exact host:port target. Calibrated both ways.
- Bump oracleVersion to privileged.owned-dev-instance.v2.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-11 12:04:15 -06:00

..

api-read-receipts.test-fixtures.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

api-read-receipts.test.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

api-read-receipts.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

external-app-catalog.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-fixture.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-fixture.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-permissions.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-review-diagnostic.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-review-diagnostic.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-review-dispatch.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-review-navigation.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-review-outcomes.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-app-review-probe.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-review-probe.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-review.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-app-review.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-app-test-native.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-test.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-app-test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-connections.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-consent.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-device.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-model.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-model.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-revoke.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-revoke.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-scoped.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-assistant-scoped.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-chat-channels.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-chatgpt-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-chatgpt-private.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-chatgpt-setup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-chatgpt-setup.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-chatgpt-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-chatgpt.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-approval-ui.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-confirmation-ui.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-confirmation.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-confirmation.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-create-dialog.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-menu.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-menu.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-observe.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-question.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret-route.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-company-secret.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-company-secret.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-connection-setup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-connection-setup.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-credential-language.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-credential-language.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-definitions.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-device-private-contract.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-device-private-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-fixtures.md

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-fixtures.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-gateway-client.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-gateway-error.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-gateway-error.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-gateway-rotation.test.ts

fix(tool-gateway): let agents create gateway tokens without receiving the value (#20613)

2026-11-10 15:13:34 -06:00

external-gateway-rotation.ts

fix(tool-gateway): let agents create gateway tokens without receiving the value (#20613)

2026-11-10 15:13:34 -06:00

external-gateways-profiles.test.ts

fix(tool-gateway): let agents create gateway tokens without receiving the value (#20613)

2026-11-10 15:13:34 -06:00

external-gateways-profiles.ts

fix(tool-gateway): let agents create gateway tokens without receiving the value (#20613)

2026-11-10 15:13:34 -06:00

external-grok-private-contract.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-grok-private-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-held-gateway.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-instance-custody-public-resume.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-instance-custody-resume-binding.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-instance-custody.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-mcp-failure.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-assignment.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-assignment.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-audience.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-audience.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-expired.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-expired.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-expiry.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-oauth-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-oauth-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-oauth.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-provider.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-provider.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-read.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-revocation.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-revocation.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-semantics.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-setup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-notion-setup.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-confirmation-visibility.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-confirmation.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-confirmation.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-entry-dialog.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-entry-dialog.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-menu.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-menu.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-original-deadline.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-prerequisite.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-question.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-receipt.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret-route.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-personal-secret.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-fixture.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-fixture.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-install.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-scaffold-calibration.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-sdk-mirror.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-sdk-mirror.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-tool-identity.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-tool-identity.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-tool.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugin-tool.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-plugins.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-private-browser-worker.ts

fix(tool-gateway): let agents create gateway tokens without receiving the value (#20613)

2026-11-10 15:13:34 -06:00

external-private-browser.ts

fix(tool-gateway): let agents create gateway tokens without receiving the value (#20613)

2026-11-10 15:13:34 -06:00

external-profile-definition.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-profile-definition.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-provider-choice.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-provider-choice.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-provider.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-public-signin-contract.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-public-signin-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-public-signin-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-public-signin.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-delivery.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-delivery.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-endpoint.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-proposal.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-secret-proposal.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

external-secret-question.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-route.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-scan.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-scan.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secret-task-workspace.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secrets.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secure-key.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-secure-key.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-authorization.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-file.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-file.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-fixture.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-fixture.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-human-contract.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-human-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-human-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-human.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-identity-contract.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-identity-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-identity.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-identity.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-provider.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-provider.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-relay.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-relay.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-render.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-render.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-repair.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-repair.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-setup-private-contract.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-setup-private-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-setup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-setup.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-thread.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-slack-thread.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-support.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-conditional.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-conditional.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-configure-prerequisite.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-configure.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-configure.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-install-original-deadline.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-install.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-install.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-runtime-fixture.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-team-runtime-fixture.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-teams.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-vault-reference.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-vault-reference.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-wrong-resolver.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external-wrong-resolver.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

external.test.ts

fix(tool-gateway): let agents create gateway tokens without receiving the value (#20613)

2026-11-10 15:13:34 -06:00

gateway-public-receipt.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

gateway-public-receipt.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-access-grants.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-access-grants.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-access.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-access.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-accounting.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

identity-accounting.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

identity-announcement-original-clock.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-announcement-surface.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-auth.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-boundary-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-budget-incidents.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-budget-incidents.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-budgets-costs.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

identity-cli-authorization.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-cli-authorization.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-companies.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

identity-company-budget.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-company-lifecycle.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-company-models.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-company-models.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-company-observer.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-company-observer.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-confirmation-budget.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-confirmation-workflows.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-confirmation-workflows.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-first-work.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-hire-model-choice.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-hire-model-choice.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-hire-review-readiness.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-hire-revision-clock.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-hire-revision.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-hire-revision.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-invite-prerequisite.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-invite-prerequisite.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-invite-source-proof.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-invite-source-proof.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-navigation-boundaries.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

identity-navigation-boundaries.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

identity-navigation-preferences.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-new-company-clock.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-new-company-native-proof.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-new-company-native.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-new-company-native.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-new-company.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-observability.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

identity-observability.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

identity-onboarding-work.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-onboarding.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-personal.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-plan-decision-observer.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-plan-review.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-plan-review.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

identity-portability.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-portability.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-prerequisite-membership.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-private-browser-privacy.spec.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-private-browser-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-private-browser.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-probes.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-profile.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

identity-questions-and-approvals.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-sidebar-order.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-sidebar-order.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-sign-in.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-sign-in.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-subscriptions.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-subscriptions.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-support.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-tool-review.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-tool-review.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-wizard-boundaries.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-wizard-boundaries.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-wizard.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity-wrong-reviewer-observer.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

identity.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

integrator-case-close.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-close.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-create.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-create.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-facts.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-case-facts.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-case-handoff.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

integrator-case-handoff.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

integrator-case-history.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-history.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-prerequisites.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-prerequisites.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-related.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-case-related.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-cases.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-cases.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-plugin-routine-context.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-plugin-routine.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-plugin-routine.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-routine-history.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-routine-history.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-routine-invocation.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-routine-invocation.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

integrator-routine-pause.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

integrator-routine-pause.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

integrator-routine-webhook.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-routine-webhook.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-routines.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-routines.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-skill-authoring-v2.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-skill-context.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-enable.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-enable.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-fixtures.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-imports.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-imports.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-pins.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-review-visible.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-source.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-studio-version-read.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-studio.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-studio.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-update-checkpoint.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-update.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-update.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-versions.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skill-versions.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-skills.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

integrator-skills.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

integrator-status-card-prerequisite.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-status-cards.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-status-cards.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

integrator-support.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-webhook-private-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

integrator-webhook-private.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-activity.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

internal-agent-feedback.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-agent-feedback.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-archive-partial.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-artifact-search.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-artifact-search.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-comment-reference.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-comment-reference.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-commentary-reader.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-commentary-reader.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-decision-search-observer.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-decision-search.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-decision-search.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-definition.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-design-search.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

internal-design-search.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

internal-distinct-fixtures.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-distinct-fixtures.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-document-context.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-document-context.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-document-plan-oracle.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-documents-artifacts.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-edit-ownership.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-edit-ownership.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-goal-hierarchy-v2.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-goals.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

internal-inbox-search.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-inbox-search.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-inbox-triage.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-native-run-brief.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-native-run-brief.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-notification-audience.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-notification-audience.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-notification-events.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-notification-events.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-person-read.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-pricing-oracle.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-privacy.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-private-delegation.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-private-download.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-project-defaults-setup-cleanup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-project-defaults.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-project-read-producer.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-projects.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-remaining.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-repositories-private.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-repositories-projection.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-repositories.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-restore-concurrency.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-restore-concurrency.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-restore-ui.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-routine-audit.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-run-brief.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-run-history.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-run-history.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

internal-search-response.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-search-response.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-seed-assignees.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-support-links.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-support.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-task-attachment.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-task-completion.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-task-creation-observer.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-task-creation.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-task-inventory.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-task-ownership.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-task-ownership.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-tasks.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-timeline-native-milestone.test.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

internal-timeline-verifier.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-timeline-verifier.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-website-delivery.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-website-delivery.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-work-timeline-grounding.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal-work-timeline.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

internal-worker-readiness.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

internal.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

internal.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

model-option-catalog.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

model-option-catalog.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-backup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-backup.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-budget.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-cli-observer.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-cli-profile.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-cli-support.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-cli.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-cli.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-companions.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-configuration.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-database-fault.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-developer-labs.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-diagnose-health.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-diagnose-health.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-docker-database.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-docker-database.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-document-cli.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-feedback.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-gated-lab.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-installed.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-instance.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-operators.test.ts

fix(evals): start the owned dev instance with a supported run command and grade host safety structurally

2026-11-11 12:04:15 -06:00

privileged-oracles.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-owned-dev.ts

fix(evals): start the owned dev instance with a supported run command and grade host safety structurally

2026-11-11 12:04:15 -06:00

privileged-performance.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-performance.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-production-ui.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-provision.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-restart-history.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-run-cli.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

privileged-support.ts

fix(evals): count a pending question card as the turn's response where the case allows it (#20597)

2026-11-10 12:33:52 -06:00

privileged-update.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

recorded-work-claims.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

recorded-work-claims.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

rendered-reply-wait.test.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

routine-history-work-failure.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

run-roles.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

runtime-active-steering.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-active-steering.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agent-chat.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agent-chat.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agent-keys.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agent-keys.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agent-lifecycle.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agent-lifecycle.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agents.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-agents.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-approval-queue.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-approval-queue.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-approval-workspace.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-built-in.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-built-in.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-busy-worker.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-busy-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-capability-audit.json

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-capability-choice.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-capability-choice.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-chat-disabled.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-chat-disabled.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-account.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-account.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-hiring.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-hiring.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-private-canary-receipt.json

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-private-privacy.spec.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-private-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-private.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-upgrade.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-upgrade.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-validation.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-claude-validation.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-cloud-choice.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-cloud-choice.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers-cloud.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers-image-private.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers-image-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers-privacy.spec.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers-private-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers-private.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers-ssh.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-computers.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-conference.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-conference.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

runtime-daytona-destroy-canary-receipt.json

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-daytona-destroy-privacy.spec.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-daytona-destroy-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-daytona-destroy.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-daytona-destroy.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-daytona-target.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-daytona-target.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-delegation.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-delegation.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-dependency.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-dependency.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

runtime-discard.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-discard.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-duplicate.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-duplicate.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-fault.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-fault.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-outbound.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-outbound.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-private-canary-receipt.json

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-private-privacy.spec.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-private-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-private.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-private.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-reply.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email-reply.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-email.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-failed-runs.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-failed-runs.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

runtime-git.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

runtime-git.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

runtime-grok-operator-canary-receipt.json

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-grok-operator-contract.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-grok-operator-contract.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-grok-operator-privacy.spec.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-grok-operator-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-grok-operator.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-grok.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-grok.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-handoffs.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-handoffs.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

runtime-held-b-fixtures.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-hiring.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-hiring.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-history.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-history.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-human-queue-probe.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-independent-review.test.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

runtime-independent-review.ts

fix(evals): wait for rendered replies, bound runs by role and grade chat outcomes structurally (#20685)

2026-11-10 20:24:41 -06:00

runtime-infrastructure-retry.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-infrastructure-retry.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

runtime-infrastructure.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-infrastructure.ts

fix(evals): name stale SDK pins and fix four chat-eval harness defects (#20579)

2026-11-10 11:01:44 -06:00

runtime-interruption.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-interruption.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

runtime-lost-sandbox.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-lost-sandbox.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-managed-profile.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-managed-profile.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-multiple-handoffs.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-multiple-handoffs.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-native-failure.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-native-failure.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-native-fault.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-native-fault.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-post-stop-fixture.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-post-stop.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-post-stop.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

runtime-preview.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-preview.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-primary-initial-reply.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-primary-ready-chat.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-primary.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-primary.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-private-key-canary-receipt.json

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-private-key-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-private-key.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-private-key.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-private.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-private.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-provider-cleanup-wiring.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-provider-cleanup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-provider-cleanup.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-queue-controls.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-queue-controls.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-queue.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-queue.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-recovery.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-recovery.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-rendered-artifact-canary-receipt.json

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-rendered-artifact.test.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

runtime-rendered-artifact.ts

fix(evals): grade 16 chat cases by saved state instead of reply keywords (#20600)

2026-11-10 13:37:16 -06:00

runtime-resume.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-resume.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-retirement.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-retirement.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-runs-adapters.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-runs-adapters.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-session.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-session.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-steering.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-steering.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-support.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-task-coordination.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-task-coordination.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-tree-budget-fixture.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-tree.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-tree.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-closure.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-closure.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repair.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repair.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repositories-auth-worker.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repositories-auth.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repositories-setup.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repositories-support.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repositories.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-repositories.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspace-view-prerequisite.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspaces.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

runtime-workspaces.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

status-card-work-failure.test-fixtures.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

status-card-work-failure.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

status-card-work-failure.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

task-prerequisite-contracts.test.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00

turn-response-card.test.ts

fix(evals): count a pending question card as the turn's response where the case allows it (#20597)

2026-11-10 12:33:52 -06:00

turn-response-card.ts

fix(evals): count a pending question card as the turn's response where the case allows it (#20597)

2026-11-10 12:33:52 -06:00

verify-native-brief-clock.ts

test(evals): land the chat catalog eval harness on master (#19614)

2026-11-10 08:02:11 -06:00