Commit Graph
246 Commits
Author SHA1 Message Date
Dotta d162a92c3f test(evals): capture the actual authenticated disabled chat page 2026-10-26 20:27:18 -05:00
Dotta 089283890d test(evals): preserve routine invocation and native failure history 2026-10-26 20:26:13 -05:00
Dotta 6e41ca33d8 test(evals): cover disabled chat and actual failed native history phases 2026-10-26 20:24:50 -05:00
Dotta 43d984ae5a test(evals): bind strict SSH known-host input declarations 2026-10-26 20:24:48 -05:00
Dotta 8b82676ed6 test(e2e): author native accounting and partial subscription journeys 2026-10-26 20:22:47 -05:00
Dotta 2e28994246 test(evals): install vetted skills and preserve editable forks 2026-10-26 20:20:04 -05:00
Dotta 1bae706393 test(evals): scope private runtime metadata to declared cases 2026-10-26 20:18:06 -05:00
Dotta 55eddc4313 test(evals): add public unavailable-model native failure prerequisite 2026-10-26 20:16:04 -05:00
Dotta 5196e94ad2 test(evals): wire repository fixtures to selected private inputs 2026-10-26 20:15:45 -05:00
Dotta 9d93100f84 test(e2e): bind campaign eligibility to measured product identities 2026-10-26 20:10:00 -05:00
Dotta c80f926546 test(evals): add real case kickoff and saved card generation checks 2026-10-26 20:09:27 -05:00
Dotta 2e21d32864 test(evals): accept substantive checklist paraphrases 2026-10-26 20:09:04 -05:00
Dotta 831a45d9c6 test(e2e): cover real company packages and conflict-safe import 2026-10-26 20:09:01 -05:00
Dotta e7468282f5 test(evals): author nine case routine card and skill scenarios 2026-10-26 20:01:46 -05:00
Dotta 98bd794052 test(e2e): verify opt-in native agent trace delivery 2026-10-26 20:00:11 -05:00
Dotta 775d063d1e test(e2e): author human company setup and real first website 2026-10-26 19:56:45 -05:00
Dotta ad0907afb9 test(evals): refuse incomplete binary secret scans 2026-10-26 19:54:36 -05:00
Dotta 589ed1a30c test(evals): cover unavailable MCP setup recovery 2026-10-26 19:52:11 -05:00
Dotta 9767bca5fc test(e2e): cover governed hire revisions and budget incidents 2026-10-26 19:52:07 -05:00
Dotta 010e5c51a7 test(evals): verify operator synthetic plugin installation 2026-10-26 19:48:23 -05:00
Dotta 35f601cec2 test(e2e): expose explicit agent access grant setup blockers 2026-10-26 19:46:56 -05:00
Dotta d54e55b708 test(evals): cover admitted gateway client profile access 2026-10-26 19:46:13 -05:00
DottaandPaperclip 8f67a700a4 test(evals): qualify owned published sources for two operator chat cases
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-10-26 19:45:12 -05:00
Dotta 3344de11b3 test(e2e): author real company model service controls 2026-10-26 19:41:42 -05:00
DottaandPaperclip 5f8a3c8eec test(evals): erase selected secrets outside retained diagnostics
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-10-26 19:41:13 -05:00
Dotta 99513b6c48 test(evals): author real bounded CLI device authorization journey 2026-10-26 19:38:30 -05:00
Dotta 15989bc518 test(e2e): bind plan decisions and draft revision provenance 2026-10-26 19:37:30 -05:00
Dotta 4b54b90b90 test(evals): scope external inputs and close probe credential lifetimes 2026-10-26 19:33:54 -05:00
Dotta 5cc4d6f1fa test(e2e): cover missing links and personal announcements 2026-10-26 19:32:09 -05:00
DottaandPaperclip 9be9c65e85 test(evals): isolate declared case credentials and private provider inputs
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-10-26 19:31:15 -05:00
Dotta dbabcc4e0d test(evals): add real disposable plugin management journeys 2026-10-26 19:29:28 -05:00
Dotta 62c6745930 test(e2e): author real identity onboarding boundaries 2026-10-26 19:28:56 -05:00
Dotta 5da3ff9ce0 test(evals): verify restoration across a real concurrent edit 2026-10-26 19:24:13 -05:00
Dotta 747eb78c7b test(evals): scan secret outputs privately and cover catalog quarantine 2026-10-26 19:22:29 -05:00
Dotta a1859e0e67 test(e2e): reconcile finite catalog authoring checkpoint 2026-10-26 19:16:40 -05:00
Dotta 50775edc48 test(evals): bind conversational approvals and race real question answers 2026-10-26 19:14:54 -05:00
Dotta 4cde887b01 Exercise property edits under actual later execution ownership denial 2026-10-26 19:14:03 -05:00
Dotta b33f3b8b64 test(e2e): author bounded privileged operator journeys 2026-10-26 19:12:54 -05:00
Dotta 24016a4ac2 Add actual two-principal notification and explicit mention journey 2026-10-26 19:09:46 -05:00
Dotta 51bd1c8138 test(evals): finish stale approvals and one-action tool review coverage 2026-10-26 19:07:50 -05:00
Dotta 483d5f2b9b test(evals): close question continuation and sidebar scope gaps 2026-10-26 19:00:15 -05:00
Dotta 0b69bdef99 Add historical final-artifact search through public migration evidence 2026-10-26 18:59:55 -05:00
Dotta f232f03d0e test(evals): exercise human CLI authorization and revocation 2026-10-26 18:54:07 -05:00
Dotta 874035eca4 Add genuine generated website delivery and retained revision journeys 2026-10-26 18:51:39 -05:00
Dotta 0f95be3f07 test(evals): author real expired-session browser boundary 2026-10-26 18:48:58 -05:00
Dotta 4c4408b85d Use immutable production attachment origin for completion evidence 2026-10-26 18:46:48 -05:00
Dotta 6a28921e39 test(evals): cover human profile and company lifecycle journeys 2026-10-26 18:44:07 -05:00
Dotta 80ba3b2d35 Add real stale assignment read and execution ownership conflict journey 2026-10-26 18:43:30 -05:00
Dotta b1f30d7d51 eval: add real operator companions and finite disabled-chat boundary 2026-10-26 18:39:51 -05:00
Dotta 6e5df53427 Add genuine interrupted execution and continuation history journey 2026-10-26 18:39:50 -05:00