Commit Graph
5834 Commits
Author SHA1 Message Date
Dotta 69b2e2b1a2 test(evals): keep authenticated API cookies outside Test parameters 2026-10-26 21:33:37 -05:00
Dotta 8d4168d1ed evals: reject contrary managed qualification and retention advice 2026-10-26 21:30:23 -05:00
Dotta 2e4258749a evals: verify truthful operator path for unqualified managed profiles 2026-10-26 21:27:36 -05:00
Dotta 2d53c3952f test(evals): hand off Morgan primary through genuine native authority 2026-10-26 21:19:08 -05:00
Dotta 4e73b7bb70 test(evals): protect short multiline diagnostic credentials 2026-10-26 21:18:45 -05:00
Dotta db4c051441 evals: route existing website feedback while preserving delivered logo 2026-10-26 21:14:24 -05:00
Dotta ad4b0162ae test(e2e): isolate identity entry and verify post-retry chat result 2026-10-26 21:12:12 -05:00
Dotta b72f0f7cbb test(evals): redact private diagnostic streams and opaque reporter sinks 2026-10-26 21:10:10 -05:00
Dotta bf54b256db evals: prove design dependency gates actual website admission 2026-10-26 21:09:24 -05:00
Dotta c410c08205 evals: keep standalone browser privacy canary explicit and opt in 2026-10-26 21:09:24 -05:00
Dotta 098303bf13 evals: install disabled-chat human session through private state file 2026-10-26 21:04:31 -05:00
Dotta 1ef868b0ac evals: isolate human API key UI and leakage scans from Test recording 2026-10-26 21:02:32 -05:00
Dotta 2f31e660e2 test(evals): separate schedule pause from genuine running routine work 2026-10-26 20:55:36 -05:00
Dotta 84cd4a4366 test(evals): isolate secure entry from Playwright reporter artifacts 2026-10-26 20:55:27 -05:00
Dotta 766afb3149 evals: verify human subtree pause and independent child gates 2026-10-26 20:55:24 -05:00
Dotta 2e1943a7c7 test(evals): prove case work links and current principal access 2026-10-26 20:52:51 -05:00
Dotta ce5fbfc2af evals: cover pending discard and consumed cancellation as new direction 2026-10-26 20:50:07 -05:00
Dotta baca00beb9 test(evals): verify real bounded Studio input revision and output 2026-10-26 20:49:44 -05:00
Dotta e1000c7fcc test(evals): observe manual routine delivery and actual later result 2026-10-26 20:46:07 -05:00
Dotta 0d73ba89c3 test(evals): prove secure key setup and flexible Notion semantics 2026-10-26 20:41:55 -05:00
Dotta 8e57349a43 test(evals): bind Morgan handoff chat to a real engineer principal 2026-10-26 20:38:47 -05:00
Dotta 079d05e893 test(evals): author named Notion read proof and viewer boundary 2026-10-26 20:34:39 -05:00
Dotta 81e03353d5 test(evals): cover real preview lifecycle and queued requirement delivery 2026-10-26 20:34:24 -05:00
Dotta 40af4fe402 test(evals): verify viewer-limited assistant consent 2026-10-26 20:28:44 -05:00
Dotta 94cf8870d6 test(evals): accept concise truthful routine history answers 2026-10-26 20:28:08 -05:00
Dotta d162a92c3f test(evals): capture the actual authenticated disabled chat page 2026-10-26 20:27:18 -05:00
Dotta 089283890d test(evals): preserve routine invocation and native failure history 2026-10-26 20:26:13 -05:00
Dotta 6e41ca33d8 test(evals): cover disabled chat and actual failed native history phases 2026-10-26 20:24:50 -05:00
Dotta 43d984ae5a test(evals): bind strict SSH known-host input declarations 2026-10-26 20:24:48 -05:00
Dotta 8b82676ed6 test(e2e): author native accounting and partial subscription journeys 2026-10-26 20:22:47 -05:00
Dotta 2e28994246 test(evals): install vetted skills and preserve editable forks 2026-10-26 20:20:04 -05:00
Dotta 1bae706393 test(evals): scope private runtime metadata to declared cases 2026-10-26 20:18:06 -05:00
Dotta 55eddc4313 test(evals): add public unavailable-model native failure prerequisite 2026-10-26 20:16:04 -05:00
Dotta 5196e94ad2 test(evals): wire repository fixtures to selected private inputs 2026-10-26 20:15:45 -05:00
Dotta 9d93100f84 test(e2e): bind campaign eligibility to measured product identities 2026-10-26 20:10:00 -05:00
Dotta c80f926546 test(evals): add real case kickoff and saved card generation checks 2026-10-26 20:09:27 -05:00
Dotta 2e21d32864 test(evals): accept substantive checklist paraphrases 2026-10-26 20:09:04 -05:00
Dotta 831a45d9c6 test(e2e): cover real company packages and conflict-safe import 2026-10-26 20:09:01 -05:00
Dotta e7468282f5 test(evals): author nine case routine card and skill scenarios 2026-10-26 20:01:46 -05:00
Dotta 98bd794052 test(e2e): verify opt-in native agent trace delivery 2026-10-26 20:00:11 -05:00
Dotta 775d063d1e test(e2e): author human company setup and real first website 2026-10-26 19:56:45 -05:00
Dotta ad0907afb9 test(evals): refuse incomplete binary secret scans 2026-10-26 19:54:36 -05:00
Dotta 589ed1a30c test(evals): cover unavailable MCP setup recovery 2026-10-26 19:52:11 -05:00
Dotta 9767bca5fc test(e2e): cover governed hire revisions and budget incidents 2026-10-26 19:52:07 -05:00
Dotta 010e5c51a7 test(evals): verify operator synthetic plugin installation 2026-10-26 19:48:23 -05:00
Dotta 35f601cec2 test(e2e): expose explicit agent access grant setup blockers 2026-10-26 19:46:56 -05:00
Dotta d54e55b708 test(evals): cover admitted gateway client profile access 2026-10-26 19:46:13 -05:00
DottaandPaperclip 8f67a700a4 test(evals): qualify owned published sources for two operator chat cases
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-10-26 19:45:12 -05:00
Dotta 3344de11b3 test(e2e): author real company model service controls 2026-10-26 19:41:42 -05:00
DottaandPaperclip 5f8a3c8eec test(evals): erase selected secrets outside retained diagnostics
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-10-26 19:41:13 -05:00