Commit Graph
5 Commits
Author SHA1 Message Date
DottaandPaperclip 94aefb1f38 fix(evals): recognize prospective task wording in approval cards
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-09-16 08:47:40 -05:00
DottaandPaperclip 1c5b9c8b14 Grade verified task attachments and preserve interrupted report outcomes
Capture bounded text attachments through the task API, verify size and hash, and include their saved content in completion grading and transcripts. Cover further proposal headings without treating interrupted journeys as passes. Keep artifact errors separate from behavior errors and regenerate the native question example.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-09-15 22:58:50 -05:00
DottaandPaperclip b62924a737 Preserve incomplete outcomes and unknown costs in E2E reports
Reject incidental and negated task mentions as proposals. Carry incomplete journeys through history and retain unknown judge totals instead of reporting them as zero.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-09-15 22:51:20 -05:00
DottaandPaperclip e6619d3f5e Recognize new-task confirmation cards as onboarding proposals
Preserve the explicit confirmation semantics without requiring proposal keywords in the visible text. Cover the recorded Claude false failure and retain the rebased model recovery test.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-09-15 22:45:56 -05:00
DottaandPaperclip 633143d89b Add first-task onboarding skill, native delivery, and E2E evaluation
Co-Authored-By: Paperclip <noreply@paperclip.ing>
2026-09-15 22:14:28 -05:00