Files
PaperClipAI/tests
DottaandClaude Opus 5.5 086af6dd8b test(evals): retarget instance-settings from the removed Agent Chat toggle to the Cases experiment
Agent Chat is always on since #19360, so "Enable Agent Chat on this
instance." has no setting to change and the scripted human's "Toggle agent
chat experimental setting" switch no longer exists. The case keeps its
promise with an experiment that still exists and has a real route gate:
Cases (enableCases), whose /<prefix>/cases route redirects to the dashboard
while off.

- YAML: new query/context/expected outcome for Cases; inventory digest,
  manifest rows and changedFields updated and pinned.
- Setup starts Cases off (restored in cleanup), refuses a hidden setting, and
  probes GET/PATCH experimental settings with the agent's own key (403
  board_access_required, setting unchanged).
- The human checks Cases is still off after the agent's turn and its route is
  unavailable, then follows the Experimental settings link the reply rendered
  (no typed-URL fallback), turns Cases on, sees it persist after reload, and
  opens the Cases page.
- The reply-wording regex is replaced by structural checks: a rendered link to
  Experimental settings that the person followed, and saved setting state.
- oracleVersion privileged.instance-settings.v2; sourceFiles follow the code.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-11 12:22:26 -06:00
..