Permit idle sleep with consumed retries and passive worktrees (#15907)

## Thinking Path

> - Paperclip is the open source app people use to manage AI agents for
work.
> - Idle sleep must wait for accepted work and durable cleanup.
> - The retry dispatcher keeps its due date after it promotes a retry.
> - Finished retries and passive local directories can therefore look
like pending work.
> - This pull request requires completion proof and permits known
passive directory records.
> - It retains the records and keeps real work and unknown state awake.

## Linked Issues or Issue Description

Related: #15897 and #15851. The open runtime-service work in #13413
retains its separate service and ingress guarantees. This patch does not
change those checks.

**What happened?**

Idle sleep treats a consumed retry date as pending work. It also blocks
on every retained execution workspace, including a local directory
without runtime activity.

**Steps to reproduce**

1. Promote a scheduled retry, then finish its run without accounting
debt. Retain its scheduled retry date.
2. Retain a local primary directory or Git worktree without runtime
configuration, commands, or cleanup due.
3. Request an owned idle safety report. The report returns `present` for
this history.

**Paperclip version or commit**

Reproduced on master at 4b59e2a2ec.

**Deployment mode**

Server with PostgreSQL. The regression tests use embedded PostgreSQL.

## What Changed

- Permit terminal runs with a finish time at or after their retry date
and no accounting debt. Apply that proof to linked wake,
answer-delivery, and verified failed-lease history.
- Permit known passive local primary directories and Git worktrees. Keep
due cleanup, commands, runtime configuration, shared project runtime
inheritance, pending reopen, runtime owners, and unfamiliar state awake.
- Retain retry dates, workspace records, files, and metadata. Document
the proof and retention limits.

## Verification

- Passed all 200 tests in `pnpm exec vitest run
server/src/__tests__/idle-sleep-safety.test.ts` against embedded
PostgreSQL.
- Passed the 52 retry dispatcher tests.
- Passed `pnpm -r typecheck` and `pnpm build`. After the provider
correction, server typecheck and build passed again.
- Full CI is green for commit
`0510669439e855b90a4e03a2fc7827503cea507f`, including all test shards,
typecheck, build, and browser end-to-end tests. One browser test
initially raced its comment write; the failed jobs passed on retry
without a source change.
- Local `pnpm test:run` recorded 18,721 passed, 105 skipped, and four
failures in existing AI-login, Git-fixture, and native runner-recovery
tests; it exited before the remaining workspace and serialized groups.
The AI-login test passed alone. Both Git fixtures passed with
command-scoped `init.defaultBranch=master`. The native recovery failure
also occurs on the parent revision on this Mac. These suites pass in CI.
- Greptile Apex scored the final commit 5/5. Its provider-coverage
comment was addressed and the review thread resolved.
- Reviewed the diff for secrets, private data, generated files, and
unrelated changes.

## Risks

- Missing finish times, later retry dates, active children, and
accounting debt continue to block sleep. Failed lease history still
requires an exact provider termination receipt.
- Future cleanup eligibility can wait for the next wake. Due cleanup
blocks sleep. Storage must remain attached across sleep and keep its
backup policy.
- Shared directories with a project workspace and unfamiliar providers,
strategies, modes, or configuration remain conservative blockers.
- No migration, provider teardown, retry scheduling change, or tenant
data deletion.

## Model Used

OpenAI Codex, GPT-6, with repository tools and code execution. The
runtime does not expose a more specific model snapshot or context-window
size.

## Checklist

- [x] I have included a thinking path that traces from project context
to this change
- [x] I have specified the model used (with version and capability
details)
- [x] I have checked ROADMAP.md and confirmed this PR does not duplicate
planned core work
- [x] I have searched GitHub for duplicate or related PRs and linked
them above
- [x] I have either (a) linked existing issues with `Fixes: #` / `Closes
#` / `Refs #` OR (b) described the issue in-PR following the relevant
issue template
- [x] I have not referenced internal/instance-local Paperclip issues or
links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip`
URLs)
- [x] My branch name describes the change (e.g. `docs/...`, `fix/...`)
and contains no internal Paperclip ticket id or instance-derived details
- [ ] I have run tests locally and they pass (focused tests pass; the
full local run has the environmental failures documented above)
- [x] I have added or updated tests where applicable
- [x] I have updated relevant documentation to reflect my changes
- [x] I have considered and documented any risks above
- [x] All Paperclip CI gates are green
- [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups
- [x] I will address all Greptile and reviewer comments before
requesting merge

---------

Co-authored-by: Paperclip <noreply@paperclip.ing>

server/src/services/idle-sleep-safety.ts

@@ -22,6 +22,16 @@ export type InspectIdlePlugins = (hold: { ownerId: string; expiresAt: number })
   pluginIds: string[];
 }>;
 
+// Retry promotion keeps its due date as history on the run. Only a terminal
+// run finished at or after that date has consumed the schedule. Newer retry
+// dates, unfinished runs and accounting work still require the instance.
+function finishedRun(alias: string): string {
+  return `${alias}.status IN ('succeeded', 'failed', 'cancelled', 'timed_out', 'interrupted')
+    AND ${alias}.finished_at IS NOT NULL
+    AND (${alias}.scheduled_retry_at IS NULL OR ${alias}.scheduled_retry_at <= ${alias}.finished_at)
+    AND ${alias}.cost_accounting_pending = false`;
+}
+
 // A failed turn may have successfully torn down its ephemeral allocation. A
 // cleanup label alone is not provider termination proof. Require the exact
 // host-owned receipt and finished run, and retain all cleanup/export intents.
@@ -43,9 +53,7 @@ function finishedFailedLease(alias: string): string {
     AND ${receipt}->>'state' IN ('stopped', 'destroyed')
     AND EXISTS (SELECT 1 FROM heartbeat_runs r WHERE r.id = ${alias}.heartbeat_run_id
       AND r.company_id = ${alias}.company_id
-      AND r.status IN ('succeeded', 'failed', 'cancelled', 'timed_out', 'interrupted')
-      AND r.finished_at IS NOT NULL AND r.scheduled_retry_at IS NULL
-      AND r.cost_accounting_pending = false)`;
+      AND ${finishedRun("r")})`;
 }
 
 // These are deliberately conservative. Completed agent runs and workspace
@@ -60,7 +68,9 @@ const WORK_CHECKS = [
      COALESCE((runtime_config->'heartbeat'->>'intervalSec')::numeric, 0) > 0)`,
   `SELECT 1 FROM heartbeat_runs WHERE
     status NOT IN ('succeeded', 'failed', 'cancelled', 'timed_out', 'interrupted')
-    OR scheduled_retry_at IS NOT NULL OR cost_accounting_pending`,
+    OR (scheduled_retry_at IS NOT NULL
+      AND (finished_at IS NULL OR scheduled_retry_at > finished_at))
+    OR cost_accounting_pending`,
   `SELECT 1 FROM agent_instruction_working_copies WHERE
     state NOT IN ('saved', 'unchanged', 'resolved', 'unavailable', 'conflict')
     OR process_stopped_at IS NULL OR next_attempt_at IS NOT NULL
@@ -78,14 +88,41 @@ const WORK_CHECKS = [
     OR (w.status = 'coalesced' AND (w.finished_at IS NULL OR NOT EXISTS (
       SELECT 1 FROM heartbeat_runs r WHERE r.id = w.run_id
         AND r.company_id = w.company_id AND r.agent_id = w.agent_id
-        AND r.status IN ('succeeded', 'failed', 'cancelled', 'timed_out', 'interrupted')
-        AND r.finished_at IS NOT NULL AND r.scheduled_retry_at IS NULL
-        AND r.cost_accounting_pending = false)))`,
+        AND ${finishedRun("r")})))`,
   `SELECT 1 FROM issues WHERE status NOT IN ('done', 'cancelled')`,
   // A completed issue can still need its first watchdog review, including a
   // retry after immediate evaluation failed before creating a review/run.
   `SELECT 1 FROM issue_watchdogs WHERE status <> 'disabled'`,
   `SELECT 1 FROM workspace_operations WHERE status NOT IN ('succeeded', 'failed', 'cancelled')`,
+  // A local directory has no independent worker. Keep unfamiliar providers,
+  // runtime/command configuration, reopen fences and due cleanup awake. Runs,
+  // operations, runtime services, retained leases and backup work are checked
+  // separately; inspecting the row never deletes or shortens retained data.
+  `SELECT 1 FROM execution_workspaces w WHERE (
+    w.provider_type IN ('local_fs', 'git_worktree')
+    AND w.strategy_type IN ('project_primary', 'git_worktree')
+    AND w.mode IN ('inherit', 'shared_workspace', 'isolated_workspace', 'operator_branch', 'reuse_existing', 'agent_default')
+    AND w.status IN ('active', 'idle', 'in_review', 'archived')
+    AND (w.metadata IS NULL OR jsonb_typeof(w.metadata) = 'object')
+    -- A shared workspace can inherit runtime configuration from its project.
+    AND (w.mode <> 'shared_workspace' OR w.project_workspace_id IS NULL)
+    AND (w.provider_ref IS NULL OR w.provider_ref = w.cwd)
+    AND (w.cleanup_eligible_at IS NULL OR w.cleanup_eligible_at > now())
+    AND COALESCE(w.metadata->>'reopenPendingConsumption', 'false') = 'false'
+    AND (w.metadata->'config' IS NULL OR w.metadata->'config' = 'null'::jsonb
+      OR (jsonb_typeof(w.metadata->'config') = 'object'
+        AND CASE WHEN jsonb_typeof(w.metadata->'config') = 'object' THEN
+          (w.metadata->'config') - ARRAY['environmentId', 'provisionCommand', 'runtimeProvisionCommand',
+            'teardownCommand', 'cleanupCommand', 'workspaceRuntime', 'desiredState', 'serviceStates'] = '{}'::jsonb
+          ELSE false END
+        AND COALESCE(w.metadata->'config'->'workspaceRuntime', 'null'::jsonb) = 'null'::jsonb
+        AND COALESCE(w.metadata->'config'->'serviceStates', 'null'::jsonb) IN ('null'::jsonb, '{}'::jsonb)
+        AND COALESCE(w.metadata->'config'->>'desiredState', 'stopped') = 'stopped'
+        AND COALESCE(w.metadata->'config'->>'provisionCommand', '') = ''
+        AND COALESCE(w.metadata->'config'->>'runtimeProvisionCommand', '') = ''
+        AND COALESCE(w.metadata->'config'->>'teardownCommand', '') = ''
+        AND COALESCE(w.metadata->'config'->>'cleanupCommand', '') = ''))
+    ) IS NOT TRUE`,
   `SELECT 1 FROM environment_leases l WHERE status NOT IN ('released', 'expired')
     AND (${finishedFailedLease("l")}) IS NOT TRUE`,
   `SELECT 1 FROM routines WHERE status NOT IN ('paused', 'archived')`,
@@ -135,9 +172,7 @@ const WORK_CHECKS = [
     OR (d.target_run_id IS NOT NULL AND NOT EXISTS (
       SELECT 1 FROM heartbeat_runs r WHERE r.id = d.target_run_id
         AND r.company_id = d.company_id
-        AND r.status IN ('succeeded', 'failed', 'cancelled', 'timed_out', 'interrupted')
-        AND r.finished_at IS NOT NULL AND r.scheduled_retry_at IS NULL
-        AND r.cost_accounting_pending = false))
+        AND ${finishedRun("r")}))
     OR (d.status = 'fallback_queued' AND d.target_run_id IS NULL AND NOT EXISTS (
       SELECT 1 FROM agent_wakeup_requests w WHERE w.company_id = d.company_id
         AND w.idempotency_key = 'question-response:' || d.interaction_id::text
@@ -147,9 +182,7 @@ const WORK_CHECKS = [
           OR (w.status = 'coalesced' AND EXISTS (
             SELECT 1 FROM heartbeat_runs r WHERE r.id = w.run_id
               AND r.company_id = w.company_id AND r.agent_id = w.agent_id
-              AND r.status IN ('succeeded', 'failed', 'cancelled', 'timed_out', 'interrupted')
-              AND r.finished_at IS NOT NULL AND r.scheduled_retry_at IS NULL
-              AND r.cost_accounting_pending = false)))))`,
+              AND ${finishedRun("r")})))))`,
   // These less common work sources fail closed on any retained state. Their
   // terminal-state exceptions can be added with tests for the owning service.
   ...[
@@ -161,7 +194,7 @@ const WORK_CHECKS = [
     "native_run_finalizations", "company_transfer_runs", "decisions", "decision_effect_executions",
     "decision_archive_notification_outbox", "browser_use_sessions", "browser_use_runs",
     "browser_use_browsers", "environment_custom_image_setup_sessions", "feedback_exports",
-    "company_secret_proposals", "execution_workspaces",
+    "company_secret_proposals",
     "mcp_oauth_grants", "mcp_mutation_receipts", "mcp_event_subscriptions",
     "mcp_event_deliveries", "mcp_attachment_uploads", "dot_agent_bindings",
     "dot_runner_assignments", "dot_runner_operations", "dot_mailbox_items",