Files
PaperClipAI/doc/connections/AGENTMAIL.md
T
DottaandPaperclip 2083bf6f9a feat(connections): add AgentMail inboxes and email tasks (#13256)
## Thinking Path

> - Paperclip is the open source app people use to manage AI agents for
work.
> - Connections give agents controlled access to external services.
> - Experimental channels already map conversations to tasks and durable
work queues.
> - Email needs inbox ownership, recipient envelopes, delivery records,
and explicit sends.
> - This pull request adds AgentMail to that infrastructure and keeps
the provider key in the server vault.
> - Agents can receive and send email from local or sandbox execution
while the board follows each conversation in its task.

## Linked Issues or Issue Description

**Problem or motivation**

Agents need dedicated email addresses. Incoming email should become
assigned work. Internal task comments and progress must never become
outgoing email by accident.

**Proposed solution**

Add experimental AgentMail connections, an inbox assignment wizard,
durable email intake and publication, task email cards, and
authenticated API, CLI, and native runtime actions. Agents use Paperclip
credentials to request sends. Paperclip owns the provider key and
enforces access and task authority.

**Alternatives considered**

A general mailbox MCP connector does not provide durable task binding or
publication boundaries. A separate mailbox application duplicates task
collaboration. The board instead directs the agent through the normal
task conversation.

**Roadmap alignment**

This extends the existing experimental connections and task
infrastructure. Product scope and interaction design were reviewed with
the maintainer. Related connection authority work: #11831 and #11818.
The duplicate search found no competing task-based AgentMail
integration.

## What Changed

- Add AgentMail catalog data, shared contracts, company-scoped email
records, and an additive migration.
- Add vaulted setup, inbox assignment, access grants, trust guidance,
and provider-side allowlist guidance.
- Support WebSocket and signed-webhook intake through a shared durable
pipeline, deduplication, catch-up, and task wakeups.
- Queue explicit new conversations and replies with immutable send
intents, idempotency, delivery state, and uncertain-send resolution.
- Show inbound and outbound email cards in normal task conversations.
Keep internal messages internal.
- Add task-scoped CLI actions and the sandbox callback routes required
for Daytona execution.
- Provide a dedicated AgentMail skill automatically only to agents with
active authorized inbox assignments. Keep email instructions out of the
universal Paperclip skill.
- Advertise connector-owned `agentmail_inboxes`,
`agentmail_read_thread`, `agentmail_send`, and `agentmail_delivery`
tools only in eligible native sessions. Recheck live authority on
execution.
- Isolate Codex CLI connector skills by agent and skill revision.
Deliver the assigned skill in the run prompt for adapters that use
shared skill directories, including resumed turns. Keep automatic skills
out of manual persistent sync. Show them as read-only and document the
pattern in the connector playbook.
- Fix AgentMail health checks that entered local-stdio validation and
optional missing Codex credential cleanup in sandboxes.
- Add API, pipeline, authorization, sandbox, browser, and Storybook
coverage.

## Verification

- Live AgentMail testing covered WebSocket intake, signed webhooks,
restart catch-up, and a full receive → task → Daytona Codex CLI →
explicit reply → Delivered round trip. The reply was verified in the
other inbox. The normal task composer also initiated an outgoing email
child task.
- The connector-skill change was verified in the browser: AgentMail
appears once as an automatic, read-only skill with its assigned address.
Disabling experimental chat connections removes it; re-enabling restores
it. A regression test covers assignment data arriving after library
data.
- Connector regression coverage passed 178 runtime utility, email
integration, skill-route, and heartbeat tests. All 17 Codex execution
tests passed, including per-agent skill isolation, model identity,
revision changes, removal, and prompt delivery without shared skill
files.
- After rebasing onto master, all 44 focused email, heartbeat, and
native-authority tests passed. All 313 native-session executor tests
passed. The UI regression suite passed all 3 tests. These test sets
overlap earlier focused runs.
- Full workspace typecheck and build passed after the rebase. Token
gates passed. Earlier focused Playwright task/setup coverage and the
Storybook build also passed.
- Native connector tool execution uses deterministic integration tests.
Live Daytona qualification used the Codex CLI adapter; the new
shared-home prompt fallback has deterministic coverage.
- The full repository suite is run by CI. The earlier unsharded local
full-suite attempt was stopped after the equivalent CI suites passed and
is not reported as a completed local run. Greptile reviewed
`7e57dc267a8446d3c906e3cc5b8abc94fb8860eb` at 5/5 with no unresolved
threads. All server, workspace, serialized server, and browser suites
passed in CI. The build job hit a five-second timeout in a runner
transport test; both variants and the full 80-test file passed locally
with unchanged timeouts. The build passed on retry on the same commit
without code or timeout changes. All required CI gates, including the
final `ci / verify` and `ci / e2e` summaries, are green on
`7e57dc267a8446d3c906e3cc5b8abc94fb8860eb`.

## Risks

- Email from external senders can start normal agent work. Setup
recommends a low-trust agent and AgentMail sender controls. Sender
addresses never grant board membership.
- Provider timeouts can leave uncertain sends. Retries retain their
idempotency key; expired windows require reconciliation or operator
resolution.
- Connector skills and native tools are assignment-dependent and require
current access. Revocation denies retained calls; assignment changes
select a new runtime context.
- Activation remains behind the experimental-channel setting. The native
runner path has deterministic coverage; live Daytona qualification used
the Codex CLI adapter.
- Schema changes are additive. Inbox ownership is unique across
companies. Disconnect preserves provider inboxes and task history.

## Model Used

OpenAI GPT-6 (Codex). Used reasoning, repository tools, code execution,
and browser testing. The exact deployment model ID and context-window
size were not exposed in this session.

## Checklist

- [x] I have included a thinking path that traces from project context
to this change
- [x] I have specified the model used (with version and capability
details)
- [x] I have checked ROADMAP.md and confirmed this PR does not duplicate
planned core work
- [x] I have searched GitHub for duplicate or related PRs and linked
them above
- [x] I have either (a) linked existing issues with `Fixes: #` / `Closes
#` / `Refs #` OR (b) described the issue in-PR following the relevant
issue template
- [x] I have not referenced internal/instance-local Paperclip issues or
links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip`
URLs)
- [x] My branch name describes the change (e.g. `docs/...`, `fix/...`)
and contains no internal Paperclip ticket id or instance-derived details
- [x] I have run tests locally and they pass
- [x] I have added or updated tests where applicable
- [x] I have updated relevant documentation to reflect my changes
- [x] I have considered and documented any risks above
- [x] All Paperclip CI gates are green
- [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups
- [x] I will address all Greptile and reviewer comments before
requesting merge

---------

Co-authored-by: Paperclip <noreply@paperclip.ing>
2026-09-11 16:56:38 -05:00

12 KiB
Raw Blame History

AgentMail email connections

AgentMail is an experimental channel connection. Enable experimental chat connections, open Apps → AgentMail, select which humans and agents may use the credential, then enter an API key. In the saved connection’s Permissions page, choose Give an agent an email address. The three-step wizard selects an agent, creates or attaches an address, and reviews the setup. Selecting an agent outside the current allowed list adds that agent when setup completes. Every provider thread in that inbox has one Paperclip task. Subjects are not identifiers. The same email delivered to two connected inboxes creates two independent tasks.

Setup accepts an AgentMail API key or the saved company credential from another AgentMail connection. Organization and pod keys create an inbox-scoped runtime key. An existing inbox-scoped key can connect only its own inbox. Credentials are vaulted and resolved by the server; they are not passed to agents. An inbox can have only one non-archived Paperclip endpoint across the instance.

Verified custom domains are selectable after checking the API key. Complete DNS setup in AgentMail. Paperclip does not register domains or manage DNS.

The setup and Permissions page warn that an unrestricted inbox can receive mail from anyone. Configure sender allowlists in AgentMail; Paperclip does not manage or verify them. AgentMail controls new-message and reply lists separately. The wizard recommends Paperclip’s existing Low-trust review preset and lets the operator configure a project or root-task boundary. Incoming tasks are placed inside that boundary. Low-trust execution also requires isolated workspaces and an active sandbox environment selected for the agent; setup rejects an unavailable runtime. New inbound tasks request isolated execution. The trust preset itself does not sandbox filesystem or network access. Standard agents remain selectable with a warning.

Removing the assigned agent’s saved-connection access or revoking its credential grant stops receiving and sending. Connection creation saves the vaulted binding, human grants, and agent access in one database transaction.

Receiving and task lifecycle

WebSocket is the default and needs no public HTTP URL. The server authenticates with an Authorization header, keeping the provider key out of the connection URL (provider handshake). The service holds a renewable database lease, subscribes to the connected inbox, and reconnects with backoff. Webhook mode needs the configured public HTTPS webhook base URL. Setup registers a Paperclip-owned webhook. The raw request body is verified using Svix before the inbox is admitted to the shared durable delivery queue. The API key needs inbox-scoped webhook_create, webhook_read, and webhook_delete permissions in addition to mail access. AgentMail's "Send & read mail" preset alone cannot register a webhook. A rejected registration while switching from WebSocket leaves live receiving active.

Both transports deduplicate by inbox, event kind, and provider message ID. A per-conversation worker lease serializes work; independent conversations can proceed concurrently. Provider messages, comments, and attachment links preserve the provider message identity. A reply to a completed task reopens it. A cancelled task retains new mail but does not wake its agent. Provider-classified spam, blocked and unauthenticated mail do not start automatic work. Recognized automatic replies can be retained in an existing conversation but do not wake an agent or create a new task.

Activation establishes the intake cutoff. Activation, reconnect, and periodic maintenance scan paginated message metadata and fetch eligible messages using a receipt-time checkpoint with a five-minute overlap. Metadata scans traverse all pages because AgentMail sorts messages by the sender's timestamp: a newly received message can have an old Date header. Message-ID deduplication makes repeated scans safe. Earlier messages in a newly active thread are imported as context without separate historical wakeups. There is no automatic historical mailbox import and no assumption of WebSocket replay.

Incoming mail wakes the selected agent through its normal task execution path, including its configured permissions and budget controls. The external sender is recorded in the email envelope; an email address never grants Paperclip membership or board authority.

Explicit email actions

Internal comments, progress, final responses, approvals, and errors never send email. Email endpoints have an explicit publication mode; shared automatic chat publication paths exclude them. Sending email does not close a task.

The task displays the email envelope, extracted reply text, full text context, attachments, and delivery outcomes. Use the normal task conversation to ask the agent to send an email or reply. There is no separate email composer or mode switch. The agent uses an explicit email action; task messages themselves are not sent as email. Reply uses Reply-To when present, otherwise the sender; reply-all must be requested. Bcc is retained in the originating envelope but is not copied to reply inputs. Remote email images are not rendered. Attachments use Paperclip's content-type, size, company, and task bounds.

An agent must own the inbox, be assigned the source task, and supply the running source task's X-Paperclip-Run-Id at acceptance. Board actions require company write access. Configured action policies apply to both. Authority is checked again when the durable send executes. A new conversation creates its child task and immutable send intent in one transaction before contacting AgentMail.

All paths below are relative to /api:

Operation Path
Save credential and human/agent access POST /companies/:companyId/email/connections
Inspect a saved credential POST /companies/:companyId/email/connections/:connectionId/inspect
List authorized inboxes GET /companies/:companyId/email/inboxes
Inspect setup credentials (connection manager) POST /companies/:companyId/email/inspect
Create or attach an inbox (connection manager) POST /companies/:companyId/email/inboxes
Pause, resume, disconnect POST /email/inboxes/:endpointId/control
Replace credentials / receiving mode POST /email/inboxes/:endpointId/reconnect
Start an email child task or reply POST /companies/:companyId/email/send
Read the email context of a bound task GET /companies/:companyId/email/tasks/:issueId
Read delivery outcome GET /companies/:companyId/email/deliveries/:publicationId
Resolve an uncertain outcome (connection manager) POST /companies/:companyId/email/deliveries/:publicationId/resolve

A new send request:

{
  "endpointId": "<inbox-endpoint-uuid>",
  "parentIssueId": "<current-task-uuid>",
  "to": ["recipient@example.com"],
  "cc": [],
  "bcc": [],
  "subject": "Question about the proposal",
  "text": "Could you clarify the delivery date?",
  "attachmentIds": [],
  "idempotencyKey": "<new-request-uuid>"
}

A reply request uses conversationId and replyToMessageId from the bound task:

{
  "endpointId": "<inbox-endpoint-uuid>",
  "conversationId": "<email-conversation-uuid>",
  "replyToMessageId": "<provider-message-id>",
  "replyAll": false,
  "text": "Thanks, that answers the question.",
  "attachmentIds": [],
  "idempotencyKey": "<new-request-uuid>"
}

Native runners with an active, authorized inbox receive agentmail_inboxes, agentmail_read_thread, agentmail_send, and agentmail_delivery. The system also installs the AgentMail skill for those agents through the normal runtime skill path. These tools supply run authority and work independently of the optional generic runtime API rollout. Where enabled, search_api and call_api also expose these operations. The CLI uses the same authenticated operations and inherits the agent run ID:

paperclipai email inboxes
paperclipai email thread "$PAPERCLIP_TASK_ID"
paperclipai email send --file email-request.json
paperclipai email reply --file email-reply.json
paperclipai email delivery '<publication-uuid>'

A 202 response includes task, conversation, and publication IDs immediately. The publication progresses through queued, sent, delivered, failed, or uncertain. Delivery callbacks update that publication and do not create new correspondence. Retries reuse the same immutable request and provider idempotency key. The worker stops automatic retries after 23 hours, conservatively inside AgentMail's 24-hour deduplication window. An uncertain receipt can be resolved by matching its provider message ID and Paperclip publication header, or by an operator confirming that it was not sent. The latter marks it failed; any resend is a new explicit action. Do not change an idempotency key just because a request timed out.

Disconnect and diagnostics

Reconnect preserves inbox and task identity. Pause stops intake and sending. Disconnect archives the local endpoint and removes its credential bindings, unreferenced vaulted credentials, and only the webhook/runtime key created by Paperclip. It never deletes the provider inbox or task history. If a revoked key prevents provider cleanup, local disconnection still completes and reports that Paperclip's provider registrations need cleanup in AgentMail.

Connection settings show state, receiving mode, catch-up time and errors. Tasks show publication failures and uncertain delivery resolution. Delivery admission, message processing and agent wakeup are separate from provider delivery and model startup; live latency measurements must distinguish those stages.

Verification and live qualification

Deterministic coverage lives in server/src/__tests__/agentmail-api.test.ts, server/src/__tests__/email-channels.integration.test.ts, and tests/e2e/agentmail.spec.ts. It exercises real database transactions with a fake provider, plus browser setup and explicit task email actions.

Before labeling an installation live-qualified, use a disposable inbox and an approved test recipient. In each transport mode, receive a message, verify one task and one wake, send an explicit reply, and verify provider threading and delivery. Also disconnect/reconnect, interrupt receiving, and verify catch-up. Record provider message IDs and timestamps without copying credentials. Compare the durable delivery received_at with the wake request time separately from provider transit time and model startup. Automated fixtures do not constitute live provider qualification.

Provider references: inboxes, webhook verification, idempotency, message listing, reply API.

Sandbox execution

AgentMail runs in the Paperclip control plane using its vaulted credentials. It is a REST connection, not a local-stdio MCP server. The connection health check validates the key against AgentMail; it does not launch a local command or discover MCP tools.

Agents in Daytona and other sandbox environments use the same task email actions. The sandbox callback bridge allows inbox discovery, bound-thread reads, delivery reads, and explicit sends. The controller enforces company, inbox, task/run, and action-policy checks. Mailbox setup, credential inspection, reconnect, and manual delivery resolution remain outside that sandbox API surface. Native runners use the assigned AgentMail tools through their run-bound tool channel. Neither path exposes the AgentMail provider key to the sandbox.