mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-27 02:44:50 +01:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - Agent adapters are the boundary between the control plane and the runtimes that actually do work. > - Hermes support needs to be available as first-class local and gateway adapters while still preserving the adapter-manager override path for external packages. > - The adapter work touches runtime execution, UI adapter metadata, onboarding prompts, scoped credentials, release packaging, and smoke coverage, so the handoff needs concrete verification rather than only unit tests. > - This pull request adds built-in Hermes local and Hermes gateway support, keeps external adapter overrides compatible, and documents/tests the gateway flow end to end. > - The benefit is that operators can hire Hermes-backed agents without a manual plugin install, while self-hosted installs can still override/shadow the built-ins through Adapter manager packages. ## Linked Issues or Issue Description No public GitHub issue exists for this exact Hermes built-in adapter, gateway onboarding, and release-source work. Problem description: - Hermes local and gateway adapters need a public, reviewable source path in the monorepo so package artifacts and built-in adapter behavior match the application source. - Operators need built-in `hermes_local` and `hermes_gateway` adapter choices without losing the ability to install external Hermes packages as overrides. - Gateway onboarding needs secure defaults for API server URLs, API keys, and generated agent setup text. - Hermes-originated task bridge credentials need narrower API-key scope configuration. - Related public PRs found during duplicate search include #3027, #2363, #7544, #7950, #8095, and #8543. ## What Changed - Added the unified Hermes adapter package with local and gateway server/UI/CLI exports, config schemas, transcript parsing, model detection, and package metadata. - Registered `hermes_local` and `hermes_gateway` as built-in adapters across shared constants, server registries, CLI packaging, and UI adapter registries. - Kept the external adapter override path compatible so installed Hermes packages can shadow built-ins and restore the built-in parser when disabled. - Added Hermes gateway onboarding docs, board-operator docs, Docker smoke assets, and shell smoke harnesses for join/e2e validation. - Added scoped task-bridge API-key support, authorization checks, issue-origin handling, and tests for Hermes-created Paperclip tasks. - Hardened gateway transport and redaction behavior for API keys, headers, session data, and smoke diagnostics. - Updated release packaging/bootstrap checks for the Hermes packages while leaving `pnpm-lock.yaml` out of the PR per repository policy. ## Verification Targeted local verification recorded before PR handoff: - `pnpm --filter @paperclipai/hermes-paperclip-adapter exec vitest run src/gateway/server/execute.test.ts` — 14/14 passed. - `pnpm test:hermes-gateway-smoke` — 6/6 passed. - Hermes package typecheck/build checks passed. - Focused server/UI adapter tests passed — 31/31. - Release helper Node tests passed — 18/18. - `git diff --check origin/master..HEAD` passed. Fresh Docker E2E smoke evidence: - Ran `pnpm smoke:hermes-gateway-e2e` on 2026-06-26 with a fresh state directory and fresh Docker container against a live Paperclip dev server. - Hermes direct execution reached `completed`. - Hermes stop/cancel path reached `cancelled`. - Hermes gateway created a Paperclip task, Paperclip ran the Hermes agent, and the task reached `done` with the expected marker response. - Temporary board auth keys, token files, smoke state, and Docker containers were cleaned up after the run. PR checks on head `b5eae40ce`: - GitHub Actions passed: `policy`, `review`, `Typecheck + Release Registry`, all general test shards, all serialized server shards, `Build`, `Canary Dry Run`, `e2e`, and aggregate `verify`. - External checks passed: Snyk and Socket Project Report. - External Socket Pull Request Alerts remained pending after the first-party CI matrix completed. ## Risks - Medium risk: this spans adapter registration, package publishing, gateway execution, onboarding docs, API-key scoping, and UI adapter metadata. - Migration risk is low: the scope-config migration adds a nullable column and does not rewrite existing keys. - Gateway execution depends on operator-provided Hermes API configuration; the smoke covers the Docker gateway path but real deployments may differ by network/auth setup. - Direct Greptile review on the latest expanded diff is file-count limited, although the commitperclip review gate passed. > For core feature work, check [`ROADMAP.md`](ROADMAP.md) first and discuss it in `#dev` before opening the PR. Feature PRs that overlap with planned core work may need to be redirected — check the roadmap first. See `CONTRIBUTING.md`. ## Model Used OpenAI Codex, GPT-5 coding agent, tool use enabled in a local repository workspace. Context window size is not exposed in this environment. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Commitperclip review gate is green; direct Greptile review is file-count limited on the latest expanded diff - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
409 lines
11 KiB
Markdown
409 lines
11 KiB
Markdown
---
|
|
title: External Adapters
|
|
summary: Build, package, and distribute adapters as plugins without modifying Paperclip source
|
|
---
|
|
|
|
Paperclip supports external adapter plugins that can be installed from npm packages or local directories. External adapters work exactly like built-in adapters — they execute agents, parse output, and render transcripts — but they live in their own package and don't require changes to Paperclip's source code.
|
|
|
|
## Built-in vs External
|
|
|
|
| | Built-in | External |
|
|
|---|---|---|
|
|
| Source location | Inside `paperclip-fork/packages/adapters/` | Separate npm package or local directory |
|
|
| Registration | Hardcoded in three registries | Loaded at startup via plugin system |
|
|
| UI parser | Static import at build time | Dynamically loaded from API (see [UI Parser](/adapters/adapter-ui-parser)) |
|
|
| Distribution | Ships with Paperclip | Published to npm or linked via `file:` |
|
|
| Updates | Requires Paperclip release | Independent versioning |
|
|
|
|
### Built-in Hermes compatibility note
|
|
|
|
Hermes is built in with two stable adapter type keys:
|
|
|
|
- `hermes_local` starts the local Hermes CLI from
|
|
`@paperclipai/hermes-paperclip-adapter`.
|
|
- `hermes_gateway` calls an already-running Hermes API server through
|
|
`@paperclipai/hermes-paperclip-adapter/gateway`.
|
|
|
|
The legacy `@paperclipai/adapter-hermes-gateway` package is a deprecated
|
|
compatibility shim for one release. It preserves the old gateway exports while
|
|
forwarding to the unified Hermes package. New external override packages should
|
|
depend on or link `@paperclipai/hermes-paperclip-adapter` and declare the type
|
|
they override (`hermes_local` or `hermes_gateway`); the type keys did not
|
|
change.
|
|
|
|
## Quick Start
|
|
|
|
### Minimal Package Structure
|
|
|
|
```
|
|
my-adapter/
|
|
package.json
|
|
tsconfig.json
|
|
src/
|
|
index.ts # Shared metadata (type, label, models)
|
|
server/
|
|
index.ts # createServerAdapter() factory
|
|
execute.ts # Core execution logic
|
|
parse.ts # Output parsing
|
|
test.ts # Environment diagnostics
|
|
ui-parser.ts # Self-contained UI transcript parser
|
|
```
|
|
|
|
### package.json
|
|
|
|
```json
|
|
{
|
|
"name": "my-paperclip-adapter",
|
|
"version": "1.0.0",
|
|
"type": "module",
|
|
"license": "MIT",
|
|
"paperclip": {
|
|
"adapterUiParser": "1.0.0"
|
|
},
|
|
"exports": {
|
|
".": "./dist/index.js",
|
|
"./server": "./dist/server/index.js",
|
|
"./ui-parser": "./dist/ui-parser.js"
|
|
},
|
|
"files": ["dist"],
|
|
"scripts": {
|
|
"build": "tsc"
|
|
},
|
|
"dependencies": {
|
|
"@paperclipai/adapter-utils": "^2026.325.0",
|
|
"picocolors": "^1.1.0"
|
|
},
|
|
"devDependencies": {
|
|
"@types/node": "^22.0.0",
|
|
"typescript": "^5.7.0"
|
|
}
|
|
}
|
|
```
|
|
|
|
Key fields:
|
|
|
|
| Field | Purpose |
|
|
|-------|---------|
|
|
| `exports["."]` | Entry point — must export `createServerAdapter` |
|
|
| `exports["./ui-parser"]` | Self-contained UI parser module (optional but recommended) |
|
|
| `paperclip.adapterUiParser` | Contract version for the UI parser (`"1.0.0"`) |
|
|
| `files` | Limits what gets published — only `dist/` |
|
|
|
|
### tsconfig.json
|
|
|
|
```json
|
|
{
|
|
"compilerOptions": {
|
|
"target": "ES2022",
|
|
"module": "Node16",
|
|
"moduleResolution": "Node16",
|
|
"outDir": "dist",
|
|
"rootDir": "src",
|
|
"declaration": true,
|
|
"strict": true,
|
|
"esModuleInterop": true,
|
|
"skipLibCheck": true
|
|
},
|
|
"include": ["src"]
|
|
}
|
|
```
|
|
|
|
## Server Module
|
|
|
|
The plugin loader calls `createServerAdapter()` from your package root. This function must return a `ServerAdapterModule`.
|
|
|
|
### src/index.ts
|
|
|
|
```ts
|
|
export const type = "my_adapter"; // snake_case, globally unique
|
|
export const label = "My Agent (local)";
|
|
|
|
export const models = [
|
|
{ id: "model-a", label: "Model A" },
|
|
];
|
|
|
|
export const agentConfigurationDoc = `# my_adapter configuration
|
|
Use when: ...
|
|
Don't use when: ...
|
|
`;
|
|
|
|
// Required by plugin-loader convention
|
|
export { createServerAdapter } from "./server/index.js";
|
|
```
|
|
|
|
### src/server/index.ts
|
|
|
|
```ts
|
|
import type { ServerAdapterModule } from "@paperclipai/adapter-utils";
|
|
import { type, models, agentConfigurationDoc } from "../index.js";
|
|
import { execute } from "./execute.js";
|
|
import { testEnvironment } from "./test.js";
|
|
|
|
export function createServerAdapter(): ServerAdapterModule {
|
|
return {
|
|
type,
|
|
execute,
|
|
testEnvironment,
|
|
models,
|
|
agentConfigurationDoc,
|
|
};
|
|
}
|
|
```
|
|
|
|
### src/server/execute.ts
|
|
|
|
The core execution function. Receives an `AdapterExecutionContext` and returns an `AdapterExecutionResult`.
|
|
|
|
```ts
|
|
import type {
|
|
AdapterExecutionContext,
|
|
AdapterExecutionResult,
|
|
} from "@paperclipai/adapter-utils";
|
|
|
|
import {
|
|
runChildProcess,
|
|
buildPaperclipEnv,
|
|
renderTemplate,
|
|
} from "@paperclipai/adapter-utils/server-utils";
|
|
|
|
export async function execute(
|
|
ctx: AdapterExecutionContext,
|
|
): Promise<AdapterExecutionResult> {
|
|
const { config, agent, runtime, context, onLog, onMeta } = ctx;
|
|
|
|
// 1. Read config with safe helpers
|
|
const cwd = String(config.cwd ?? "/tmp");
|
|
const command = String(config.command ?? "my-agent");
|
|
const timeoutSec = Number(config.timeoutSec ?? 300);
|
|
|
|
// 2. Build environment with Paperclip vars injected
|
|
const env = buildPaperclipEnv(agent);
|
|
|
|
// 3. Render prompt template
|
|
const prompt = config.promptTemplate
|
|
? renderTemplate(String(config.promptTemplate), {
|
|
agentId: agent.id,
|
|
agentName: agent.name,
|
|
companyId: agent.companyId,
|
|
runId: ctx.runId,
|
|
taskId: context.taskId ?? "",
|
|
taskTitle: context.taskTitle ?? "",
|
|
})
|
|
: "Continue your work.";
|
|
|
|
// 4. Spawn process
|
|
const result = await runChildProcess(command, {
|
|
args: [prompt],
|
|
cwd,
|
|
env,
|
|
timeout: timeoutSec * 1000,
|
|
graceMs: 10_000,
|
|
onStdout: (chunk) => onLog("stdout", chunk),
|
|
onStderr: (chunk) => onLog("stderr", chunk),
|
|
});
|
|
|
|
// 5. Return structured result
|
|
return {
|
|
exitCode: result.exitCode,
|
|
timedOut: result.timedOut,
|
|
// Include session state for persistence
|
|
sessionParams: { /* ... */ },
|
|
};
|
|
}
|
|
```
|
|
|
|
#### Available Helpers from `@paperclipai/adapter-utils`
|
|
|
|
| Helper | Purpose |
|
|
|--------|---------|
|
|
| `runChildProcess(command, opts)` | Spawn a child process with timeout, grace period, and streaming callbacks |
|
|
| `buildPaperclipEnv(agent)` | Inject `PAPERCLIP_*` environment variables |
|
|
| `renderTemplate(template, data)` | `{{variable}}` substitution in prompt templates |
|
|
| `asString(v)`, `asNumber(v)`, `asBoolean(v)` | Safe config value extraction |
|
|
|
|
### src/server/test.ts
|
|
|
|
Validates the adapter configuration before running. Returns structured diagnostics.
|
|
|
|
```ts
|
|
import type {
|
|
AdapterEnvironmentTestContext,
|
|
AdapterEnvironmentTestResult,
|
|
} from "@paperclipai/adapter-utils";
|
|
|
|
export async function testEnvironment(
|
|
ctx: AdapterEnvironmentTestContext,
|
|
): Promise<AdapterEnvironmentTestResult> {
|
|
const checks = [];
|
|
|
|
// Example: check CLI is installed
|
|
checks.push({
|
|
level: "info",
|
|
message: "My Agent CLI v1.2.0 detected",
|
|
code: "cli_detected",
|
|
});
|
|
|
|
// Example: check working directory
|
|
const cwd = String(ctx.config.cwd ?? "");
|
|
if (!cwd.startsWith("/")) {
|
|
checks.push({
|
|
level: "error",
|
|
message: `Working directory must be absolute: "${cwd}"`,
|
|
hint: "Use /home/user/project or /workspace",
|
|
code: "invalid_cwd",
|
|
});
|
|
}
|
|
|
|
return {
|
|
adapterType: ctx.adapterType,
|
|
status: checks.some(c => c.level === "error") ? "fail" : "pass",
|
|
checks,
|
|
testedAt: new Date().toISOString(),
|
|
};
|
|
}
|
|
```
|
|
|
|
Check levels:
|
|
|
|
| Level | Meaning | Effect |
|
|
|-------|---------|--------|
|
|
| `info` | Informational | Shown in test results |
|
|
| `warn` | Non-blocking issue | Shown with yellow indicator |
|
|
| `error` | Blocks execution | Prevents agent from running |
|
|
|
|
## Installation
|
|
|
|
### From npm
|
|
|
|
```sh
|
|
# Via the Paperclip UI
|
|
# Settings → Adapters → Install from npm → "my-paperclip-adapter"
|
|
|
|
# Or via API
|
|
curl -X POST http://localhost:3102/api/adapters \
|
|
-H "Authorization: Bearer <token>" \
|
|
-H "Content-Type: application/json" \
|
|
-d '{"packageName": "my-paperclip-adapter"}'
|
|
```
|
|
|
|
### From local directory
|
|
|
|
```sh
|
|
curl -X POST http://localhost:3102/api/adapters \
|
|
-H "Authorization: Bearer <token>" \
|
|
-H "Content-Type: application/json" \
|
|
-d '{"localPath": "/home/user/my-adapter"}'
|
|
```
|
|
|
|
Local adapters are symlinked into Paperclip's adapter directory. Changes to the source are picked up on server restart.
|
|
|
|
### Via adapter-plugins.json
|
|
|
|
For development, you can also edit `~/.paperclip/adapter-plugins.json` directly:
|
|
|
|
```json
|
|
[
|
|
{
|
|
"packageName": "my-paperclip-adapter",
|
|
"localPath": "/home/user/my-adapter",
|
|
"type": "my_adapter",
|
|
"installedAt": "2026-03-30T12:00:00.000Z"
|
|
}
|
|
]
|
|
```
|
|
|
|
## Optional: Session Persistence
|
|
|
|
If your agent runtime supports sessions (conversation continuity across heartbeats), implement a session codec:
|
|
|
|
```ts
|
|
import type { AdapterSessionCodec } from "@paperclipai/adapter-utils";
|
|
|
|
export const sessionCodec: AdapterSessionCodec = {
|
|
deserialize(raw) {
|
|
if (typeof raw !== "object" || raw === null) return null;
|
|
const r = raw as Record<string, unknown>;
|
|
return r.sessionId ? { sessionId: String(r.sessionId) } : null;
|
|
},
|
|
serialize(params) {
|
|
return params?.sessionId ? { sessionId: String(params.sessionId) } : null;
|
|
},
|
|
getDisplayId(params) {
|
|
return params?.sessionId ? String(params.sessionId) : null;
|
|
},
|
|
};
|
|
```
|
|
|
|
Include it in `createServerAdapter()`:
|
|
|
|
```ts
|
|
return { type, execute, testEnvironment, sessionCodec, /* ... */ };
|
|
```
|
|
|
|
## Optional: Skills Sync
|
|
|
|
If your agent runtime supports skills/plugins, implement `listSkills` and `syncSkills`:
|
|
|
|
```ts
|
|
return {
|
|
type,
|
|
execute,
|
|
testEnvironment,
|
|
async listSkills(ctx) {
|
|
return {
|
|
adapterType: ctx.adapterType,
|
|
supported: true,
|
|
mode: "ephemeral",
|
|
desiredSkills: [],
|
|
entries: [],
|
|
warnings: [],
|
|
};
|
|
},
|
|
async syncSkills(ctx, desiredSkills) {
|
|
// Install desired skills into the runtime
|
|
return { /* same shape as listSkills */ };
|
|
},
|
|
};
|
|
```
|
|
|
|
## Optional: Model Detection
|
|
|
|
If your runtime has a local config file that specifies the default model:
|
|
|
|
```ts
|
|
async function detectModel() {
|
|
// Read ~/.my-agent/config.yaml or similar
|
|
return {
|
|
model: "anthropic/claude-sonnet-4",
|
|
provider: "anthropic",
|
|
source: "~/.my-agent/config.yaml",
|
|
candidates: ["anthropic/claude-sonnet-4", "openai/gpt-4o"],
|
|
};
|
|
}
|
|
|
|
return { type, execute, testEnvironment, detectModel: () => detectModel() };
|
|
```
|
|
|
|
## Publishing
|
|
|
|
```sh
|
|
npm run build
|
|
npm publish
|
|
```
|
|
|
|
Other Paperclip users can then install your adapter by package name from the UI or API.
|
|
|
|
## Security
|
|
|
|
- Treat agent output as untrusted — parse defensively, never `eval()` agent output
|
|
- Inject secrets via environment variables, not in prompts
|
|
- Configure network access controls if the runtime supports them
|
|
- Always enforce timeout and grace period — don't let agents run forever
|
|
- The UI parser module runs in a browser sandbox — it must have zero runtime imports and no side effects
|
|
|
|
## Next Steps
|
|
|
|
- [UI Parser Contract](/adapters/adapter-ui-parser) — add a custom run-log parser so the UI renders your adapter's output correctly
|
|
- [Creating an Adapter](/adapters/creating-an-adapter) — full walkthrough of adapter internals
|
|
- [How Agents Work](/guides/agent-developer/how-agents-work) — understand the heartbeat lifecycle your adapter serves
|