mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-29 12:59:13 +01:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - Apps connections give agents governed access to external services through vault credentials, grants, action policies, the tool gateway, and audit. > - Unikraft Cloud runs unikernel micro-VMs, services, and volumes across regional metros, and it offers a sandbox plugin for commands and files. > - Unikraft is not in the catalog. It has no hosted MCP server, so the generic "Connect your own MCP server" flow cannot reach it. > - Daytona (#16483) added a native REST pattern for this case: a catalog generated from the provider's published OpenAPI specifications and executed through the gateway. > - This pull request adds Unikraft on that pattern and moves the shared native-provider code into one registry, so the shared connection code does not name each provider. > - The benefit is governed agent access to all published Unikraft actions, with the token kept in the vault and sent only to published Unikraft hosts. ## Linked Issues or Issue Description Refs #16483 **Problem or motivation** Teams that run workloads on Unikraft Cloud want their agents to list instances, read logs, deploy and scale services, and run commands in sandboxes. Unikraft is not in the Apps catalog. Unikraft has no hosted MCP server, so operators cannot connect it through the remote MCP flow. **Proposed solution** Add a native Unikraft connection. Generate its actions from Unikraft's official OpenAPI specifications for the platform API and the sandbox plugin. Pin the specifications to a reviewed commit. The operator connects an API token. The token stays in the vault and goes only to the five published metro hosts. Every action takes an optional metro. Actions without a metro use the connection's default metro, which the operator can change under Advanced. **Alternatives considered** A catalog-only AppDefinition was not possible because no hosted MCP endpoint exists. Wrapping the `unikraft` CLI was rejected because it would expose host filesystem behavior and CLI login state. A second copy of the Daytona bridge was rejected; the shared transport and catalog contract are now one module with a provider registry. **Roadmap alignment** This extends the existing Apps and Connections provider coverage. It uses the existing credential, grant, policy, gateway, and audit model. It does not overlap planned core work. ## What Changed - Added `scripts/generate-unikraft-tools.mjs` and its tests. The generator reads the platform and sandbox plugin specifications at commit `5dd107ea1cd8716b83cb86a83ed2a6ee46f99b5b`, resolves shared parameters, records source SHA-256 hashes, and writes `server/src/services/unikraft/operations.generated.json`. - The catalog has 105 actions: 89 platform operations and 16 sandbox plugin operations. The server-sent audit event stream is recorded in the inventory and is not advertised as an action. - Classification: GET operations and sandbox reads and waits are reads. Delete, stop, suspend, detach, unpin, and sandbox command execution, signals, and stdin are destructive. All other operations are writes. - Added `server/src/services/connectors/unikraft/client.ts` and its generated catalog. It validates arguments against the generated schemas, accepts only published metros, rejects path traversal, sends JSON bodies on GET and DELETE as the specification requires, and verifies the token with `GET /v1/users/quotas`. A sandbox wait that times out (documented HTTP 408) returns a still-running result instead of a failure. - Moved the bounded, credential-redacting HTTP sender and the catalog contract helpers from `daytona.ts` to `native-rest-client.ts`. Added `native-provider-catalogs.ts`. `tool-access.ts`, the `tool-access/catalog` and `token-broker` modules, `connectors/tool-policy.ts`, and `tool-gateway.ts` now use this registry instead of Daytona-specific checks. Daytona behavior does not change. - Added the Unikraft definition source, the generated definition, the brand mark and manifest entry, and the permission review (`liveProof: not-run`). - Added `doc/connections/UNIKRAFT.md` with a sequence diagram, endpoints, setup, actions, and limits. Updated the connections README, the permission audit, and both capability maps. - Tests: definition shape, database-backed gateway reads, writes, deletes, and sandbox commands for personal and shared grants, default and per-call metros, rejection of unpublished metros and traversal, Off policies, revocation, stale-contract blocking, credential export denial, schema validation for all actions, pinned-transport tests for GET and DELETE bodies, and a browser setup check. ## Verification - `pnpm exec vitest run packages/shared/src server/src/__tests__/unikraft-connection.test.ts server/src/__tests__/unikraft-http-boundary.test.ts server/src/__tests__/daytona-connection.test.ts server/src/__tests__/daytona-http-boundary.test.ts server/src/__tests__/tool-access-service.test.ts server/src/__tests__/tool-gateway-service.test.ts server/src/__tests__/tool-gateway.test.ts ui/src/pages/apps/AppsConnect.test.tsx ui/src/pages/apps/Browse.test.tsx ui/src/lib/app-brand-assets.test.ts` plus `connector-tool-policy` and `tool-catalog-publication`: all passed after the rebase onto the split tool-access modules. - `node --test scripts/generate-unikraft-tools.test.mjs scripts/generate-daytona-tools.test.mjs scripts/app-brand-validation.test.mjs`: 20 passed. - `node scripts/check-app-brand-assets.mjs`, `node scripts/check-maps.mjs`, and `git diff --check`: passed. - `pnpm --filter @paperclipai/shared typecheck`, `pnpm --filter @paperclipai/server typecheck`, and `pnpm --filter @paperclipai/ui typecheck`: clean. - `npx playwright test --config tests/e2e/playwright.config.ts tests/e2e/unikraft-connector.spec.ts tests/e2e/daytona-connector.spec.ts`: 2 passed. - `node scripts/generate-unikraft-tools.mjs` regenerates the committed catalog with the recorded hashes. - Manual: on a local instance, open Connectors, search for Unikraft, and select **Add key**. Confirm the icon, the password field, the key guidance, and the default metro select under **Change**. - Not verified: a real Unikraft account. Live provider read and write proof is pending. ## Risks - A Unikraft token acts for the whole organization in every metro. Unikraft offers no narrower token permissions. Assign only trusted agents and review action permissions. - Sandbox actions run arbitrary commands inside the selected instance. They are classified as destructive. - A timed-out write can still complete at the provider. The bridge does not retry writes automatically. - New metros fail closed until the specification is regenerated and reviewed. Legacy `*.kraft.cloud` hosts are not reachable. - The Daytona refactor moves code without behavior changes. All Daytona tests pass without edits. - The generated JSON snapshot is large because it holds the provider input contracts. No migration or lockfile change is required. ## Model Used - Claude Opus 5.5 (Anthropic), model ID `claude-opus-5-5`, 1M context window, used through Claude Code with tool use (shell, file editing, web research, browser tests). ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [ ] All Paperclip CI gates are green - [ ] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge
155 lines
9.6 KiB
TypeScript
155 lines
9.6 KiB
TypeScript
import { z } from "zod";
|
|
import { NATIVE_REST_MAX_BYTES as MAX_BYTES, nativeCatalog, nativeRestFailure as failure, nativeRestPathValue, nativeRestRecord as record,
|
|
nativeRestSender, type NativeCatalogEntry, type NativeRestRequest } from "./native-rest-client.js";
|
|
import catalog from "./daytona/operations.generated.json" with { type: "json" };
|
|
|
|
export const DAYTONA_API_URL = "https://app.daytona.io/api";
|
|
// Preserve the saved method identity when upgrading the earlier small catalog.
|
|
export const DAYTONA_METHOD = "workspace-diagnostics";
|
|
export type DaytonaRequest = NativeRestRequest;
|
|
type Operation = typeof catalog.tools[number];
|
|
const contract = nativeCatalog(catalog.tools);
|
|
|
|
export const DAYTONA_TOOLS = contract.tools;
|
|
export const isDaytonaToolName = contract.isToolName;
|
|
export const daytonaRisk = contract.risk;
|
|
export const isCurrentDaytonaCatalogEntry = (entry: NativeCatalogEntry) => contract.isCurrentEntry(entry);
|
|
|
|
export function isDaytonaConnection(connection: { transport: string; config?: Record<string, unknown> }) {
|
|
return connection.transport === "rest_api" && connection.config?.sourceTemplateKey === "daytona"
|
|
&& connection.config.connectionMethodKey === DAYTONA_METHOD && connection.config.url === DAYTONA_API_URL;
|
|
}
|
|
|
|
function pathValue(value: unknown) {
|
|
return nativeRestPathValue(value, () => failure(422, "daytona_arguments_invalid", "Invalid Daytona path argument."));
|
|
}
|
|
|
|
function decodeFile(value: unknown) {
|
|
if (typeof value !== "string" || value.length > Math.ceil(MAX_BYTES / 3) * 4
|
|
|| value.length % 4 !== 0 || /[^A-Za-z0-9+/=]/.test(value)) {
|
|
throw failure(422, "daytona_file_invalid", "File contents must be bounded base64 bytes.");
|
|
}
|
|
const bytes = Buffer.from(value, "base64");
|
|
if (bytes.toString("base64") !== value) throw failure(422, "daytona_file_invalid", "File contents must be canonical base64 bytes.");
|
|
return bytes;
|
|
}
|
|
|
|
/** A provider-focused REST bridge. It never reads host files, calls host shell
|
|
* commands, borrows provider-plugin credentials, or looks up Paperclip tasks. */
|
|
export function daytonaClient(headers: Record<string, string>, request: DaytonaRequest, pinnedOrganizationId?: unknown,
|
|
signal: AbortSignal = AbortSignal.timeout(30_000), deadlineAt: number = Date.now() + 30_000) {
|
|
const authorization = headers.Authorization;
|
|
if (!authorization || !/^Bearer [^\r\n]+$/.test(authorization)) {
|
|
throw failure(422, "daytona_credential_missing", "Reconnect Daytona to restore its API key.");
|
|
}
|
|
const { send: sendRequest, withinDeadline } = nativeRestSender({ provider: "Daytona", code: "daytona", authorization, request, signal, deadlineAt,
|
|
deniedMessage: "Daytona denied access. Check this key's organization and permissions. Some account operations require provider user authentication.",
|
|
fixedHeaders: { "X-Daytona-Source": "paperclip-connector" } });
|
|
const send = (url: string, init: RequestInit, organizationId?: string) =>
|
|
sendRequest(url, init, organizationId ? { "X-Daytona-Organization-ID": organizationId } : {});
|
|
|
|
async function identity() {
|
|
const value = record(await send(`${DAYTONA_API_URL}/api-keys/current`, { method: "GET" }));
|
|
const organizationId = value.organizationId;
|
|
if (!z.string().uuid().safeParse(organizationId).success || (pinnedOrganizationId && organizationId !== pinnedOrganizationId)) {
|
|
throw failure(403, "daytona_organization_mismatch", "The Daytona key does not identify the configured organization.");
|
|
}
|
|
return { organizationId: organizationId as string };
|
|
}
|
|
|
|
async function execute(operation: Operation, parameters: Record<string, unknown>) {
|
|
const account = await identity();
|
|
let base = DAYTONA_API_URL;
|
|
if (operation.kind === "toolbox") {
|
|
const sandbox = record(await send(`${DAYTONA_API_URL}/sandbox/${pathValue(parameters.sandboxId)}`, { method: "GET" }, account.organizationId));
|
|
if (!z.string().uuid().safeParse(sandbox.id).success || sandbox.organizationId !== account.organizationId
|
|
|| (sandbox.id !== parameters.sandboxId && sandbox.name !== parameters.sandboxId)) {
|
|
throw failure(403, "daytona_workspace_mismatch", "Daytona returned a sandbox outside the selected account or target.");
|
|
}
|
|
let proxyValue = sandbox.toolboxProxyUrl;
|
|
if (!proxyValue) proxyValue = record(await send(`${DAYTONA_API_URL}/sandbox/${pathValue(sandbox.id)}/toolbox-proxy-url`, { method: "GET" }, account.organizationId)).url;
|
|
let proxy: URL;
|
|
try { proxy = new URL(String(proxyValue)); }
|
|
catch { throw failure(502, "daytona_proxy_invalid", "Daytona returned an invalid toolbox address."); }
|
|
if (proxy.protocol !== "https:" || !/^proxy(?:-[a-z0-9-]+)?\.app\.daytona\.io$/.test(proxy.hostname)
|
|
|| proxy.username || proxy.password || (proxy.port && proxy.port !== "443")
|
|
|| !/^\/toolbox\/?$/.test(proxy.pathname) || proxy.search || proxy.hash) {
|
|
throw failure(502, "daytona_proxy_invalid", "Daytona returned an unrecognized toolbox address. No credentials were forwarded.");
|
|
}
|
|
base = `${proxy.origin}/toolbox/${pathValue(sandbox.id)}`;
|
|
}
|
|
const route = operation.path.replace(/\{([^}]+)\}/g, (_match, key: string) => pathValue(record(parameters.path)[key]));
|
|
const url = new URL(base + route);
|
|
const projectedHeaders: Record<string, string> = {};
|
|
for (const parameter of operation.parameters) {
|
|
if (parameter.group === "path") continue;
|
|
const value = record(parameters[parameter.group])[parameter.name];
|
|
if (value === undefined || value === null) continue;
|
|
if (parameter.group === "headers") {
|
|
const text = String(value);
|
|
if (/[\r\n]/.test(text)) throw failure(422, "daytona_arguments_invalid", "Invalid Daytona header argument.");
|
|
projectedHeaders[parameter.name] = text;
|
|
} else if (parameter.json || (value && typeof value === "object" && !Array.isArray(value))) {
|
|
if (parameter.style === "deepObject") {
|
|
for (const [key, child] of Object.entries(record(value))) {
|
|
if (Array.isArray(child)) child.forEach(item => url.searchParams.append(`${parameter.name}[${key}]`, String(item)));
|
|
else url.searchParams.append(`${parameter.name}[${key}]`, String(child));
|
|
}
|
|
} else url.searchParams.append(parameter.name, JSON.stringify(value));
|
|
} else if (Array.isArray(value)) {
|
|
if (parameter.explode) value.forEach(item => url.searchParams.append(parameter.name, String(item)));
|
|
else url.searchParams.append(parameter.name, value.join(parameter.style === "spaceDelimited" ? " " : parameter.style === "pipeDelimited" ? "|" : ","));
|
|
} else url.searchParams.append(parameter.name, String(value));
|
|
}
|
|
let body: BodyInit | undefined;
|
|
if (operation.bodyContentType === "multipart/form-data") {
|
|
const form = new FormData();
|
|
if (Array.isArray(parameters.files)) {
|
|
let total = 0;
|
|
for (const item of parameters.files) {
|
|
const file = record(item), bytes = decodeFile(file.contentBase64);
|
|
total += bytes.length;
|
|
if (total > MAX_BYTES) throw failure(422, "daytona_input_limit", "The total upload exceeds the limit.");
|
|
form.append("files", new Blob([bytes]), String(file.path));
|
|
}
|
|
} else {
|
|
for (const [key, value] of Object.entries(record(parameters.body))) {
|
|
if (key === "file") form.append(key, new Blob([decodeFile(value)]), "upload");
|
|
else form.append(key, String(value));
|
|
}
|
|
}
|
|
// The guarded, DNS-pinned transport accepts bytes, not FormData. Use the
|
|
// platform encoder to serialize parts and its matching boundary header.
|
|
const encoded = new Request(DAYTONA_API_URL, { method: "POST", body: form });
|
|
body = Buffer.from(await withinDeadline(() => encoded.arrayBuffer()));
|
|
if (body.byteLength > MAX_BYTES) throw failure(422, "daytona_input_limit", "The multipart upload exceeds the limit.");
|
|
projectedHeaders["Content-Type"] = encoded.headers.get("Content-Type")!;
|
|
} else if (parameters.body !== undefined) {
|
|
body = JSON.stringify(parameters.body);
|
|
if (Buffer.byteLength(body) > MAX_BYTES) throw failure(422, "daytona_input_limit", "The request body exceeds the limit.");
|
|
projectedHeaders["Content-Type"] = operation.bodyContentType === "*/*" ? "application/json" : operation.bodyContentType ?? "application/json";
|
|
}
|
|
// No automatic retry. A transport failure cannot prove a write did not run.
|
|
return send(url.toString(), { method: operation.method, headers: projectedHeaders, body }, account.organizationId);
|
|
}
|
|
return { probe: identity, execute };
|
|
}
|
|
|
|
type Binding = { companyId: string; agentId: string | null; runId?: string | null; responsibleUserId?: string | null };
|
|
type Connection = { companyId: string; config: Record<string, unknown> };
|
|
export async function executeDaytonaTool(input: {
|
|
binding: Binding; connection: Connection; headers: Record<string, string>;
|
|
request: DaytonaRequest; toolName: string; parameters: unknown;
|
|
signal?: AbortSignal;
|
|
deadlineAt?: number;
|
|
}) {
|
|
if (!input.binding.agentId || input.connection.companyId !== input.binding.companyId) {
|
|
throw failure(404, "daytona_connection_not_found", "Connection not found.");
|
|
}
|
|
const operation = contract.operation(input.toolName);
|
|
if (!operation) throw failure(404, "daytona_tool_not_found", "Daytona action not found.");
|
|
if (!contract.validate(operation.name, input.parameters)) throw failure(422, "daytona_arguments_invalid", "Invalid Daytona action arguments.");
|
|
const config = record(input.connection.config.methodConfig);
|
|
return daytonaClient(input.headers, input.request, config.organizationId, input.signal, input.deadlineAt).execute(operation, record(input.parameters));
|
|
}
|