mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-24 18:19:05 +02:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work > - Sandbox providers carry agent work through controlled execution channels > - The Daytona callback bridge uses a bespoke line-framed protocol over its duplex channel > - The bespoke protocol adds framing work and does not use the Node transport that already supports multiplexed streams > - This pull request carries raw bytes across the channel, adds a Node HTTP/2 bridge, and selects it for Daytona > - The benefit is one authenticated, multiplexed callback session with queue_v1 as the bounded fallback ## Linked Issues or Issue Description **Subsystem affected** The packages/plugins Daytona provider and the shared duplex execution path. **Problem or motivation** The Daytona callback bridge uses a bespoke line-framed protocol over the provider duplex channel. This adds protocol work and limits stream handling. **Proposed solution** Carry raw bytes through the cross-layer channel. Add an authenticated Node HTTP/2 host server and sandbox client gateway. Select http2_v1 for Daytona and retain queue_v1 as the fallback. **Alternatives considered** Keep the current duplex_v1 protocol. This keeps the bespoke framing path and does not provide one HTTP/2 session for callback streams. **Roadmap alignment** ROADMAP.md lists Daytona under cloud and sandbox agents. This change improves the shipped Daytona provider path. **Additional context** The branch adds no dependency. Node 24 provides the http2 module. The host token check and canonical path parser remain the single dispatch path. ## What Changed - Carry raw Uint8Array chunks through the adapter, plugin, worker, runtime, and Daytona layers. - Encode bytes as base64 only across the JSON-RPC hop, because JSON has no binary type. - Add the bounded host HTTP/2 server and the in-sandbox HTTP/2 client gateway. - Authenticate every stream with the per-run bridge token before route work. - Parse the path once and reuse the canonical result for route and forwarding work. - Select http2_v1 for Daytona and fall back once to queue_v1 when the client preface is absent. - Add transport, session, stream, and fallback telemetry. - Mark HTTP/2 as the preferred transport and queue_v1 as the soft-deprecated fallback. ## Verification - `npx vitest run packages/adapter-utils/src` — 990 passed and 4 skipped. - `npx vitest run server/src/__tests__/plugin-worker-manager-duplex.test.ts` — 32 passed. - `npx vitest run --config packages/plugins/sandbox-providers/daytona/vitest.config.ts` — 220 passed and 6 skipped. - `npx tsc --noEmit` in `packages/adapter-utils`, `packages/shared`, `packages/plugins/sdk`, and `server` — clean. - No `package.json` or `pnpm-lock.yaml` file changed. - The live Daytona test skips when `DAYTONA_API_KEY` is absent. - The root `npx tsc --noEmit` command has a pre-existing missing `packages/adapters/droid-local` reference on this branch and on `master`. ## Risks - The transport change affects several duplex layers and could expose byte-boundary errors. - A missing HTTP/2 client preface falls back once to queue_v1 and records `preface_missing`. - The host token check and canonical path parser must remain on the shared dispatch path. - The live Daytona test needs `DAYTONA_API_KEY` and does not run in this agent sandbox. ## Model Used OpenAI GPT-5, tool-enabled coding agent with repository inspection, GitHub CLI, and shell execution. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Paperclip <noreply@paperclip.ing>
442 lines
12 KiB
TypeScript
442 lines
12 KiB
TypeScript
/**
|
|
* `@paperclipai/plugin-sdk` — Paperclip plugin worker-side SDK.
|
|
*
|
|
* This is the main entrypoint for plugin worker code. For plugin UI bundles,
|
|
* import from `@paperclipai/plugin-sdk/ui` instead.
|
|
*
|
|
* @example
|
|
* ```ts
|
|
* // Plugin worker entrypoint (dist/worker.ts)
|
|
* import { definePlugin, runWorker, z } from "@paperclipai/plugin-sdk";
|
|
*
|
|
* const plugin = definePlugin({
|
|
* async setup(ctx) {
|
|
* ctx.logger.info("Plugin starting up");
|
|
*
|
|
* ctx.events.on("issue.created", async (event) => {
|
|
* ctx.logger.info("Issue created", { issueId: event.entityId });
|
|
* });
|
|
*
|
|
* ctx.jobs.register("full-sync", async (job) => {
|
|
* ctx.logger.info("Starting full sync", { runId: job.runId });
|
|
* // ... sync implementation
|
|
* });
|
|
*
|
|
* ctx.data.register("sync-health", async ({ companyId }) => {
|
|
* const state = await ctx.state.get({
|
|
* scopeKind: "company",
|
|
* scopeId: String(companyId),
|
|
* stateKey: "last-sync-at",
|
|
* });
|
|
* return { lastSync: state };
|
|
* });
|
|
* },
|
|
*
|
|
* async onHealth() {
|
|
* return { status: "ok" };
|
|
* },
|
|
* });
|
|
*
|
|
* export default plugin;
|
|
* runWorker(plugin, import.meta.url);
|
|
* ```
|
|
*
|
|
* @see PLUGIN_SPEC.md §14 — SDK Surface
|
|
* @see PLUGIN_SPEC.md §29.2 — SDK Versioning
|
|
*/
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Main factory
|
|
// ---------------------------------------------------------------------------
|
|
|
|
export { definePlugin } from "./define-plugin.js";
|
|
export { createTestHarness, createEnvironmentTestHarness, createFakeEnvironmentDriver, filterEnvironmentEvents, assertEnvironmentEventOrder, assertLeaseLifecycle, assertWorkspaceRealizationLifecycle, assertExecutionLifecycle, assertEnvironmentError } from "./testing.js";
|
|
export { createPluginBundlerPresets } from "./bundlers.js";
|
|
export { startPluginDevServer, getUiBuildSnapshot } from "./dev-server.js";
|
|
export { startWorkerRpcHost, runWorker } from "./worker-rpc-host.js";
|
|
export {
|
|
createHostClientHandlers,
|
|
getRequiredCapability,
|
|
CapabilityDeniedError,
|
|
InvocationScopeDeniedError,
|
|
} from "./host-client-factory.js";
|
|
|
|
// JSON-RPC protocol helpers and constants
|
|
export {
|
|
JSONRPC_VERSION,
|
|
JSONRPC_ERROR_CODES,
|
|
PLUGIN_RPC_ERROR_CODES,
|
|
HOST_TO_WORKER_REQUIRED_METHODS,
|
|
HOST_TO_WORKER_OPTIONAL_METHODS,
|
|
MESSAGE_DELIMITER,
|
|
createRequest,
|
|
createSuccessResponse,
|
|
createErrorResponse,
|
|
createNotification,
|
|
isJsonRpcRequest,
|
|
isJsonRpcNotification,
|
|
isJsonRpcResponse,
|
|
isJsonRpcSuccessResponse,
|
|
isJsonRpcErrorResponse,
|
|
serializeMessage,
|
|
parseMessage,
|
|
JsonRpcParseError,
|
|
JsonRpcCallError,
|
|
LOGIN_PTY_OUTPUT_NOTIFICATION,
|
|
LOGIN_PTY_EXIT_NOTIFICATION,
|
|
DUPLEX_CHANNEL_DATA_NOTIFICATION,
|
|
DUPLEX_CHANNEL_EXIT_NOTIFICATION,
|
|
encodeChannelBytes,
|
|
decodeChannelBytes,
|
|
_resetIdCounter,
|
|
} from "./protocol.js";
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Type exports
|
|
// ---------------------------------------------------------------------------
|
|
|
|
// Plugin definition and lifecycle types
|
|
export type {
|
|
PluginDefinition,
|
|
PaperclipPlugin,
|
|
PluginHealthDiagnostics,
|
|
PluginConfigChangeContext,
|
|
PluginConfigValidationResult,
|
|
PluginWebhookInput,
|
|
PluginApiRequestInput,
|
|
PluginApiResponse,
|
|
} from "./define-plugin.js";
|
|
export type {
|
|
TestHarness,
|
|
TestHarnessOptions,
|
|
TestHarnessLogEntry,
|
|
EnvironmentTestHarness,
|
|
EnvironmentTestHarnessOptions,
|
|
EnvironmentEventRecord,
|
|
FakeEnvironmentDriverOptions,
|
|
} from "./testing.js";
|
|
export type {
|
|
PluginBundlerPresetInput,
|
|
PluginBundlerPresets,
|
|
EsbuildLikeOptions,
|
|
RollupLikeConfig,
|
|
} from "./bundlers.js";
|
|
export type { PluginDevServer, PluginDevServerOptions } from "./dev-server.js";
|
|
export type {
|
|
WorkerRpcHostOptions,
|
|
WorkerRpcHost,
|
|
RunWorkerOptions,
|
|
} from "./worker-rpc-host.js";
|
|
export type {
|
|
HostServices,
|
|
HostClientFactoryOptions,
|
|
HostClientHandlers,
|
|
} from "./host-client-factory.js";
|
|
|
|
// JSON-RPC protocol types
|
|
export type {
|
|
JsonRpcId,
|
|
JsonRpcInvocationScope,
|
|
JsonRpcInvocationContext,
|
|
JsonRpcRequest,
|
|
JsonRpcSuccessResponse,
|
|
JsonRpcError,
|
|
JsonRpcErrorResponse,
|
|
JsonRpcResponse,
|
|
JsonRpcNotification,
|
|
JsonRpcMessage,
|
|
JsonRpcErrorCode,
|
|
PluginRpcErrorCode,
|
|
PluginInvocationScope,
|
|
PluginInvocationContext,
|
|
WorkerHostCallContext,
|
|
InitializeParams,
|
|
InitializeResult,
|
|
ConfigChangedParams,
|
|
ValidateConfigParams,
|
|
OnEventParams,
|
|
RunJobParams,
|
|
GetDataParams,
|
|
PerformActionParams,
|
|
PluginPerformActionActorType,
|
|
PluginPerformActionActorContext,
|
|
PluginPerformActionContext,
|
|
ExecuteToolParams,
|
|
PluginExternalObjectUrlCandidate,
|
|
PluginExternalObjectSourceContext,
|
|
DetectExternalObjectsParams,
|
|
PluginExternalObjectDetection,
|
|
DetectExternalObjectsResult,
|
|
PluginExternalObjectRecordSnapshot,
|
|
ResolveExternalObjectParams,
|
|
PluginExternalObjectResolvedSnapshot,
|
|
PluginExternalObjectResolveResult,
|
|
RefreshExternalObjectsParams,
|
|
RefreshExternalObjectsResult,
|
|
PluginEnvironmentDiagnostic,
|
|
PluginEnvironmentDriverBaseParams,
|
|
PluginEnvironmentValidateConfigParams,
|
|
PluginEnvironmentValidationResult,
|
|
PluginEnvironmentProbeParams,
|
|
PluginEnvironmentProbeResult,
|
|
PluginEnvironmentLease,
|
|
PluginEnvironmentAcquireLeaseParams,
|
|
PluginEnvironmentResumeLeaseParams,
|
|
PluginEnvironmentReleaseLeaseParams,
|
|
PluginEnvironmentDestroyLeaseParams,
|
|
PluginEnvironmentRealizeWorkspaceParams,
|
|
PluginEnvironmentRealizeWorkspaceResult,
|
|
PluginEnvironmentExecuteParams,
|
|
PluginEnvironmentExecuteResult,
|
|
PluginSyncFileMapping,
|
|
PluginPostUploadCommand,
|
|
PluginSyncOperation,
|
|
PluginEnvironmentSyncInParams,
|
|
PluginEnvironmentSyncOutParams,
|
|
PluginEnvironmentSyncResult,
|
|
PluginEnvironmentInteractiveSetupStatus,
|
|
PluginEnvironmentInteractiveSetupConnectionType,
|
|
PluginEnvironmentTemplateRefKind,
|
|
PluginEnvironmentInteractiveSetupConnectionSummary,
|
|
PluginEnvironmentInteractiveSetupConnectionPayload,
|
|
PluginEnvironmentInteractiveSetupSession,
|
|
PluginEnvironmentStartInteractiveSetupParams,
|
|
PluginEnvironmentGetInteractiveSetupParams,
|
|
PluginEnvironmentCaptureTemplateParams,
|
|
PluginEnvironmentCaptureTemplateResult,
|
|
PluginEnvironmentCancelInteractiveSetupParams,
|
|
PluginEnvironmentCancelInteractiveSetupResult,
|
|
PluginEnvironmentDeleteTemplateParams,
|
|
PluginEnvironmentDeleteTemplateResult,
|
|
PluginModalBoundsRequest,
|
|
PluginRenderCloseEvent,
|
|
PluginLauncherRenderContextSnapshot,
|
|
HostToWorkerMethods,
|
|
HostToWorkerMethodName,
|
|
WorkerToHostMethods,
|
|
WorkerToHostMethodName,
|
|
HostToWorkerRequest,
|
|
HostToWorkerResponse,
|
|
WorkerToHostRequest,
|
|
WorkerToHostResponse,
|
|
WorkerToHostNotifications,
|
|
WorkerToHostNotificationName,
|
|
} from "./protocol.js";
|
|
|
|
// Plugin context and all client interfaces
|
|
export type {
|
|
PluginContext,
|
|
PluginConfigClient,
|
|
PluginLocalFolderProblem,
|
|
PluginLocalFolderStatus,
|
|
PluginLocalFolderConfigureInput,
|
|
PluginLocalFolderListOptions,
|
|
PluginLocalFolderEntry,
|
|
PluginLocalFolderListing,
|
|
PluginLocalFoldersClient,
|
|
PluginEventsClient,
|
|
PluginJobsClient,
|
|
PluginLaunchersClient,
|
|
PluginHttpClient,
|
|
PluginSecretsClient,
|
|
PluginActivityClient,
|
|
PluginActivityLogEntry,
|
|
PluginStateClient,
|
|
PluginEntitiesClient,
|
|
PluginProjectsClient,
|
|
PluginExecutionWorkspacesClient,
|
|
PluginSkillsClient,
|
|
PluginCompaniesClient,
|
|
PluginIssuesClient,
|
|
PluginIssueMutationActor,
|
|
PluginIssueRelationsClient,
|
|
PluginIssueRelationSummary,
|
|
PluginIssueCheckoutOwnership,
|
|
PluginIssueWakeupResult,
|
|
PluginIssueWakeupBatchResult,
|
|
PluginIssueRunSummary,
|
|
PluginIssueApprovalSummary,
|
|
PluginIssueCostSummary,
|
|
PluginBudgetIncidentSummary,
|
|
PluginIssueInvocationBlockSummary,
|
|
PluginIssueOrchestrationSummary,
|
|
PluginIssueSubtreeOptions,
|
|
PluginIssueAssigneeSummary,
|
|
PluginIssueSubtree,
|
|
PluginIssueSummariesClient,
|
|
PluginAgentsClient,
|
|
PluginAccessClient,
|
|
PluginAccessMembersClient,
|
|
PluginAccessInvitesClient,
|
|
PluginAccessMember,
|
|
PluginAccessInvite,
|
|
PluginAuthorizationClient,
|
|
PluginAuthorizationPolicySummary,
|
|
PluginAuthorizationPolicyRecord,
|
|
PluginAssignmentPreviewInput,
|
|
PluginAuthorizationDecisionResult,
|
|
PluginAuthorizationAuditEntry,
|
|
PluginAgentSessionsClient,
|
|
AgentSession,
|
|
AgentSessionEvent,
|
|
AgentSessionSendResult,
|
|
PluginGoalsClient,
|
|
PluginDataClient,
|
|
PluginActionsClient,
|
|
PluginStreamsClient,
|
|
PluginToolsClient,
|
|
PluginMetricsClient,
|
|
PluginTelemetryClient,
|
|
PluginLogger,
|
|
PluginTracer,
|
|
PluginSpan,
|
|
} from "./types.js";
|
|
|
|
// Tracer no-op default (a value, so it re-exports here, not in the type block).
|
|
export { NOOP_PLUGIN_TRACER, NOOP_PLUGIN_SPAN } from "./types.js";
|
|
|
|
// Supporting types for context clients
|
|
export type {
|
|
ScopeKey,
|
|
EventFilter,
|
|
PluginEvent,
|
|
PluginJobContext,
|
|
PluginLauncherRegistration,
|
|
ToolRunContext,
|
|
ToolResult,
|
|
PluginEntityUpsert,
|
|
PluginEntityRecord,
|
|
PluginEntityQuery,
|
|
PluginWorkspace,
|
|
PluginExecutionWorkspaceMetadata,
|
|
Company,
|
|
Project,
|
|
Issue,
|
|
IssueComment,
|
|
IssueDocumentSummary,
|
|
Agent,
|
|
Goal,
|
|
PermissionKey,
|
|
PrincipalPermissionGrant,
|
|
PrincipalType,
|
|
PluginDatabaseClient,
|
|
HumanCompanyMembershipRole,
|
|
MembershipStatus,
|
|
EnvSecretRefBinding,
|
|
} from "./types.js";
|
|
|
|
// Manifest and constant types re-exported from @paperclipai/shared
|
|
// Plugin authors import manifest types from here so they have a single
|
|
// dependency (@paperclipai/plugin-sdk) for all plugin authoring needs.
|
|
export type {
|
|
PaperclipPluginManifestV1,
|
|
PluginJobDeclaration,
|
|
PluginWebhookDeclaration,
|
|
PluginToolDeclaration,
|
|
PluginEnvironmentDriverDeclaration,
|
|
PluginEnvironmentTemplateConfigBinding,
|
|
PluginManagedAgentDeclaration,
|
|
PluginManagedAgentResolution,
|
|
PluginManagedProjectDeclaration,
|
|
PluginManagedProjectResolution,
|
|
PluginManagedRoutineDeclaration,
|
|
PluginManagedRoutineResolution,
|
|
PluginManagedSkillDeclaration,
|
|
PluginManagedSkillFileDeclaration,
|
|
PluginManagedSkillResolution,
|
|
CompanySkill,
|
|
PluginManagedResourceKind,
|
|
PluginManagedResourceRef,
|
|
PluginUiSlotDeclaration,
|
|
PluginUiDeclaration,
|
|
PluginLauncherActionDeclaration,
|
|
PluginLauncherRenderDeclaration,
|
|
PluginLauncherDeclaration,
|
|
PluginMinimumHostVersion,
|
|
PluginDatabaseDeclaration,
|
|
PluginApiRouteCompanyResolution,
|
|
PluginApiRouteDeclaration,
|
|
PluginLocalFolderDeclaration,
|
|
PluginCompanySettings,
|
|
PluginObjectReferenceRefreshPolicy,
|
|
PluginObjectReferenceProviderDeclaration,
|
|
PluginRecord,
|
|
PluginDatabaseNamespaceRecord,
|
|
PluginMigrationRecord,
|
|
PluginConfig,
|
|
JsonSchema,
|
|
PluginStatus,
|
|
PluginCategory,
|
|
PluginCapability,
|
|
PluginUiSlotType,
|
|
PluginUiSlotEntityType,
|
|
PluginLauncherPlacementZone,
|
|
PluginLauncherAction,
|
|
PluginLauncherBounds,
|
|
PluginLauncherRenderEnvironment,
|
|
PluginStateScopeKind,
|
|
PluginJobStatus,
|
|
PluginJobRunStatus,
|
|
PluginJobRunTrigger,
|
|
PluginWebhookDeliveryStatus,
|
|
PluginDatabaseCoreReadTable,
|
|
PluginDatabaseMigrationStatus,
|
|
PluginDatabaseNamespaceMode,
|
|
PluginDatabaseNamespaceStatus,
|
|
PluginApiRouteAuthMode,
|
|
PluginApiRouteCheckoutPolicy,
|
|
PluginApiRouteMethod,
|
|
PluginEventType,
|
|
PluginBridgeErrorCode,
|
|
} from "./types.js";
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Zod re-export
|
|
// ---------------------------------------------------------------------------
|
|
|
|
/**
|
|
* Zod is re-exported for plugin authors to use when defining their
|
|
* `instanceConfigSchema` and tool `parametersSchema`.
|
|
*
|
|
* Plugin authors do not need to add a separate `zod` dependency.
|
|
*
|
|
* @see PLUGIN_SPEC.md §14.1 — Example SDK Shape
|
|
*
|
|
* @example
|
|
* ```ts
|
|
* import { z } from "@paperclipai/plugin-sdk";
|
|
*
|
|
* const configSchema = z.object({
|
|
* apiKey: z.string().describe("Your API key"),
|
|
* workspace: z.string().optional(),
|
|
* });
|
|
* ```
|
|
*/
|
|
export { z } from "zod";
|
|
|
|
// ---------------------------------------------------------------------------
|
|
// Constants re-exports (for plugin code that needs to check values at runtime)
|
|
// ---------------------------------------------------------------------------
|
|
|
|
export {
|
|
PLUGIN_API_VERSION,
|
|
PLUGIN_STATUSES,
|
|
PLUGIN_CATEGORIES,
|
|
PLUGIN_CAPABILITIES,
|
|
PLUGIN_UI_SLOT_TYPES,
|
|
PLUGIN_UI_SLOT_ENTITY_TYPES,
|
|
PLUGIN_RESERVED_COMPANY_SETTINGS_ROUTE_SEGMENTS,
|
|
PLUGIN_STATE_SCOPE_KINDS,
|
|
PLUGIN_JOB_STATUSES,
|
|
PLUGIN_JOB_RUN_STATUSES,
|
|
PLUGIN_JOB_RUN_TRIGGERS,
|
|
PLUGIN_WEBHOOK_DELIVERY_STATUSES,
|
|
PLUGIN_EVENT_TYPES,
|
|
PLUGIN_BRIDGE_ERROR_CODES,
|
|
PERMISSION_KEYS,
|
|
HUMAN_COMPANY_MEMBERSHIP_ROLES,
|
|
HUMAN_COMPANY_MEMBERSHIP_ROLE_LABELS,
|
|
MEMBERSHIP_STATUSES,
|
|
PRINCIPAL_TYPES,
|
|
} from "@paperclipai/shared";
|