mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-10-09 06:15:21 +02:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work. > - Paperclip runs the server and runner test suites with Vitest. > - Vitest 5 removes the deprecated `describe.sequential` property, so the pending Vitest 5 upgrade fails the type-check and test jobs. > - `describe.sequential` only changes behaviour inside a `describe.concurrent` suite, or when `sequence.concurrent` is on. > - This repository has neither, so the modifier changed nothing at run time. > - The benefit is that the Vitest 5 upgrade can land, and the test files lose a modifier that did no work. ## Linked Issues or Issue Description Refs: #12969 ## What Changed - Replace every `describe.sequential` use with a plain `describe` call. - Drop the `{ concurrent: false }` suite option from the two runner test files. - Add a comment to `server/vitest.config.ts` that records why these suites must run one test at a time. - Leave the package manifests and the lockfile unchanged. ## Why the modifier did nothing The Vitest documentation states that `describe.sequential` is useful to run tests in sequence inside a `describe.concurrent` suite, or with the `--sequence.concurrent` option. `sequence.concurrent` defaults to `false`. This repository satisfies neither condition: - No test file uses `describe.concurrent`, `it.concurrent`, or `test.concurrent`. - `server/vitest.config.ts` sets `sequence.concurrent: false`, with `maxWorkers: 1`, `maxConcurrency: 1`, and `isolate: true`. - `packages/paperclip-runner/vitest.config.ts` sets no `sequence` block, so the `false` default applies. `packages/db` and `cli` already run the same embedded-Postgres suites with a plain `describe`, and those jobs are green. The server package was the only outlier. The modifier did carry one real piece of knowledge: these suites need their tests to run one at a time. The new comment in `server/vitest.config.ts` records that reason next to the setting that enforces it. ## Verification - `git grep` for `describe.sequential` returns nothing outside `node_modules`. - The author ran the changed server test files under the installed Vitest 4, and the results match the results without this change. - Two very large embedded-Postgres test files exceeded the author's local memory limit, so the CI test jobs cover those two. - The two changed runner test files have pre-existing local failures caused by a missing Rust toolchain and a missing global `pnpm` binary. The failures are identical with and without this change. - The author type-checked the changed files and found no new error. - CI must pass the typecheck, build, server test, and runner verify jobs. ## Risks - Low risk. Suite execution stays serial, because the Vitest config enforces it. - The change adds no dependency and changes no package manifest or lockfile. - A future change that turns `sequence.concurrent` on would break these suites. The new config comment warns against it. ## Model Used - Claude Sonnet 5 — code edits and local verification. - OpenAI Codex, GPT-5 — the earlier revision of this branch. ## Test plan - [x] Every CI check reaches a terminal green state. A pending or queued check is not a pass. - [x] The `Typecheck + Release Registry` job passes. This change must not introduce a type error. - [x] The `Build` job passes. - [x] The server test jobs and the runner verify jobs pass. - [x] Greptile re-reviews this commit set and posts a passing verdict. The dependabot waiver does not apply to this pull request. - [x] `mergeable` reads `MERGEABLE` as a terminal value. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have linked the related public issue with `Refs: #12969` - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [x] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [x] All Paperclip CI gates are green - [x] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [x] I will address all Greptile and reviewer comments before requesting merge Co-Authored-By: Priya Raman <priya.raman@paperclip.ing> --------- Co-authored-by: Priya Raman <priya.raman@paperclip.ing> Co-authored-by: Paperclip <noreply@paperclip.ing> Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com> Co-authored-by: nickyleach <331803+nickyleach@users.noreply.github.com>
387 lines
14 KiB
TypeScript
387 lines
14 KiB
TypeScript
/**
|
|
* Route-level coverage for the plugin install security floor:
|
|
*
|
|
* - Cloud-managed instances (PAPERCLIP_MANAGED_CONFIG present) may only
|
|
* install plugins whose source canonicalizes into the bundled plugin
|
|
* catalog root; npm installs and arbitrary local paths are rejected.
|
|
* - Every instance canonicalizes and validates `localPath` (traversal,
|
|
* symlink, and absolute-path handling) before the loader runs.
|
|
* - Self-hosted non-localPath install validation is unchanged.
|
|
*/
|
|
import express from "express";
|
|
import { randomUUID } from "node:crypto";
|
|
import { mkdir, mkdtemp, realpath, rm, symlink, writeFile } from "node:fs/promises";
|
|
import os from "node:os";
|
|
import path from "node:path";
|
|
import request from "supertest";
|
|
import { afterAll, afterEach, beforeAll, describe, expect, it, vi } from "vitest";
|
|
import { createDb, plugins } from "@paperclipai/db";
|
|
import { pluginLoader, REPO_ROOT } from "../services/plugin-loader.js";
|
|
import {
|
|
getEmbeddedPostgresTestSupport,
|
|
startEmbeddedPostgresTestDatabase,
|
|
} from "./helpers/embedded-postgres.js";
|
|
|
|
const mockLifecycle = vi.hoisted(() => ({
|
|
load: vi.fn(),
|
|
upgrade: vi.fn(),
|
|
unload: vi.fn(),
|
|
enable: vi.fn(),
|
|
disable: vi.fn(),
|
|
}));
|
|
|
|
vi.mock("../services/plugin-lifecycle.js", () => ({
|
|
pluginLifecycleManager: () => mockLifecycle,
|
|
}));
|
|
|
|
vi.mock("../services/activity-log.js", () => ({
|
|
logActivity: vi.fn(),
|
|
}));
|
|
|
|
vi.mock("../services/live-events.js", () => ({
|
|
publishGlobalLiveEvent: vi.fn(),
|
|
}));
|
|
|
|
const embeddedPostgresSupport = await getEmbeddedPostgresTestSupport();
|
|
const describeEmbeddedPostgres = embeddedPostgresSupport.supported ? describe : describe.skip;
|
|
|
|
if (!embeddedPostgresSupport.supported) {
|
|
console.warn(
|
|
`Skipping plugin install route security tests on this host: ${embeddedPostgresSupport.reason ?? "unsupported environment"}`,
|
|
);
|
|
}
|
|
|
|
const CLOUD_MANAGED_CONFIG = JSON.stringify({
|
|
v: 1,
|
|
mode: "cloud",
|
|
catalogVersion: "2026.720.0",
|
|
features: {},
|
|
plugins: { autoInstall: [] },
|
|
});
|
|
|
|
const repoPluginRoot = path.join(REPO_ROOT, "packages", "plugins");
|
|
|
|
type FixturePlugin = {
|
|
packageName: string;
|
|
pluginKey: string;
|
|
packageRoot: string;
|
|
};
|
|
|
|
/**
|
|
* Create a valid, already-built plugin package (dist written directly, so no
|
|
* pnpm auto-build runs during install) at an arbitrary directory.
|
|
*/
|
|
async function createBuiltPluginFixture(parentDir: string, nameSuffix: string): Promise<FixturePlugin> {
|
|
const slug = `plugin-install-guard-${nameSuffix}-${randomUUID().slice(0, 8)}`;
|
|
const packageName = `@paperclipai/${slug}`;
|
|
const pluginKey = `paperclip.${slug.replace(/^plugin-/, "").replace(/-/g, "_")}`;
|
|
const packageRoot = path.join(parentDir, slug);
|
|
const distDir = path.join(packageRoot, "dist");
|
|
|
|
await mkdir(distDir, { recursive: true });
|
|
await writeFile(
|
|
path.join(packageRoot, "package.json"),
|
|
JSON.stringify({
|
|
name: packageName,
|
|
version: "0.1.0",
|
|
private: true,
|
|
type: "module",
|
|
paperclipPlugin: {
|
|
manifest: "./dist/manifest.js",
|
|
worker: "./dist/worker.js",
|
|
},
|
|
}, null, 2),
|
|
"utf8",
|
|
);
|
|
|
|
const manifest = {
|
|
id: pluginKey,
|
|
apiVersion: 1,
|
|
version: "0.1.0",
|
|
displayName: "Install Guard Fixture",
|
|
description: "Plugin fixture for install-route security floor coverage.",
|
|
author: "Paperclip",
|
|
categories: ["automation"],
|
|
capabilities: ["companies.read"],
|
|
entrypoints: {
|
|
worker: "./dist/worker.js",
|
|
},
|
|
};
|
|
await writeFile(
|
|
path.join(distDir, "manifest.js"),
|
|
`export default ${JSON.stringify(manifest, null, 2)};\n`,
|
|
"utf8",
|
|
);
|
|
await writeFile(path.join(distDir, "worker.js"), "export {};\n", "utf8");
|
|
|
|
return { packageName, pluginKey, packageRoot };
|
|
}
|
|
|
|
async function createInstallApp(db: ReturnType<typeof createDb>) {
|
|
const [{ pluginRoutes }, { errorHandler }] = await Promise.all([
|
|
import("../routes/plugins.js"),
|
|
import("../middleware/index.js"),
|
|
]);
|
|
|
|
const loader = pluginLoader(db, {
|
|
enableLocalFilesystem: false,
|
|
enableNpmDiscovery: false,
|
|
});
|
|
|
|
const app = express();
|
|
app.use(express.json());
|
|
app.use((req, _res, next) => {
|
|
req.actor = {
|
|
type: "board",
|
|
userId: "admin-1",
|
|
source: "session",
|
|
isInstanceAdmin: true,
|
|
companyIds: [],
|
|
} as typeof req.actor;
|
|
next();
|
|
});
|
|
app.use("/api", pluginRoutes(db as never, loader as never, {} as never, undefined, {} as never, {} as never));
|
|
app.use(errorHandler);
|
|
return app;
|
|
}
|
|
|
|
describeEmbeddedPostgres("plugin install route security floor", () => {
|
|
let db!: ReturnType<typeof createDb>;
|
|
let tempDb: Awaited<ReturnType<typeof startEmbeddedPostgresTestDatabase>> | null = null;
|
|
const cleanupPaths = new Set<string>();
|
|
const originalManagedConfig = process.env["PAPERCLIP_MANAGED_CONFIG"];
|
|
|
|
beforeAll(async () => {
|
|
tempDb = await startEmbeddedPostgresTestDatabase("paperclip-plugin-install-guard-");
|
|
db = createDb(tempDb.connectionString);
|
|
}, 20_000);
|
|
|
|
afterEach(async () => {
|
|
vi.clearAllMocks();
|
|
await db.delete(plugins);
|
|
for (const cleanupPath of cleanupPaths) {
|
|
await rm(cleanupPath, { recursive: true, force: true });
|
|
}
|
|
cleanupPaths.clear();
|
|
if (originalManagedConfig === undefined) {
|
|
delete process.env["PAPERCLIP_MANAGED_CONFIG"];
|
|
} else {
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = originalManagedConfig;
|
|
}
|
|
});
|
|
|
|
afterAll(async () => {
|
|
await tempDb?.cleanup();
|
|
}, 30_000);
|
|
|
|
describe("cloud-managed instances", () => {
|
|
it("rejects npm installs outright", async () => {
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = CLOUD_MANAGED_CONFIG;
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: "paperclip-plugin-anything", version: "1.0.0" });
|
|
|
|
expect(res.status).toBe(403);
|
|
expect(res.body.error).toContain("npm installs are disabled on cloud-managed instances");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("rejects npm installs even when the managed config document is corrupted", async () => {
|
|
// The fail-closed startup parser refuses to boot a managed instance
|
|
// with a corrupted document, so boot with a valid one and corrupt it
|
|
// afterwards: the install floor must still hold because it keys off
|
|
// the variable's presence at request time, never its parsed content.
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = CLOUD_MANAGED_CONFIG;
|
|
const app = await createInstallApp(db);
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = "{definitely not json";
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: "paperclip-plugin-anything" });
|
|
|
|
expect(res.status).toBe(403);
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("rejects localPath installs from outside the bundled catalog root", async () => {
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = CLOUD_MANAGED_CONFIG;
|
|
const outsideDir = await mkdtemp(path.join(os.tmpdir(), "guard-outside-"));
|
|
cleanupPaths.add(outsideDir);
|
|
const fixture = await createBuiltPluginFixture(outsideDir, "outside");
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: fixture.packageRoot, isLocalPath: true });
|
|
|
|
expect(res.status).toBe(403);
|
|
expect(res.body.error).toContain("bundled plugin catalog");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("rejects localPath traversal that escapes the bundled catalog root", async () => {
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = CLOUD_MANAGED_CONFIG;
|
|
const app = await createInstallApp(db);
|
|
|
|
// Starts under packages/plugins but canonicalizes to the repo's server
|
|
// directory — a real, readable directory outside the catalog.
|
|
const traversalPath = path.join(repoPluginRoot, "..", "..", "server");
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: traversalPath, isLocalPath: true });
|
|
|
|
expect(res.status).toBe(403);
|
|
expect(res.body.error).toContain("bundled plugin catalog");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("rejects a symlink inside the catalog root that points outside it", async () => {
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = CLOUD_MANAGED_CONFIG;
|
|
const outsideDir = await mkdtemp(path.join(os.tmpdir(), "guard-symlink-target-"));
|
|
cleanupPaths.add(outsideDir);
|
|
const fixture = await createBuiltPluginFixture(outsideDir, "symlink-target");
|
|
|
|
const linkPath = path.join(repoPluginRoot, `guard-sneaky-link-${randomUUID().slice(0, 8)}`);
|
|
cleanupPaths.add(linkPath);
|
|
await symlink(fixture.packageRoot, linkPath, "dir");
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: linkPath, isLocalPath: true });
|
|
|
|
expect(res.status).toBe(403);
|
|
expect(res.body.error).toContain("bundled plugin catalog");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("allows installing a plugin from inside the bundled catalog root", async () => {
|
|
process.env["PAPERCLIP_MANAGED_CONFIG"] = CLOUD_MANAGED_CONFIG;
|
|
const fixture = await createBuiltPluginFixture(repoPluginRoot, "bundled");
|
|
cleanupPaths.add(fixture.packageRoot);
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: fixture.packageRoot, isLocalPath: true });
|
|
|
|
expect(res.status).toBe(200);
|
|
expect(res.body.packageName).toBe(fixture.packageName);
|
|
expect(res.body.pluginKey).toBe(fixture.pluginKey);
|
|
expect(mockLifecycle.load).toHaveBeenCalledTimes(1);
|
|
}, 30_000);
|
|
});
|
|
|
|
describe("all instances: localPath canonicalization", () => {
|
|
it("rejects a nonexistent localPath with a validation error", async () => {
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: "/nonexistent/plugin/dir", isLocalPath: true });
|
|
|
|
expect(res.status).toBe(400);
|
|
expect(res.body.error).toContain("Invalid localPath");
|
|
expect(res.body.error).toContain("does not exist");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("rejects a localPath containing a null byte", async () => {
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: "/tmp/foo\u0000bar", isLocalPath: true });
|
|
|
|
expect(res.status).toBe(400);
|
|
expect(res.body.error).toContain("Invalid localPath");
|
|
expect(res.body.error).toContain("null byte");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("rejects a localPath that resolves to a file", async () => {
|
|
const outsideDir = await mkdtemp(path.join(os.tmpdir(), "guard-file-"));
|
|
cleanupPaths.add(outsideDir);
|
|
const filePath = path.join(outsideDir, "plugin.tgz");
|
|
await writeFile(filePath, "not a directory", "utf8");
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: filePath, isLocalPath: true });
|
|
|
|
expect(res.status).toBe(400);
|
|
expect(res.body.error).toContain("Invalid localPath");
|
|
expect(res.body.error).toContain("not a directory");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("canonicalizes traversal segments before installing (self-hosted)", async () => {
|
|
const outsideDir = await mkdtemp(path.join(os.tmpdir(), "guard-traversal-"));
|
|
cleanupPaths.add(outsideDir);
|
|
const fixture = await createBuiltPluginFixture(outsideDir, "traversal");
|
|
const slug = path.basename(fixture.packageRoot);
|
|
const traversalPath = path.join(outsideDir, "..", path.basename(outsideDir), ".", slug);
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: traversalPath, isLocalPath: true });
|
|
|
|
expect(res.status).toBe(200);
|
|
expect(res.body.packageName).toBe(fixture.packageName);
|
|
expect(res.body.packagePath).toBe(await realpath(fixture.packageRoot));
|
|
expect(mockLifecycle.load).toHaveBeenCalledTimes(1);
|
|
}, 30_000);
|
|
|
|
it("resolves symlinked localPath installs to the real target (self-hosted)", async () => {
|
|
const outsideDir = await mkdtemp(path.join(os.tmpdir(), "guard-selfhosted-symlink-"));
|
|
cleanupPaths.add(outsideDir);
|
|
const fixture = await createBuiltPluginFixture(outsideDir, "symlinked");
|
|
const linkPath = path.join(outsideDir, "linked-plugin");
|
|
await symlink(fixture.packageRoot, linkPath, "dir");
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: linkPath, isLocalPath: true });
|
|
|
|
expect(res.status).toBe(200);
|
|
expect(res.body.packageName).toBe(fixture.packageName);
|
|
expect(res.body.packagePath).toBe(await realpath(fixture.packageRoot));
|
|
expect(mockLifecycle.load).toHaveBeenCalledTimes(1);
|
|
}, 30_000);
|
|
});
|
|
|
|
describe("self-hosted npm installs (behavior unchanged)", () => {
|
|
it("still rejects package names with invalid characters", async () => {
|
|
const app = await createInstallApp(db);
|
|
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: "bad<name>" });
|
|
|
|
expect(res.status).toBe(400);
|
|
expect(res.body.error).toBe("packageName contains invalid characters");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it("does not apply the cloud floor when PAPERCLIP_MANAGED_CONFIG is absent", async () => {
|
|
const app = await createInstallApp(db);
|
|
|
|
// A well-formed npm package name passes route validation and reaches
|
|
// the loader (which fails here because npm cannot resolve the package
|
|
// in the test environment) — proving the 403 floor did not trigger.
|
|
const res = await request(app)
|
|
.post("/api/plugins/install")
|
|
.send({ packageName: `paperclip-plugin-guard-missing-${randomUUID().slice(0, 8)}` });
|
|
|
|
expect(res.status).toBe(400);
|
|
expect(res.body.error).toContain("npm install failed");
|
|
expect(mockLifecycle.load).not.toHaveBeenCalled();
|
|
}, 150_000);
|
|
});
|
|
});
|