mirror of
https://github.com/paperclipai/paperclip.git
synced 2026-11-21 02:43:25 +01:00
## Thinking Path > - Paperclip is the open source app people use to manage AI agents for work > - The dashboard is the first page a person sees in a company > - The classic dashboard shows agents, runs, costs and recent tasks > - It does not show what the person is responsible for, or if that work goes well > - People think in areas, such as Fundraising or Customers, and in the things they own in each area > - This pull request adds a dashboard built on areas and responsibilities, behind an experimental setting that is off by default > - The benefit is that a person sees what they own, how it is going, and what agents do for it, on one page ## Linked Issues or Issue Description No public issue exists for this work. The description follows the feature request template. **Subsystem affected** Dashboard, navigation, the task conversation, routines, and the instance experimental settings. **Problem or motivation** The classic dashboard counts agents and tasks. It does not say what a person owns or if it goes well. People who run a company with agents want to see their areas, the responsibilities in each area, the bar each one must meet, and the agents and routines that serve it. **Proposed solution** A person owns responsibilities. Each responsibility belongs to an area and has a bar, a number to reach. Projects, tasks and routines link to a responsibility, and the page shows its status from those links. An agent can interview the person and draft the dashboard. The person accepts or declines each change, and any change can be undone from a saved version. **Alternatives considered** Add the same data to the classic dashboard. That page is a fixed set of cards for company activity, so a second, person-centred page is clearer. The setting lets a person pick one of the two. **Roadmap alignment** This is an experimental feature behind `enableResponsibilities`. It is off by default and changes nothing for a person who leaves it off. ## What Changed - Add the setting "Areas & Responsibilities dashboard" (`enableResponsibilities`, off by default). On, Dashboard in the sidebar opens the new page, and the classic dashboard link is not shown in the sidebars or the command palette. Off, nothing changes. - Add tables and migrations 0492 to 0497 for areas, responsibilities, links to work, metrics, status reports, saved dashboard versions, and model-call records for summaries. - Add the API: areas, responsibilities, links, bars, metrics, status reports, summaries, runs, automation, and the dashboard conversation with versions and undo. Each route checks company access and writes to the activity log. - Add four task conversations with an agent: about a bar, about an automation, about a routine, and about the whole dashboard. The agent proposes a change. Nothing applies until a person accepts it. - Add standing checks: routines that an agent carries out on its heartbeat and reports. - Add the Dashboard page: search, counts, areas that open and close, a primary New area button, and a message box at the bottom of the page. Add the responsibility page with its bar, metrics, work and routines. - Add the Paperclip skill sections and runner API entries that let an agent use these routes. The runner skill inventory is regenerated (166 to 174 rows). - Keep the new runner API tests in their own file so `runner-api.test.ts` stays at 985 lines. - Onboarding is not changed. The onboarding changes that build on this work are a separate pull request. ## Verification - Type checks pass for `packages/db`, `packages/shared`, `server` (all layers) and `ui`. - `pnpm --filter @paperclipai/db check:migrations` passes. A new `drizzle-kit generate` run produces no further change. - Tests for every changed file pass: 26 server test files (3,009 tests), 116 UI test files (1,991 tests) and 28 shared test files (432 tests). - The runner capability inventory checks pass. - I started the app on a local database that already held earlier data. Master's new migrations and these migrations applied without error. With the setting on, the Dashboard and a responsibility page loaded with no console or server errors. The More menu and the command palette show one Dashboard. - I did not run `pnpm verify`, the full local suite, or the browser suites. Required CI covers them. - The agent conversations are tested with simulated agents. No real model has run them. ## Risks - Medium. The change is large, and the setting is off by default. With it off, the new routes refuse requests and the UI is unchanged. - Migrations only add tables and columns. Two replace a CHECK constraint, and one builds an index `CONCURRENTLY`. These two have the `online_compatible` override with a reason in the file, and the second one is listed in `MIGRATIONS_WITH_TOP_LEVEL_STATEMENTS`. - Master can add migrations before this merges. The migrations then need new numbers. - `responsibilities.ts` (1,663 lines), `responsibility-summaries.ts` (1,239 lines) and one Storybook fixture file (1,305 lines) are new files over 1,000 lines. They each keep one cohesive unit together: the service for one table family, the model-call path for summaries, and the fixtures that the stories share. No existing file crosses 1,000 lines. > For core feature work, check [`ROADMAP.md`](ROADMAP.md) first and discuss it in `#dev` before opening the PR. Feature PRs that overlap with planned core work may need to be redirected — check the roadmap first. See `CONTRIBUTING.md`. ## Model Used - Anthropic Claude: Claude Fable 5.2 (`claude-fable-5-2`) wrote most of the change, with Claude Sonnet 5.5 (`claude-sonnet-5-5`) for the final steps. Both used tool use, code execution and browser checks. ## Checklist - [x] I have included a thinking path that traces from project context to this change - [x] I have specified the model used (with version and capability details) - [x] I have checked ROADMAP.md and confirmed this PR does not duplicate planned core work - [x] I have searched GitHub for duplicate or related PRs and linked them above - [x] I have either (a) linked existing issues with `Fixes: #` / `Closes #` / `Refs #` OR (b) described the issue in-PR following the relevant issue template - [x] I have not referenced internal/instance-local Paperclip issues or links (only public GitHub `#NNN` / `github.com/paperclipai/paperclip` URLs) - [x] My branch name describes the change (e.g. `docs/...`, `fix/...`) and contains no internal Paperclip ticket id or instance-derived details - [x] I have run tests locally and they pass - [x] I have added or updated tests where applicable - [ ] I have updated relevant documentation to reflect my changes - [x] I have considered and documented any risks above - [ ] All Paperclip CI gates are green - [ ] Greptile is 5/5 with no open P2s, recommendations, or follow-ups - [ ] I will address all Greptile and reviewer comments before requesting merge --------- Co-authored-by: Scott Tong <scott@scottsmbpm5max.lan> Co-authored-by: Claude Fable 5.2 <noreply@anthropic.com>
792 lines
31 KiB
TypeScript
792 lines
31 KiB
TypeScript
import { buffer } from "node:stream/consumers";
|
|
import { and, desc, eq, inArray, isNotNull, isNull, notInArray, or, sql, type SQL } from "drizzle-orm";
|
|
import { alias } from "drizzle-orm/pg-core";
|
|
import type { Db } from "@paperclipai/db";
|
|
import {
|
|
agents,
|
|
assets,
|
|
companies,
|
|
documentMemberships,
|
|
documents,
|
|
heartbeatRuns,
|
|
issueAttachments,
|
|
issueDocuments,
|
|
issues,
|
|
issueWorkProducts,
|
|
projects,
|
|
} from "@paperclipai/db";
|
|
import {
|
|
ARTIFACT_REVIEW_DOCUMENT_KEY_PREFIX,
|
|
attachmentArtifactWorkProductMetadataSchema,
|
|
COMPANY_ARTIFACTS_MAX_LIMIT,
|
|
companyArtifactsQuerySchema,
|
|
SYSTEM_ISSUE_DOCUMENT_KEYS,
|
|
type CompanyArtifact,
|
|
type CompanyArtifactGroup,
|
|
type CompanyArtifactGroupBy,
|
|
type CompanyArtifactMediaKind,
|
|
type CompanyArtifactsQuery,
|
|
type CompanyArtifactsResponse,
|
|
} from "@paperclipai/shared";
|
|
import { badRequest, notFound } from "../errors.js";
|
|
import type { StorageService } from "../storage/types.js";
|
|
|
|
const TEXT_PREVIEW_BYTES = 4096;
|
|
const PREVIEW_TEXT_MAX_LENGTH = 280;
|
|
const GROUP_PREVIEW_ARTIFACT_LIMIT = 3;
|
|
const GROUPED_ARTIFACT_FETCH_LIMIT = COMPANY_ARTIFACTS_MAX_LIMIT * 10;
|
|
|
|
type ArtifactCursor = {
|
|
updatedAt: string;
|
|
id: string;
|
|
};
|
|
|
|
type ArtifactGroupBy = Exclude<CompanyArtifactGroupBy, "none">;
|
|
|
|
type IssueGroupingRow = {
|
|
id: string;
|
|
parentId: string | null;
|
|
identifier: string | null;
|
|
title: string;
|
|
updatedAt: Date;
|
|
};
|
|
|
|
function encodeCursor(cursor: ArtifactCursor) {
|
|
return Buffer.from(JSON.stringify(cursor), "utf8").toString("base64url");
|
|
}
|
|
|
|
function decodeCursor(cursor: string | undefined): ArtifactCursor | null {
|
|
if (!cursor) return null;
|
|
try {
|
|
const parsed = JSON.parse(Buffer.from(cursor, "base64url").toString("utf8")) as Partial<ArtifactCursor>;
|
|
if (typeof parsed.id !== "string" || typeof parsed.updatedAt !== "string") {
|
|
throw new Error("Invalid cursor");
|
|
}
|
|
const date = new Date(parsed.updatedAt);
|
|
if (Number.isNaN(date.getTime())) {
|
|
throw new Error("Invalid cursor date");
|
|
}
|
|
return { id: parsed.id, updatedAt: date.toISOString() };
|
|
} catch {
|
|
throw badRequest("Invalid artifacts cursor");
|
|
}
|
|
}
|
|
|
|
function cursorCondition(updatedAt: SQL<Date>, artifactId: SQL<string>, cursor: ArtifactCursor | null) {
|
|
if (!cursor) return undefined;
|
|
return sql`(${updatedAt} < ${cursor.updatedAt}::timestamptz OR (${updatedAt} = ${cursor.updatedAt}::timestamptz AND ${artifactId} < ${cursor.id}))`;
|
|
}
|
|
|
|
function isAfterCursor(item: { updatedAt: string; id: string }, cursor: ArtifactCursor | null) {
|
|
if (!cursor) return true;
|
|
const dateDiff = Date.parse(item.updatedAt) - Date.parse(cursor.updatedAt);
|
|
return dateDiff < 0 || (dateDiff === 0 && item.id < cursor.id);
|
|
}
|
|
|
|
function escapeLikePattern(value: string) {
|
|
return value.replace(/[\\%_]/g, (match) => `\\${match}`);
|
|
}
|
|
|
|
function normalizePreviewText(input: string | null | undefined) {
|
|
if (!input) return null;
|
|
const stripped = input
|
|
.replace(/```[\s\S]*?```/g, " ")
|
|
.replace(/`([^`]+)`/g, "$1")
|
|
.replace(/!\[[^\]]*]\([^)]*\)/g, " ")
|
|
.replace(/\[([^\]]+)]\([^)]*\)/g, "$1")
|
|
.replace(/[#>*_\-~|]+/g, " ")
|
|
.replace(/\s+/g, " ")
|
|
.trim();
|
|
if (!stripped) return null;
|
|
return stripped.length > PREVIEW_TEXT_MAX_LENGTH
|
|
? `${stripped.slice(0, PREVIEW_TEXT_MAX_LENGTH - 3).trimEnd()}...`
|
|
: stripped;
|
|
}
|
|
|
|
function classifyMediaKind(contentType: string | null | undefined, fallback: CompanyArtifactMediaKind = "file") {
|
|
const normalized = (contentType ?? "").toLowerCase();
|
|
if (!normalized) return fallback;
|
|
if (normalized.startsWith("image/")) return "image";
|
|
if (normalized.startsWith("video/")) return "video";
|
|
if (
|
|
normalized.startsWith("text/") ||
|
|
normalized === "application/json" ||
|
|
normalized.endsWith("+json") ||
|
|
normalized === "application/xml" ||
|
|
normalized.endsWith("+xml") ||
|
|
normalized === "application/markdown"
|
|
) {
|
|
return "text";
|
|
}
|
|
return "file";
|
|
}
|
|
|
|
function contentTypeKindCondition(contentTypeExpression: SQL<string>, kind: CompanyArtifactsQuery["kind"]) {
|
|
if (!kind || kind === "all") return undefined;
|
|
if (kind === "image") return sql`${contentTypeExpression} ILIKE 'image/%'`;
|
|
if (kind === "video") return sql`${contentTypeExpression} ILIKE 'video/%'`;
|
|
if (kind === "text") {
|
|
return sql`(${contentTypeExpression} ILIKE 'text/%' OR ${contentTypeExpression} IN ('application/json', 'application/xml', 'application/markdown') OR ${contentTypeExpression} ILIKE '%+json' OR ${contentTypeExpression} ILIKE '%+xml')`;
|
|
}
|
|
if (kind === "file") {
|
|
return sql`NOT (${contentTypeExpression} ILIKE 'image/%' OR ${contentTypeExpression} ILIKE 'video/%' OR ${contentTypeExpression} ILIKE 'text/%' OR ${contentTypeExpression} IN ('application/json', 'application/xml', 'application/markdown') OR ${contentTypeExpression} ILIKE '%+json' OR ${contentTypeExpression} ILIKE '%+xml')`;
|
|
}
|
|
return undefined;
|
|
}
|
|
|
|
function buildIssueHref(companyPrefix: string, identifier: string, anchor: string) {
|
|
return `/${encodeURIComponent(companyPrefix)}/issues/${encodeURIComponent(identifier)}#${anchor}`;
|
|
}
|
|
|
|
function buildArtifactsGroupHref(
|
|
companyPrefix: string,
|
|
query: CompanyArtifactsQuery,
|
|
groupBy: ArtifactGroupBy,
|
|
groupIssueId: string,
|
|
) {
|
|
const params = new URLSearchParams();
|
|
params.set("groupBy", groupBy);
|
|
params.set("groupIssueId", groupIssueId);
|
|
if (query.kind !== "all") params.set("kind", query.kind);
|
|
if (query.projectId) params.set("projectId", query.projectId);
|
|
if (query.agentId) params.set("agentId", query.agentId);
|
|
if (query.q) params.set("q", query.q);
|
|
return `/${encodeURIComponent(companyPrefix)}/artifacts?${params.toString()}`;
|
|
}
|
|
|
|
function attachmentContentPath(attachmentId: string) {
|
|
return `/api/attachments/${attachmentId}/content`;
|
|
}
|
|
|
|
async function readTextAttachmentPreview(
|
|
storage: StorageService | undefined,
|
|
input: { companyId: string; objectKey: string; byteSize: number },
|
|
) {
|
|
if (!storage || input.byteSize <= 0) return null;
|
|
try {
|
|
const object = await storage.getObject(input.companyId, input.objectKey, {
|
|
range: { start: 0, end: Math.min(input.byteSize, TEXT_PREVIEW_BYTES) - 1 },
|
|
});
|
|
const body = await buffer(object.stream);
|
|
return normalizePreviewText(body.toString("utf8"));
|
|
} catch {
|
|
return null;
|
|
}
|
|
}
|
|
|
|
function sortArtifacts(artifacts: CompanyArtifact[], sortDates = new Map<string, string>()) {
|
|
return artifacts.sort((a, b) => {
|
|
const dateDiff = Date.parse(sortDates.get(b.id) ?? b.updatedAt)
|
|
- Date.parse(sortDates.get(a.id) ?? a.updatedAt);
|
|
if (dateDiff !== 0) return dateDiff;
|
|
return b.id.localeCompare(a.id);
|
|
});
|
|
}
|
|
|
|
function pageByCursor<T extends { id: string; updatedAt: string }>(
|
|
items: T[],
|
|
limit: number,
|
|
cursor: ArtifactCursor | null,
|
|
) {
|
|
const filtered = items.filter((item) => isAfterCursor(item, cursor));
|
|
const page = filtered.slice(0, limit);
|
|
const nextCursor = filtered.length > limit
|
|
? encodeCursor({ id: page[page.length - 1]?.id ?? "", updatedAt: page[page.length - 1]?.updatedAt ?? new Date(0).toISOString() })
|
|
: null;
|
|
return { page, nextCursor };
|
|
}
|
|
|
|
async function loadIssueGroupingRows(db: Db, companyId: string, seedIssueIds: Iterable<string>, readCondition?: SQL) {
|
|
const rowsById = new Map<string, IssueGroupingRow>();
|
|
let pending = [...new Set(seedIssueIds)];
|
|
|
|
while (pending.length > 0) {
|
|
const rows = await db
|
|
.select({
|
|
id: issues.id,
|
|
parentId: issues.parentId,
|
|
identifier: issues.identifier,
|
|
title: issues.title,
|
|
updatedAt: issues.updatedAt,
|
|
})
|
|
.from(issues)
|
|
.where(and(eq(issues.companyId, companyId), inArray(issues.id, pending), readCondition));
|
|
|
|
const nextPending = new Set<string>();
|
|
for (const row of rows) {
|
|
rowsById.set(row.id, row);
|
|
if (row.parentId && !rowsById.has(row.parentId)) {
|
|
nextPending.add(row.parentId);
|
|
}
|
|
}
|
|
pending = [...nextPending];
|
|
}
|
|
|
|
return rowsById;
|
|
}
|
|
|
|
function getIssueSummary(issue: IssueGroupingRow) {
|
|
return {
|
|
id: issue.id,
|
|
identifier: issue.identifier ?? issue.id,
|
|
title: issue.title,
|
|
};
|
|
}
|
|
|
|
function resolveRootIssueId(issueId: string, issueRows: Map<string, IssueGroupingRow>) {
|
|
let current = issueRows.get(issueId);
|
|
if (!current) return issueId;
|
|
const seen = new Set<string>();
|
|
while (current.parentId && !seen.has(current.id)) {
|
|
seen.add(current.id);
|
|
const parent = issueRows.get(current.parentId);
|
|
if (!parent) break;
|
|
current = parent;
|
|
}
|
|
return current.id;
|
|
}
|
|
|
|
function resolveGroupIssueId(groupBy: ArtifactGroupBy, issueId: string, issueRows: Map<string, IssueGroupingRow>) {
|
|
return groupBy === "task" ? issueId : resolveRootIssueId(issueId, issueRows);
|
|
}
|
|
|
|
function emptyGroup(input: {
|
|
companyPrefix: string;
|
|
query: CompanyArtifactsQuery;
|
|
groupBy: ArtifactGroupBy;
|
|
issue: IssueGroupingRow;
|
|
}): CompanyArtifactGroup {
|
|
const summary = getIssueSummary(input.issue);
|
|
return {
|
|
id: `${input.groupBy}:${input.issue.id}`,
|
|
groupBy: input.groupBy,
|
|
issue: summary,
|
|
title: summary.title,
|
|
count: 0,
|
|
mediaKinds: [],
|
|
previewArtifacts: [],
|
|
updatedAt: input.issue.updatedAt.toISOString(),
|
|
href: buildArtifactsGroupHref(input.companyPrefix, input.query, input.groupBy, input.issue.id),
|
|
};
|
|
}
|
|
|
|
function buildArtifactGroups(input: {
|
|
artifacts: CompanyArtifact[];
|
|
companyPrefix: string;
|
|
query: CompanyArtifactsQuery;
|
|
groupBy: ArtifactGroupBy;
|
|
issueRows: Map<string, IssueGroupingRow>;
|
|
}) {
|
|
const groups = new Map<string, CompanyArtifactGroup>();
|
|
|
|
for (const artifact of input.artifacts) {
|
|
const groupIssueId = resolveGroupIssueId(input.groupBy, artifact.issue.id, input.issueRows);
|
|
const groupIssue = input.issueRows.get(groupIssueId) ?? {
|
|
id: artifact.issue.id,
|
|
parentId: null,
|
|
identifier: artifact.issue.identifier,
|
|
title: artifact.issue.title,
|
|
updatedAt: new Date(artifact.updatedAt),
|
|
};
|
|
const groupId = `${input.groupBy}:${groupIssueId}`;
|
|
const existing = groups.get(groupId);
|
|
const group = existing ?? emptyGroup({
|
|
companyPrefix: input.companyPrefix,
|
|
query: input.query,
|
|
groupBy: input.groupBy,
|
|
issue: groupIssue,
|
|
});
|
|
if (!existing) groups.set(groupId, group);
|
|
|
|
group.count += 1;
|
|
if (!group.mediaKinds.includes(artifact.mediaKind)) {
|
|
group.mediaKinds.push(artifact.mediaKind);
|
|
}
|
|
if (group.previewArtifacts.length < GROUP_PREVIEW_ARTIFACT_LIMIT) {
|
|
group.previewArtifacts.push(artifact);
|
|
}
|
|
if (Date.parse(artifact.updatedAt) > Date.parse(group.updatedAt)) {
|
|
group.updatedAt = artifact.updatedAt;
|
|
}
|
|
}
|
|
|
|
return [...groups.values()].sort((a, b) => {
|
|
const dateDiff = Date.parse(b.updatedAt) - Date.parse(a.updatedAt);
|
|
if (dateDiff !== 0) return dateDiff;
|
|
return b.id.localeCompare(a.id);
|
|
});
|
|
}
|
|
|
|
export function companyArtifactsService(db: Db, storage?: StorageService) {
|
|
return {
|
|
list: async (
|
|
companyId: string,
|
|
rawQuery: Partial<CompanyArtifactsQuery> = {},
|
|
/** `readCondition` limits artifacts and group tasks to tasks the caller can read. */
|
|
options: {
|
|
issueConditions?: SQL[];
|
|
readCondition?: SQL;
|
|
userId?: string;
|
|
/** Leave out the `artifact-review-*` documents materialized to review a work product (the work product is listed). */
|
|
excludeArtifactReviewDocuments?: boolean;
|
|
} = {},
|
|
): Promise<CompanyArtifactsResponse> => {
|
|
const query = companyArtifactsQuerySchema.parse(rawQuery);
|
|
const cursor = decodeCursor(query.cursor);
|
|
const groupBy = query.groupBy === "none" ? null : query.groupBy;
|
|
const company = await db
|
|
.select({ id: companies.id, issuePrefix: companies.issuePrefix })
|
|
.from(companies)
|
|
.where(eq(companies.id, companyId))
|
|
.then((rows) => rows[0] ?? null);
|
|
if (!company) throw notFound("Company not found");
|
|
|
|
if (query.starred && !options.userId) {
|
|
return { artifacts: [], nextCursor: null };
|
|
}
|
|
|
|
const fetchLimit = Math.min(query.limit + 1, COMPANY_ARTIFACTS_MAX_LIMIT + 1);
|
|
const sourceFetchLimit = groupBy ? GROUPED_ARTIFACT_FETCH_LIMIT : fetchLimit;
|
|
const q = query.q ? `%${escapeLikePattern(query.q)}%` : null;
|
|
const issueConditions: SQL[] = [
|
|
isNull(issues.hiddenAt),
|
|
isNull(issues.harnessKind),
|
|
...(options.issueConditions ?? []),
|
|
...(options.readCondition ? [options.readCondition] : []),
|
|
];
|
|
const artifacts: CompanyArtifact[] = [];
|
|
const artifactSortDates = new Map<string, string>();
|
|
const workProductAttachmentIds = new Set<string>();
|
|
|
|
if (query.kind === "all" || query.kind === "document") {
|
|
const createdAgent = alias(agents, "document_created_agent");
|
|
const updatedAgent = alias(agents, "document_updated_agent");
|
|
const documentArtifactId = sql<string>`concat('document:', ${documents.id})`;
|
|
const documentConditions: SQL[] = [
|
|
eq(issueDocuments.companyId, companyId),
|
|
eq(documents.companyId, companyId),
|
|
...issueConditions,
|
|
...(query.starred
|
|
? [
|
|
eq(documentMemberships.companyId, companyId),
|
|
eq(documentMemberships.userId, options.userId!),
|
|
isNotNull(documentMemberships.starredAt),
|
|
]
|
|
: [
|
|
or(isNotNull(documents.createdByAgentId), isNotNull(documents.updatedByAgentId))!,
|
|
notInArray(issueDocuments.key, [...SYSTEM_ISSUE_DOCUMENT_KEYS]),
|
|
]),
|
|
...(options.excludeArtifactReviewDocuments
|
|
? [sql`${issueDocuments.key} not like ${`${ARTIFACT_REVIEW_DOCUMENT_KEY_PREFIX}%`}`]
|
|
: []),
|
|
];
|
|
const documentSortDate = query.starred
|
|
? sql<Date>`${documentMemberships.starredAt}`
|
|
: sql<Date>`${documents.updatedAt}`;
|
|
const documentCursor = groupBy ? undefined : cursorCondition(documentSortDate, documentArtifactId, cursor);
|
|
if (documentCursor) documentConditions.push(documentCursor);
|
|
if (groupBy === "task" && query.groupIssueId) documentConditions.push(eq(issues.id, query.groupIssueId));
|
|
if (query.projectId) documentConditions.push(eq(issues.projectId, query.projectId));
|
|
if (query.agentId) documentConditions.push(sql`coalesce(${createdAgent.id}, ${updatedAgent.id}) = ${query.agentId}`);
|
|
if (q) {
|
|
documentConditions.push(sql`(
|
|
coalesce(${documents.title}, '') ILIKE ${q} ESCAPE '\\'
|
|
OR ${documents.latestBody} ILIKE ${q} ESCAPE '\\'
|
|
OR coalesce(${issues.identifier}, '') ILIKE ${q} ESCAPE '\\'
|
|
OR ${issues.title} ILIKE ${q} ESCAPE '\\'
|
|
)`);
|
|
}
|
|
|
|
const documentRowsQuery = db
|
|
.select({
|
|
artifactId: documentArtifactId,
|
|
documentId: documents.id,
|
|
issueId: issues.id,
|
|
issueIdentifier: issues.identifier,
|
|
issueTitle: issues.title,
|
|
projectId: projects.id,
|
|
projectName: projects.name,
|
|
key: issueDocuments.key,
|
|
title: documents.title,
|
|
latestBody: documents.latestBody,
|
|
createdByAgentId: sql<string | null>`coalesce(${createdAgent.id}, ${updatedAgent.id})`,
|
|
createdByAgentName: sql<string | null>`coalesce(${createdAgent.name}, ${updatedAgent.name})`,
|
|
updatedAt: documents.updatedAt,
|
|
starredAt: documentMemberships.starredAt,
|
|
})
|
|
.from(issueDocuments)
|
|
.innerJoin(
|
|
documents,
|
|
and(
|
|
eq(issueDocuments.documentId, documents.id),
|
|
eq(documents.companyId, issueDocuments.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
documentMemberships,
|
|
and(
|
|
eq(documentMemberships.documentId, documents.id),
|
|
eq(documentMemberships.companyId, documents.companyId),
|
|
eq(documentMemberships.userId, options.userId ?? ""),
|
|
),
|
|
)
|
|
.innerJoin(
|
|
issues,
|
|
and(
|
|
eq(issueDocuments.issueId, issues.id),
|
|
eq(issues.companyId, issueDocuments.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
projects,
|
|
and(
|
|
eq(issues.projectId, projects.id),
|
|
eq(projects.companyId, issues.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
createdAgent,
|
|
and(
|
|
eq(documents.createdByAgentId, createdAgent.id),
|
|
eq(createdAgent.companyId, documents.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
updatedAgent,
|
|
and(
|
|
eq(documents.updatedByAgentId, updatedAgent.id),
|
|
eq(updatedAgent.companyId, documents.companyId),
|
|
),
|
|
)
|
|
.where(and(...documentConditions))
|
|
.orderBy(desc(documentSortDate), desc(documentArtifactId));
|
|
const documentRows = await documentRowsQuery.limit(sourceFetchLimit);
|
|
|
|
for (const row of documentRows) {
|
|
const identifier = row.issueIdentifier ?? row.issueId;
|
|
artifactSortDates.set(row.artifactId, (row.starredAt ?? row.updatedAt).toISOString());
|
|
artifacts.push({
|
|
id: row.artifactId,
|
|
source: "document",
|
|
mediaKind: "document",
|
|
title: row.title ?? row.key,
|
|
previewText: normalizePreviewText(row.latestBody),
|
|
contentType: "text/markdown",
|
|
contentPath: null,
|
|
openPath: null,
|
|
downloadPath: null,
|
|
issue: { id: row.issueId, identifier, title: row.issueTitle },
|
|
project: row.projectId && row.projectName ? { id: row.projectId, name: row.projectName } : null,
|
|
createdByAgent: row.createdByAgentId && row.createdByAgentName
|
|
? { id: row.createdByAgentId, name: row.createdByAgentName }
|
|
: null,
|
|
updatedAt: row.updatedAt.toISOString(),
|
|
href: buildIssueHref(company.issuePrefix, identifier, `document-${row.key}`),
|
|
});
|
|
}
|
|
}
|
|
|
|
if (!query.starred && query.kind !== "document") {
|
|
const workProductAgent = alias(agents, "work_product_agent");
|
|
const workProductArtifactId = sql<string>`concat('work_product:', ${issueWorkProducts.id})`;
|
|
const workProductContentType = sql<string>`coalesce(${issueWorkProducts.metadata}->>'contentType', '')`;
|
|
const workProductBaseConditions: SQL[] = [
|
|
eq(issueWorkProducts.companyId, companyId),
|
|
eq(issueWorkProducts.type, "artifact"),
|
|
eq(issueWorkProducts.provider, "paperclip"),
|
|
...issueConditions,
|
|
];
|
|
const workProductConditions: SQL[] = [...workProductBaseConditions];
|
|
const workProductCursor = groupBy
|
|
? undefined
|
|
: cursorCondition(sql<Date>`${issueWorkProducts.updatedAt}`, workProductArtifactId, cursor);
|
|
const workProductKind = contentTypeKindCondition(workProductContentType, query.kind);
|
|
if (workProductCursor) workProductConditions.push(workProductCursor);
|
|
if (groupBy === "task" && query.groupIssueId) {
|
|
const selectedIssueCondition = eq(issues.id, query.groupIssueId);
|
|
workProductBaseConditions.push(selectedIssueCondition);
|
|
workProductConditions.push(selectedIssueCondition);
|
|
}
|
|
if (workProductKind) {
|
|
workProductBaseConditions.push(workProductKind);
|
|
workProductConditions.push(workProductKind);
|
|
}
|
|
if (query.projectId) {
|
|
const projectCondition = eq(issues.projectId, query.projectId);
|
|
workProductBaseConditions.push(projectCondition);
|
|
workProductConditions.push(projectCondition);
|
|
}
|
|
// Agent filter applies to the listed rows only; the attachment dedupe
|
|
// below stays company-wide so a work product's file never re-lists.
|
|
if (query.agentId) workProductConditions.push(eq(workProductAgent.id, query.agentId));
|
|
if (q) {
|
|
const searchCondition = sql`(
|
|
${issueWorkProducts.title} ILIKE ${q} ESCAPE '\\'
|
|
OR coalesce(${issueWorkProducts.summary}, '') ILIKE ${q} ESCAPE '\\'
|
|
OR coalesce(${issues.identifier}, '') ILIKE ${q} ESCAPE '\\'
|
|
OR ${issues.title} ILIKE ${q} ESCAPE '\\'
|
|
)`;
|
|
workProductBaseConditions.push(searchCondition);
|
|
workProductConditions.push(searchCondition);
|
|
}
|
|
|
|
const workProductRowsQuery = db
|
|
.select({
|
|
artifactId: workProductArtifactId,
|
|
workProductId: issueWorkProducts.id,
|
|
issueId: issues.id,
|
|
issueIdentifier: issues.identifier,
|
|
issueTitle: issues.title,
|
|
projectId: projects.id,
|
|
projectName: projects.name,
|
|
title: issueWorkProducts.title,
|
|
summary: issueWorkProducts.summary,
|
|
metadata: issueWorkProducts.metadata,
|
|
createdByAgentId: workProductAgent.id,
|
|
createdByAgentName: workProductAgent.name,
|
|
updatedAt: issueWorkProducts.updatedAt,
|
|
})
|
|
.from(issueWorkProducts)
|
|
.innerJoin(
|
|
issues,
|
|
and(
|
|
eq(issueWorkProducts.issueId, issues.id),
|
|
eq(issues.companyId, issueWorkProducts.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
projects,
|
|
and(
|
|
eq(issues.projectId, projects.id),
|
|
eq(projects.companyId, issueWorkProducts.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
heartbeatRuns,
|
|
and(
|
|
eq(issueWorkProducts.createdByRunId, heartbeatRuns.id),
|
|
eq(heartbeatRuns.companyId, issueWorkProducts.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
workProductAgent,
|
|
and(
|
|
eq(heartbeatRuns.agentId, workProductAgent.id),
|
|
eq(workProductAgent.companyId, issueWorkProducts.companyId),
|
|
),
|
|
)
|
|
.where(and(...workProductConditions))
|
|
.orderBy(desc(issueWorkProducts.updatedAt), desc(workProductArtifactId));
|
|
const workProductRows = await workProductRowsQuery.limit(sourceFetchLimit);
|
|
|
|
const workProductAttachmentRows = await db
|
|
.select({
|
|
attachmentId: sql<string | null>`${issueWorkProducts.metadata}->>'attachmentId'`,
|
|
})
|
|
.from(issueWorkProducts)
|
|
.innerJoin(
|
|
issues,
|
|
and(
|
|
eq(issueWorkProducts.issueId, issues.id),
|
|
eq(issues.companyId, issueWorkProducts.companyId),
|
|
),
|
|
)
|
|
.where(and(...workProductBaseConditions, sql`${issueWorkProducts.metadata}->>'attachmentId' IS NOT NULL`))
|
|
.limit(sourceFetchLimit);
|
|
|
|
for (const row of workProductAttachmentRows) {
|
|
if (row.attachmentId) {
|
|
workProductAttachmentIds.add(row.attachmentId);
|
|
}
|
|
}
|
|
|
|
for (const row of workProductRows) {
|
|
const metadata = attachmentArtifactWorkProductMetadataSchema.safeParse(row.metadata);
|
|
const attachmentMetadata = metadata.success ? metadata.data : null;
|
|
if (attachmentMetadata) {
|
|
workProductAttachmentIds.add(attachmentMetadata.attachmentId);
|
|
}
|
|
const contentType = attachmentMetadata?.contentType ?? null;
|
|
const identifier = row.issueIdentifier ?? row.issueId;
|
|
artifacts.push({
|
|
id: row.artifactId,
|
|
source: "work_product",
|
|
mediaKind: classifyMediaKind(contentType, attachmentMetadata ? "file" : "empty"),
|
|
title: row.title,
|
|
previewText: normalizePreviewText(row.summary),
|
|
contentType,
|
|
contentPath: attachmentMetadata?.contentPath ?? null,
|
|
openPath: attachmentMetadata?.openPath ?? (typeof row.metadata?.openPath === "string" ? row.metadata.openPath : null),
|
|
downloadPath: attachmentMetadata?.downloadPath ?? null,
|
|
issue: { id: row.issueId, identifier, title: row.issueTitle },
|
|
project: row.projectId && row.projectName ? { id: row.projectId, name: row.projectName } : null,
|
|
createdByAgent: row.createdByAgentId && row.createdByAgentName
|
|
? { id: row.createdByAgentId, name: row.createdByAgentName }
|
|
: null,
|
|
updatedAt: row.updatedAt.toISOString(),
|
|
href: buildIssueHref(company.issuePrefix, identifier, `work-product-${row.workProductId}`),
|
|
});
|
|
}
|
|
|
|
const attachmentAgent = alias(agents, "attachment_agent");
|
|
const attachmentArtifactId = sql<string>`concat('attachment:', ${issueAttachments.id})`;
|
|
const attachmentConditions: SQL[] = [
|
|
eq(issueAttachments.companyId, companyId),
|
|
isNull(issueAttachments.issueCommentId),
|
|
isNotNull(assets.createdByAgentId),
|
|
...issueConditions,
|
|
];
|
|
const attachmentCursor = groupBy
|
|
? undefined
|
|
: cursorCondition(sql<Date>`${issueAttachments.updatedAt}`, attachmentArtifactId, cursor);
|
|
const attachmentKind = contentTypeKindCondition(sql<string>`${assets.contentType}`, query.kind);
|
|
if (attachmentCursor) attachmentConditions.push(attachmentCursor);
|
|
if (groupBy === "task" && query.groupIssueId) attachmentConditions.push(eq(issues.id, query.groupIssueId));
|
|
if (attachmentKind) attachmentConditions.push(attachmentKind);
|
|
if (query.projectId) attachmentConditions.push(eq(issues.projectId, query.projectId));
|
|
if (query.agentId) attachmentConditions.push(eq(attachmentAgent.id, query.agentId));
|
|
if (q) {
|
|
attachmentConditions.push(sql`(
|
|
coalesce(${assets.originalFilename}, '') ILIKE ${q} ESCAPE '\\'
|
|
OR coalesce(${issues.identifier}, '') ILIKE ${q} ESCAPE '\\'
|
|
OR ${issues.title} ILIKE ${q} ESCAPE '\\'
|
|
)`);
|
|
}
|
|
|
|
const attachmentRowsQuery = db
|
|
.select({
|
|
artifactId: attachmentArtifactId,
|
|
attachmentId: issueAttachments.id,
|
|
companyId: issueAttachments.companyId,
|
|
issueId: issues.id,
|
|
issueIdentifier: issues.identifier,
|
|
issueTitle: issues.title,
|
|
projectId: projects.id,
|
|
projectName: projects.name,
|
|
objectKey: assets.objectKey,
|
|
contentType: assets.contentType,
|
|
byteSize: assets.byteSize,
|
|
originalFilename: assets.originalFilename,
|
|
createdByAgentId: attachmentAgent.id,
|
|
createdByAgentName: attachmentAgent.name,
|
|
updatedAt: issueAttachments.updatedAt,
|
|
})
|
|
.from(issueAttachments)
|
|
.innerJoin(
|
|
assets,
|
|
and(
|
|
eq(issueAttachments.assetId, assets.id),
|
|
eq(assets.companyId, issueAttachments.companyId),
|
|
),
|
|
)
|
|
.innerJoin(
|
|
issues,
|
|
and(
|
|
eq(issueAttachments.issueId, issues.id),
|
|
eq(issues.companyId, issueAttachments.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
projects,
|
|
and(
|
|
eq(issues.projectId, projects.id),
|
|
eq(projects.companyId, issues.companyId),
|
|
),
|
|
)
|
|
.leftJoin(
|
|
attachmentAgent,
|
|
and(
|
|
eq(assets.createdByAgentId, attachmentAgent.id),
|
|
eq(attachmentAgent.companyId, assets.companyId),
|
|
),
|
|
)
|
|
.where(and(...attachmentConditions))
|
|
.orderBy(desc(issueAttachments.updatedAt), desc(attachmentArtifactId));
|
|
const attachmentRows = await attachmentRowsQuery.limit(sourceFetchLimit);
|
|
|
|
const attachmentArtifacts = await Promise.all(attachmentRows.map(async (row): Promise<CompanyArtifact | null> => {
|
|
if (workProductAttachmentIds.has(row.attachmentId)) return null;
|
|
const mediaKind = classifyMediaKind(row.contentType);
|
|
const contentPath = attachmentContentPath(row.attachmentId);
|
|
const identifier = row.issueIdentifier ?? row.issueId;
|
|
return {
|
|
id: row.artifactId,
|
|
source: "attachment",
|
|
mediaKind,
|
|
title: row.originalFilename ?? "Attachment",
|
|
previewText: mediaKind === "text"
|
|
? await readTextAttachmentPreview(storage, {
|
|
companyId: row.companyId,
|
|
objectKey: row.objectKey,
|
|
byteSize: row.byteSize,
|
|
})
|
|
: null,
|
|
contentType: row.contentType,
|
|
contentPath,
|
|
openPath: contentPath,
|
|
downloadPath: `${contentPath}?download=1`,
|
|
issue: { id: row.issueId, identifier, title: row.issueTitle },
|
|
project: row.projectId && row.projectName ? { id: row.projectId, name: row.projectName } : null,
|
|
createdByAgent: row.createdByAgentId && row.createdByAgentName
|
|
? { id: row.createdByAgentId, name: row.createdByAgentName }
|
|
: null,
|
|
updatedAt: row.updatedAt.toISOString(),
|
|
href: buildIssueHref(company.issuePrefix, identifier, `attachment-${row.attachmentId}`),
|
|
};
|
|
}));
|
|
|
|
artifacts.push(...attachmentArtifacts.filter((artifact): artifact is CompanyArtifact => artifact !== null));
|
|
}
|
|
|
|
const sorted = sortArtifacts(artifacts, artifactSortDates);
|
|
if (!groupBy) {
|
|
const page = sorted.slice(0, query.limit);
|
|
const last = page[page.length - 1];
|
|
const nextCursor = sorted.length > query.limit
|
|
? encodeCursor({
|
|
id: last?.id ?? "",
|
|
updatedAt: last ? artifactSortDates.get(last.id) ?? last.updatedAt : new Date(0).toISOString(),
|
|
})
|
|
: null;
|
|
|
|
return { artifacts: page, nextCursor };
|
|
}
|
|
|
|
const issueSeedIds = new Set(artifacts.map((artifact) => artifact.issue.id));
|
|
if (query.groupIssueId) issueSeedIds.add(query.groupIssueId);
|
|
const issueRows = await loadIssueGroupingRows(db, companyId, issueSeedIds, options.readCondition);
|
|
const groups = buildArtifactGroups({
|
|
artifacts: sorted,
|
|
companyPrefix: company.issuePrefix,
|
|
query,
|
|
groupBy,
|
|
issueRows,
|
|
});
|
|
|
|
if (query.groupIssueId) {
|
|
const selectedIssue = issueRows.get(query.groupIssueId);
|
|
if (!selectedIssue) {
|
|
return { artifacts: [], selectedGroup: null, nextCursor: null };
|
|
}
|
|
|
|
const selectedGroupIssueId = resolveGroupIssueId(groupBy, selectedIssue.id, issueRows);
|
|
const selectedGroup = groups.find((group) => group.issue.id === selectedGroupIssueId)
|
|
?? emptyGroup({
|
|
companyPrefix: company.issuePrefix,
|
|
query,
|
|
groupBy,
|
|
issue: issueRows.get(selectedGroupIssueId) ?? selectedIssue,
|
|
});
|
|
const selectedArtifacts = sorted.filter((artifact) =>
|
|
resolveGroupIssueId(groupBy, artifact.issue.id, issueRows) === selectedGroupIssueId
|
|
);
|
|
const { page, nextCursor } = pageByCursor(selectedArtifacts, query.limit, cursor);
|
|
return { artifacts: page, selectedGroup, nextCursor };
|
|
}
|
|
|
|
const { page, nextCursor } = pageByCursor(groups, query.limit, cursor);
|
|
return { artifacts: [], groups: page, nextCursor };
|
|
},
|
|
};
|
|
}
|