Conversations: pin, archive, full-text search and export (#18)

[derekhearst]

Stacked on #98 (feat/32-orchestration); retargets to main once that merges. Adds migration 0079_conversation_lifecycle (pin/archive columns + a full-text search index) — not booted against the shared dev database; CI runs the specs on a fresh one. On first boot the search index is built for existing messages (SEARCH_BUILDER_VERSION 2).

Summary

Implements all four parts of #18. Schema: conversations gains nullable pinned_at/archived_at timestamps, and a new message_search side table holds each message's searchable text plus a generated tsvector with a GIN index. The migration is drizzle/0079_conversation_lifecycle.sql, made by db:generate; db:check passes and a second db:generate reports no changes. Pin and archive live in conversation-lifecycle.server.ts. Pinning unarchives, archiving unpins, and neither moves updatedAt. A message the user sends unarchives the chat; automation and monitor writes do not. getConversations now leaves archived chats out, returns every pinned chat plus the 50 most recent others, and trims the lastMessage preview to 280 characters. getArchivedConversations lists the archive, and the list fingerprint now also moves on pin and archive. Search: buildMessageSearchText indexes message text, attachment names, each tool call's paths, commands, short arguments and printed URLs, and subagent tasks. It skips file bodies, edit payloads, raw output, thinking and system messages, caps at 60k characters, and spells each path out as segments so options.server.ts, engine/options.server.ts and options all match. searchUserConversations ranks with ts_rank_cd, highlights with ts_headline using control-character markers, merges title matches, scopes to the caller, and hides archived chats unless asked. Indexing runs fire-and-forget after commit, and a batched keyset backfill runs at boot. Export: GET /chat/[id]/export?format=md|json downloads a readable Markdown transcript or a complete JSON file; another user's chat returns 404, and responses are attachment, no-store and nosniff. UI: each sidebar row has a menu (Archive first plus a one-click hover button, Pin, Rename, two exports, Delete last behind the danger confirmDialog). Pinned chats get their own group, the Status filter has a real Archived view, and a 250ms-debounced server search shows snippets rendered as text. On touch or phone widths the menu button is always visible. Docs, README and the parity rows are updated.

After review: Addressed every must_fix, should_fix and claimed-but-not-fixed item from the review of issue #18, plus minor notes 1, 2, 3 and 5. The branch now has 21 commits and a clean worktree.

1. Search snippets. A message of up to 100 characters is now shown whole with its matches marked (ts_headline HighlightAll). Longer messages keep two excerpts, now with ShortWord=0 so short words at the edges are kept. I checked this read-only against Postgres 17 using literal strings only: "fix the [login] bug now" and "fix R&D <3 [word] now" come back whole.
2. Search backfill. A batch that fails on a foreign key (a message deleted mid-batch) is retried one row at a time, and the deleted rows are skipped. The backfill also takes an optional conversation scope, which the spec now uses so it does not index other workers' rows.
3. Export file names. The readable file name is now cut by code points, and lone surrogates are dropped, so an emoji at the 80-character cut no longer causes a 500.
4. Sidebar order. The uncommitted ordering work is now committed as src/lib/chat/conversation-order.ts with a unit spec. Pinned chats are ordered by when they were pinned. The Archived view is ordered, grouped and dated by when each chat was archived.
5. Delete. The uncommitted delete work is now committed as src/lib/chat/conversation-delete.server.ts with 4 specs. It checks ownership first, stops any running turn through the run registry, waits up to 10 seconds, then deletes.
6. Home page on a phone. "Recent chats" now shows the five most recently active chats, so pinned chats no longer push newer ones off the list.
7. Minor notes. Pin and archive now answer 404 instead of throwing a plain Error for someone else's chat. The Archived view shows "Loading…" until its list arrives. The row menu refetches the archive only when the change affects it. The desktop lifecycle spec now bumps the chat's activity before Unarchive so it stays in the 50-most-recent list.

Docs (chat.md, chat-console.md) are updated. bun run check (0 errors), bun run build and db:check all pass.

Closes #18

What was addressed

Audit findings (from the 2026-09-22 subsystem audit) were re-checked against the code before any change; "not a bug" means the claim did not hold up.

#	Item	Verdict	Note
must_fix: message-search-sql.ts:81 short-message snippet	must_fix: message-search-sql.ts:81 short-message snippet	fixed	snippetSql(): a body of 100 characters or fewer uses ts_headline HighlightAll=true (the whole message, matches marked). Longer bodies use MaxFragments=2 with ShortWord=0. The root cause was ShortWord trimming the three-letter words at the document edge. Checked read-only on literal strings: short, short-word, '<3' and long cases all keep their context. New data-layer spec: 'the snippet shows a short message whole, and a long one around the match'. The sidebar spec's R&D <3 ${word} now expectation now matches.
should_fix: ConsoleNavContent.svelte:148 client re-sort discards server order	should_fix: ConsoleNavContent.svelte:148 client re-sort discards server order	fixed	Committed src/lib/chat/conversation-order.ts (groupConversations/listTime/sortConversations). Pinned are sorted by pinnedAt, the archive by archivedAt (sort, day grouping and row time label), the rest by updatedAt. Added tests/chat.conversation-order.spec.ts (9 pure tests; they pass under a bun shim that runs only pure code).
should_fix: chat.remote.ts:143 uncommitted delete/order work	should_fix: chat.remote.ts:143 uncommitted delete/order work	fixed	Both modules are committed with specs. tests/chat.conversation-delete.spec.ts covers four cases: a live run is interrupted and the delete waits for it to end; a stranger's delete neither deletes nor interrupts (ownership is checked first); a turn that is slow to stop is bounded by the settle time; with no live turn it is an ordinary delete and a finished run is left alone. chat.md documents it.
should_fix: conversation-export.ts:382 surrogate split -> URIError 500	should_fix: conversation-export.ts:382 surrogate split -> URIError 500	fixed	The name is sliced by code points and lone surrogates are stripped first. The spec covers the 79 'x' + emoji title and a title with a lone surrogate; neither throws in exportContentDisposition.
should_fix: message-search.server.ts:109 backfill FK 23503 aborts boot backfill	should_fix: message-search.server.ts:109 backfill FK 23503 aborts boot backfill	fixed	New indexMessagesSkippingGone: on 23503 it retries row by row and skips rows that are gone. backfillMessageSearch accepts an optional conversationId, and the spec is scoped with it. New spec: a batch with one deleted id writes the other row and does not throw.
should_fix: routes/+page.svelte:295 phone Recent chats show only pinned	should_fix: routes/+page.svelte:295 phone Recent chats show only pinned	fixed	The list is sorted by last activity (sortConversations 'Recency') before slice(0,5). New mobile spec seeds 5 old pinned and 5 fresh chats and asserts that none of the pinned ones appear under Recent chats.
claimed-not-fixed: pinned group orders by pin time	claimed-not-fixed: pinned group orders by pin time	fixed	Now true on HEAD via conversation-order.ts, and pinned by the order spec.
claimed-not-fixed: archive 'most recently archived first'	claimed-not-fixed: archive 'most recently archived first'	fixed	Now true on HEAD: sorted, grouped and labelled by archivedAt. Docs expanded to match.
claimed-not-fixed: search returns a matching snippet	claimed-not-fixed: search returns a matching snippet	fixed	See the must_fix entry. Short messages now return full context.
minor 1: plain Error -> 500 on pin/archive of a foreign chat	minor 1: plain Error -> 500 on pin/archive of a foreign chat	fixed	The server functions return null, and the remote commands call error(404). The spec is updated.
minor 2: refreshLists always refetches the archive	minor 2: refreshLists always refetches the archive	fixed	The archive is refetched only when the row is archived or the action is archive/unarchive.
minor 3: 'Nothing archived.' while loading	minor 3: 'Nothing archived.' while loading	fixed	Shows 'Loading…' until archivedQuery.ready (or an error).
minor 4: regenerate/edit in an archived chat does not unarchive	minor 4: regenerate/edit in an archived chat does not unarchive	deferred	Kept as documented: only a new user message brings a chat back.
minor 5: desktop UI spec could lose the unarchived chat under 8 workers	minor 5: desktop UI spec could lose the unarchived chat under 8 workers	fixed	The spec bumps updated_at before Unarchive.
minor 6: backfill vs live edit race on first boot	minor 6: backfill vs live edit race on first boot	deferred	The window is rare and short, and the next edit or reindex corrects it. Not addressed.
minor 7: prefix stemming quirk while typing	minor 7: prefix stemming quirk while typing	deferred	A Postgres FTS behaviour. Not addressed.

Verification

• bun run check: 0 errors
• bun run build: passes
• Specs: Playwright was not run and the app was not booted, as this branch requires (it adds migration 0079). Checks that were run: - bun run check: 0 errors, tests included. - bun run build: exit 0. - db:check: fine. - tests/chat.conversation-order.spec.ts: its 9 pure tests pass under bun with a shim for @playwright/test (no DB, no app). - Search SQL: read-only SELECTs of ts_headline over literal strings on the dev DB (no table access). The rendered snippetSql and textQuery run and produce the expected extracts. - Export file names: sanity-checked directly with bun. New and changed specs for CI: tests/chat.conversation-search.spec.ts, chat.conversation-export.spec.ts, chat.conversation-lifecycle.spec.ts, chat.conversation-order.spec.ts, chat.conversation-delete.spec.ts.
• Adds a migration — not booted against the shared dev database; CI runs the specs on a fresh one.
• Independent review: changes-needed (1 must-fix, 5 should-fix), addressed in a follow-up round.

Docs updated

• docs/chat/chat.md
• docs/chat-console/chat-console.md
• README.md
• docs/structure/claude-desktop-parity.md
• docs/structure/parity-reaudit-2026-09-22.md

Follow-ups / residual risk

1. README conflict. git merge-tree against origin/main (0bb97b6) still reports a content conflict in README.md; nothing else conflicts. It needs resolving when the PR is opened or main is merged in. I did not merge main here, per the no-merge rule.
2. Migration number. 0079_conversation_lifecycle is still free on origin/main, whose latest migration is 0078.
3. Playwright not run. The new and changed specs have not been executed with Playwright (branch rule), so CI is their first real run. Worth watching:
   • the delete spec: it relies on the spec and the server module sharing one run-registry instance, as tests/runs.lifecycle.spec.ts already does;
   • the mobile home "Recent chats" spec;
   • the sidebar search spec.
4. Deferred minors. Minor 4 (regenerate or edit does not unarchive; documented as intended), minor 6 (first-boot backfill vs live-edit race) and minor 7 (FTS prefix stemming) are left as they are.
5. Intermediate commits. Some intermediate commits were staged hunk by hunk. I checked that each intermediate file state is coherent. The home-page commit was amended once to fix a misplaced test block before anything else was built on it. The final tree is exactly what passed check and build.

🤖 Generated with Claude Code