Skip to content

Let admins choose the trace backlog when enabling analysis - #1013

Draft
promptless[bot] wants to merge 10 commits into
mainfrom
promptless/trace-analysis-backlog-cutoff
Draft

promptless[bot] wants to merge 10 commits into
mainfrom
promptless/trace-analysis-backlog-cutoff

Conversation

@promptless

@promptless promptless Bot commented Sep 18, 2026 •

Copy link
Copy Markdown
Contributor

Proposed changes

Documents a Promptless Dashboard admin control that had no prior coverage in this collection: an organization admin's per-worker-installation Trace analyzer toggle, and the new backlog-cutoff choice ("All traces" or "Since date or time") that opens on enabling/resuming, from open source PR Promptless/promptless#5093 ("Let admins choose the trace backlog when enabling analysis", @adit-chandra).

Adds a new guide, docs/governance/deploy-the-worker/enable-trace-analysis.mdx, covering: enabling analysis and choosing the backlog; what "All traces" versus "Since date or time" means, including the activation floor and the model-provider data-exposure trade-off for "All traces"; pausing and resuming (and how that differs from the unrelated release-update pause on Manage updates and recovery); and recovering from a failed enable request. Adds disambiguating cross-links from Verify your deployment and Enroll your hosts, a reciprocal cross-link from Manage updates and recovery, a nav entry in astro.config.mjs, and a changelog entry.

Open items to confirm once source PR #5093 merges (org policy: an open/unmerged source PR does not hold back research or authoring; this suggestion/PR stays in draft until then):

  • Exact dialog control labels ("Enable trace analysis" title, "All traces"/"Since date or time" options, "Since date"/"Time (optional)" fields, "Enable analysis" button) are sourced from the PR diff only. The PR author states browser visual QA was not run, and this session had no live-dashboard access to confirm even the pre-existing toggle. Reconfirm every label against the live dialog once merged/deployed, and correct any that differ.
  • The PR's own rollout prerequisite (the worker build must deploy to every installation before this dashboard/runtime release merges) isn't determinable from the PR alone — confirm at merge whether/how it affects visibility for a given installation.
  • No Doc Detective test was authored: the documented dialog doesn't exist on main yet, this session had no reachable dashboard target, and no test scaffold exists yet for this governance/PIG dashboard surface (only the for-docs product dashboard has specs today). Follow-up: author .doc-detective/tests/enable-trace-analysis.spec.json once the feature is live and a login/fixture scaffold exists for this surface.
  • No screenshots included (feature unreleased; no live-dashboard access this session).

manni metadata (after #1177): The new page carries a manni id (governance-deploy-the-worker-enable-trace-analysis) and type: how-to, plus language, audiences, and lifecycle frontmatter. It also has a matching docs.metadata.yaml entry and git-derived created, last-updated, and owner stamps. These additions fix the validate check. The page also now has Overview and See also sections so it passes manni lint structure for the how-to template.

Checklist

  • Instructions and examples match the current product behavior.
  • Links and image references are valid.
  • Changed pages render correctly.

Adds a governance guide for the Promptless Dashboard's per-worker
Trace analyzer control, previously undocumented, and the new backlog
cutoff choice (All traces / Since date or time) from open source PR
Promptless/promptless#5093.
@vercel

vercel Bot commented Sep 18, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
promptless-docs Ready Ready Preview Oct 20, 2026 5:51pm UTC

Request Review

Comment thread src/content/docs/docs/governance/get-started/enroll-your-hosts.mdx
…ysis-backlog-cutoff

# Conflicts:
#	src/content/changelog/changelogs/september-2026.mdx
…ysis-backlog-cutoff

# Conflicts:
#	src/content/changelog/changelogs/september-2026.mdx
…ysis-backlog-cutoff

# Conflicts:
#	src/content/changelog/changelogs/september-2026.mdx
…ysis-backlog-cutoff

# Conflicts:
#	src/content/changelog/changelogs/september-2026.mdx
#	src/content/docs/docs/governance/deploy-the-worker/verify-your-deployment.mdx
@promptless

promptless Bot commented Oct 20, 2026

Copy link
Copy Markdown
Contributor Author

I noticed that some CI checks failed for this PR. I'm investigating whether the failures are caused by this suggestion. If they're unrelated or pre-existing, I'll leave this suggestion unchanged and create a separate suggestion if a standalone docs fix is needed.

This branch was successfully deployed

1 active deployment
Preview — 1e1a5eaa Deployed Oct 20, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant