Skip to content

fix(docs-mcp): detect true mirror duplicates - #459

Merged
MuncleUscles merged 2 commits into
mainfrom
codex/docs-mcp-rollout-fix
Aug 24, 2026
Merged

fix(docs-mcp): detect true mirror duplicates#459
MuncleUscles merged 2 commits into
mainfrom
codex/docs-mcp-rollout-fix

Conversation

@MuncleUscles

@MuncleUscles MuncleUscles commented Aug 24, 2026

Copy link
Copy Markdown
Member

Summary

  • force HTML content negotiation for the GenLayer docs scrape so final source URLs remain canonical
  • detect duplicate search results by canonical URL identity instead of rejecting every .md result
  • normalize the docs-mcp-server v3 index.html.md and index.md source forms
  • exercise the image-owned entrypoint in CI and include conflicting URLs in canary failures

Context

The AWS rollout canary exposed a real canonical/.md pair. An exact docs-mcp-server 3.0.1 full-index reproduction showed why: URL exclusions run before fetch, but some accepted canonical requests later resolve to .md source URLs. The same 225-page reproduction with Accept: text/html stored zero .md URLs and retained both canonical Equivalence Principle pages.

The detector was also broader than its name: a single valid Markdown source would fail even when no HTML mirror was returned. It now compares canonical page identities and only rejects actual pairs.

Validation

  • exact 3.0.1 full-index reproduction with local fixture embeddings: 225 pages, zero .md URLs
  • node --test docs-mcp/*.test.mjs: 9/9 passing
  • Node 22 syntax checks
  • coverage includes the image entrypoint’s HTML header, canonical + .md, canonical + index.html.md, root + index.md, and standalone Markdown-source acceptance

Depends-On: genlayerlabs/devexp-argocd-apps#651

@netlify

netlify Bot commented Aug 24, 2026

Copy link
Copy Markdown

Deploy Preview for genlayer-docs ready!

Name Link
🔨 Latest commit 9eaa334
🔍 Latest deploy log https://app.netlify.com/projects/genlayer-docs/deploys/6a8c90f0638a7d00089a002e
😎 Deploy Preview https://deploy-preview-459--genlayer-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@coderabbitai

coderabbitai Bot commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

Next included review available in 1 minute.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 793ec55c-6669-46d1-b008-36cb2605129e

📥 Commits

Reviewing files that changed from the base of the PR and between 4f42316 and 9eaa334.

📒 Files selected for processing (6)
  • .github/workflows/docs-mcp.yml
  • docs-mcp/OPERATIONS.md
  • docs-mcp/entrypoint.sh
  • docs-mcp/entrypoint.test.mjs
  • docs-mcp/smoke-test.mjs
  • docs-mcp/smoke-test.test.mjs

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@MuncleUscles
MuncleUscles merged commit d072822 into main Aug 24, 2026
8 checks passed
@MuncleUscles
MuncleUscles deleted the codex/docs-mcp-rollout-fix branch August 24, 2026 18:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant