fix(seo): GEO hygiene — indexing, canonical URLs, llms.txt, docs redirects, library consolidation by waleedlatif1 · Pull Request #8508 · simstudioai/sim

waleedlatif1 · 2026-10-01T07:44:06Z

Summary

Single source of truth for public site URLs (@sim/utils/site); SITE_URL, docs SIM_SITE_URL, and DOCS_URL derive from it. Apex https://sim.ai links (each a 301 hop; POSTs lose their body) rewritten to www, with a new check:site-urls audit so they can't creep back
Content canonicals are now derived from the section basePath + slug; the hand-written canonical: frontmatter field is gone (one article pointed at a different page)
Indexing: app/utility surfaces get X-Robots-Tag: noindex from the proxy (incl. the signed-out /workspace → /login redirect) instead of robots.txt disallows that kept them "indexed, though blocked"; /_next/ no longer blocked; non-landing routes no longer inherit a homepage canonical/og:url; deployed chats are noindex with their own preview tags
llms.txt / llms-full.txt generated from the content registries, comparison data, and navigation (library, comparisons, solutions, blog, full article text) using canonical URLs
Docs: removed locale prefixes (/fr, /es, /de, /ja, /zh, /en) redirect to the English page in one hop; 404 no longer emits conflicting robots tags or a root canonical; llms.txt dead /tools/ link fixed; git-based lastModified for sitemap + TechArticle JSON-LD from a single git log pass (skipped on shallow clones)
Library: merged 6 duplicate/overlapping articles into the stronger page with 301s and repointed inbound links; differentiated the remaining overlapping clusters (titles, descriptions, FAQ overlap, cross-links); added contextual links to the coding-tools comparison
Comparisons ↔ library interlinking derived from competitor names in article metadata
Integration pages: specific titles/H1s, factual WebPage + ItemList JSON-LD (no fake $0 offer), unsupported FAQ claims removed, same-category related integrations
One INTEGRATION_COUNT_LABEL; removed invalid self-curated review JSON-LD; Organization logo is a 512px raster; /changelog sitemap date no longer borrowed from the blog; /studio and /building legacy redirects are single-hop

Type of Change

Bug fix
Improvement

Testing

bun run type-check (apps/sim, apps/docs)
vitest run lib/content lib/navigation app/(landing) proxy.test.ts lib/compare (111 passing)
bun run lint, check:audits (53 passing incl. new check:site-urls), docs-manifest:check, block-registry check
Loaded both next.config redirect tables: no chains, every library redirect lands on an existing article; docs locale redirects curl-verified on a local docs server (308s land on the final URL, assets/llms routes unaffected)
All 79 content MDX files parse against the strict frontmatter schema and compile; every internal link resolves
Derived canonicals match the previous frontmatter values for every post (except the one that pointed elsewhere, now retired with a 301)
Docs lastModified from the single git pass matches git log -1 for all 505 pages (~0.2s vs ~11s per-file)

Checklist

Code follows project style guidelines
Self-reviewed my changes
Tests added/updated and passing (new tests pass the test-audit authoring gate)
No new warnings introduced
I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

…rects, library consolidation - Single source for public site URLs (@sim/utils/site) and a check:site-urls audit against apex links - Derive content canonicals from section basePath + slug instead of hand-written frontmatter - Replace robots.txt disallows for app surfaces with X-Robots-Tag noindex; stop blocking /_next/; drop the inherited homepage canonical and og:url; noindex deployed chats - Generate llms.txt / llms-full.txt from the content registries and comparison data - Docs: redirect removed locale URLs in one hop, fix 404 robots/canonical, git-based lastModified - Merge duplicate library articles with 301s and repoint inbound links; differentiate overlapping ones - Interlink comparisons and library; tighten integration page metadata and JSON-LD - One INTEGRATION_COUNT_LABEL; remove invalid review JSON-LD; raster Organization logo

vercel · 2026-10-01T07:44:13Z

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated
docs	Skipped		Oct 1, 2026 8:02am UTC

…t depend on git history

waleedlatif1 · 2026-10-01T07:47:56Z

@greptile

waleedlatif1 · 2026-10-01T07:47:57Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-01T07:48:04Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

greptile-apps · 2026-10-01T07:51:06Z

Confidence Score: 5/5

[Medium risk] Updates documentation URLs, SEO metadata, and content redirects.

The PR appears safe to merge; no new actionable defect or outstanding previous finding was established.

Summary

The PR consolidates canonical site URLs and content metadata, improves indexing and redirects, generates LLM-facing content from registries, and revises integration and library discovery. Since the previous review, it also adjusts competitor-name matching, fixes integration-description pluralization, and replaces arbitrary font sizes with named tokens.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  Registry[Content and comparison registries] --> Pages[Landing and integration pages]
  Registry --> LLM[llms.txt and llms-full.txt]
  Pages --> Metadata[Canonicals and structured metadata]
  URLs[Shared site URLs] --> Pages
  URLs --> Metadata
  Redirects[Legacy redirects] --> Pages

_{Reviews (4) · Last reviewed commit: "fix(landing): match bare competitor name..."}

waleedlatif1 · 2026-10-01T07:55:12Z

@greptile

waleedlatif1 · 2026-10-01T07:55:14Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-01T07:55:21Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 181 files

_{Reply with feedback, questions, or to request a fix.

Fix all with cubic | Re-trigger cubic}

…parison pages

…remaining actions

waleedlatif1 · 2026-10-01T08:02:14Z

@greptile

waleedlatif1 · 2026-10-01T08:02:15Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-01T08:02:21Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 181 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Re-trigger cubic}

waleedlatif1 requested a review from a team as a code owner October 1, 2026 07:44

vercel Bot had a problem deploying to Preview October 1, 2026 07:45 Failure

fix(docs): always register the lastModified plugin so page types don'…

fad5d3e

…t depend on git history

waleedlatif1 mentioned this pull request Oct 1, 2026

v0.9.8: search cleanup recovery, new search providers, billing and chat reliability #8494

Merged

vercel Bot deployed to Preview October 1, 2026 07:50 View deployment

greptile-apps Bot reviewed Oct 1, 2026

View reviewed changes

Comment thread apps/sim/app/(landing)/integrations/(shell)/[slug]/page.tsx

Comment thread apps/docs/content/docs/api-reference/python.mdx Outdated

greptile-apps Bot reviewed Oct 1, 2026

View reviewed changes

Comment thread apps/sim/app/(landing)/components/content-post-page/content-post-page.tsx

Comment thread apps/sim/app/(landing)/integrations/(shell)/[slug]/page.tsx

Comment thread apps/sim/app/(landing)/comparisons/components/comparison-links/comparison-links.tsx Outdated

fix(docs): say the SDK default host redirects to www

74088e1

vercel Bot deployed to Preview October 1, 2026 07:57 View deployment

greptile-apps Bot reviewed Oct 1, 2026

View reviewed changes

Comment thread apps/sim/app/(landing)/integrations/(shell)/[slug]/page.tsx Outdated

cubic-dev-ai Bot reviewed Oct 1, 2026

View reviewed changes

Comment thread apps/sim/lib/compare/data/competitors/make.ts

Comment thread apps/sim/app/(landing)/integrations/(shell)/[slug]/page.tsx Outdated

improvement(landing): use named type sizes on the integration and com…

1bd90a3

…parison pages

vercel Bot temporarily deployed to Preview October 1, 2026 08:00 Inactive

fix(landing): match bare competitor names in descriptions; pluralize …

b991a21

…remaining actions

vercel Bot temporarily deployed to Preview October 1, 2026 08:02 Inactive

cubic-dev-ai Bot reviewed Oct 1, 2026

View reviewed changes

waleedlatif1 merged commit 06139c5 into staging Oct 1, 2026
31 checks passed

waleedlatif1 deleted the chore/geo-hygiene branch October 1, 2026 08:07

waleedlatif1 mentioned this pull request Oct 1, 2026

v0.9.9: nextjs version bump, library articles, composer mention menu fixes #8523

Merged

Conversation

waleedlatif1 commented Oct 1, 2026

Summary

Type of Change

Testing

Checklist

Uh oh!

vercel Bot commented Oct 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

waleedlatif1 commented Oct 1, 2026

Uh oh!

waleedlatif1 commented Oct 1, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 1, 2026

Uh oh!

greptile-apps Bot commented Oct 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Confidence Score: 5/5

Summary

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

waleedlatif1 commented Oct 1, 2026

Uh oh!

waleedlatif1 commented Oct 1, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 1, 2026

Uh oh!

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

waleedlatif1 commented Oct 1, 2026

Uh oh!

waleedlatif1 commented Oct 1, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 1, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

This branch was previously deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

vercel Bot commented Oct 1, 2026 •

edited

Loading

greptile-apps Bot commented Oct 1, 2026 •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading