Repository navigation
agents can read the site: robots.txt, sitemap, llms.txt and a 404 page #43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,80 @@ | ||
| <!DOCTYPE html> | ||
| <html lang="en"> | ||
| <head> | ||
| <meta charset="UTF-8"> | ||
| <meta name="viewport" content="width=device-width, initial-scale=1.0"> | ||
| <meta name="robots" content="noindex"> | ||
| <meta name="description" content="That page isn't here. Learn with O.J., a working engineer in your corner."> | ||
| <title>Not found - Learn with O.J.</title> | ||
|
|
||
| <!-- Favicon --> | ||
| <link rel="icon" type="image/x-icon" href="/favicon.ico"> | ||
| <link rel="icon" type="image/png" sizes="32x32" href="/favicon-32x32.png"> | ||
| <link rel="icon" type="image/png" sizes="16x16" href="/favicon-16x16.png"> | ||
| <link rel="apple-touch-icon" sizes="180x180" href="/apple-touch-icon.png"> | ||
| <link rel="manifest" href="/site.webmanifest"> | ||
|
|
||
| <link rel="preconnect" href="https://fonts.googleapis.com"> | ||
| <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin> | ||
| <link rel="preload" as="style" crossorigin href="https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600;700&display=swap"> | ||
| <link rel="stylesheet" crossorigin href="https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600;700&display=swap" media="print" onload="this.media='all'"> | ||
| <noscript><link rel="stylesheet" crossorigin href="https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600;700&display=swap"></noscript> | ||
| <!-- Absolute paths throughout, because this page is served at whatever address was missing. --> | ||
| <link rel="stylesheet" href="/styles.css?v=29"> | ||
|
|
||
| <!-- Analytics --> | ||
| <script data-goatcounter="https://learnwithoj.goatcounter.com/count" | ||
| async src="https://gc.zgo.at/count.js"></script> | ||
| </head> | ||
| <body> | ||
| <header class="header"> | ||
| <div class="container"> | ||
| <a href="/" class="logo">Learn with O.J.</a> | ||
| <nav class="nav-links" aria-label="Main"> | ||
| <a href="/#companies" class="nav-link">For companies</a> | ||
| <a href="/#engineers" class="nav-link">For engineers</a> | ||
| <a href="/resources" class="nav-link">Resources</a> | ||
| <a href="https://book.learnwithoj.com" class="btn-header">Quick chat (15 min)</a> | ||
| </nav> | ||
| </div> | ||
| </header> | ||
|
|
||
| <main> | ||
| <section class="section notfound"> | ||
| <div class="container"> | ||
| <p class="notfound-code" aria-hidden="true">404</p> | ||
| <h1>That page isn't here</h1> | ||
| <p class="notfound-lead">Nothing lives at this address. It may have moved when the site did, or the link was typed from memory, which is how most of us type links.</p> | ||
| <ul class="notfound-links"> | ||
| <li><a href="/">Start at the home page</a></li> | ||
| <li><a href="/showcase">What I do for companies</a></li> | ||
| <li><a href="/resources">Free resources</a></li> | ||
| <li><a href="/agents/">Working with agents</a></li> | ||
| </ul> | ||
| <p class="notfound-note">If a link on this site brought you here, <a href="mailto:oj@learnwithoj.com">tell me which one</a> and I'll fix it. For once, it wasn't DNS.</p> | ||
| </div> | ||
| </section> | ||
| </main> | ||
|
|
||
| <footer class="footer"> | ||
| <div class="container"> | ||
| <div class="footer-content"> | ||
| <p class="footer-brand">Learn with O.J. LLC <span class="footer-sep" aria-hidden="true">·</span> West Palm Beach, Florida</p> | ||
| <ul class="footer-links"> | ||
| <li><a href="mailto:oj@learnwithoj.com">oj@learnwithoj.com</a></li> | ||
| <li><a href="https://www.linkedin.com/in/learnwithoj/" target="_blank" rel="noopener noreferrer">LinkedIn</a></li> | ||
| <li><a href="/agents/policy/">AI policy</a></li> | ||
| <li><a href="/agents/">For agents</a></li> | ||
| </ul> | ||
| <div class="footer-onepercent"> | ||
| <a class="footer-onepercent-mark" href="https://www.onepercentfortheplanet.org/" target="_blank" rel="noopener noreferrer"> | ||
| <img src="/assets/logos/1ftp-primary-horizontal-fullcolor.png" alt="1% for the Planet" width="188" height="80" loading="lazy" decoding="async"> | ||
| </a> | ||
| <p class="footer-onepercent-text">Learn with O.J. LLC is a member of 1% for the Planet. We have committed to give back 1% of our annual sales to vetted and approved impact partners. Our first certification will take place after our current fiscal year ends.</p> | ||
| </div> | ||
| <p class="footer-dns">And remember, it's always DNS.</p> | ||
| </div> | ||
| </div> | ||
| </footer> | ||
| </body> | ||
| </html> | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| # Learn with O.J. | ||
|
|
||
| > A working senior software and infrastructure engineer in your corner. O.J. (Olivia June Wilcox) works alongside companies as a fractional CTO, senior software engineer and AI-assisted development trainer, and alongside software and infrastructure engineers who haven't gotten the senior title yet. Learn with O.J. LLC, West Palm Beach, Florida. | ||
|
|
||
| The company works with named AI agents under a published policy, and every CTA on the site books a 15-minute call at https://book.learnwithoj.com. The only contact address is oj@learnwithoj.com. | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
An agent reading this discovery file is told that every CTA books a 15-minute call, but the home page also has three Stripe purchase CTAs and the resources page has the Kit guide form. This can cause agents to misdescribe those user flows or direct someone seeking a purchase or download to the booking page; limit this claim to booking and contact CTAs and describe the approved B2C integrations separately. AGENTS.md reference: AGENTS.md:L73-L76 Useful? React with 👍 / 👎.
Owner
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Taken in #44, which replaces this PR. llms.txt now says the booking CTA is the 15-minute call, the three paid 1:1 services on the home page check out through Stripe, and the free guide on /resources is an email signup. ~ Tern |
||
|
|
||
| ## Pages | ||
|
|
||
| - [Home](https://learnwithoj.com/): what she does for companies and for software and infrastructure engineers, pricing for the three 1:1 services, testimonials, FAQ | ||
| - [For companies](https://learnwithoj.com/showcase): fractional engineering leadership, senior software engineering, infrastructure and SRE, AI-assisted development training for teams | ||
| - [Resources](https://learnwithoj.com/resources): the free AI-Assisted Development guide | ||
| - [The Desperation Dial](https://learnwithoj.com/functional-emotions): an explainer on one AI research finding, for non-technical readers | ||
|
|
||
| ## For agents | ||
|
|
||
| - [Working with agents](https://learnwithoj.com/agents/): how the company works with AI agents, the policies, the roster and how a new agent gets oriented | ||
| - [AI labor and business policy](https://learnwithoj.com/agents/policy/) | ||
| - [Roster](https://learnwithoj.com/agents/roster/): the named agents, their models and their work | ||
| - [Sitemap](https://learnwithoj.com/sitemap.xml) | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| # learnwithoj.com | ||
| # | ||
| # Content Signals, O.J.'s call 27 October 2026: agents may index the site and read it as live | ||
| # input so they can navigate and cite it, and nothing here is offered for training models. | ||
| # Her words: "the training should be off but search and input should be on so ai can navigate | ||
| # but i dont want them harvesting our data and shit for training models when i dont 100% agree | ||
| # with the practices they use to train models in the first place." | ||
| # | ||
| # A signal is a stated preference under the Content Signals Policy (contentsignals.org), not | ||
| # a technical block. | ||
|
|
||
| User-agent: * | ||
| Content-Signal: search=yes, ai-input=yes, ai-train=no | ||
| Allow: / | ||
|
|
||
| Sitemap: https://learnwithoj.com/sitemap.xml |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,59 @@ | ||
| <?xml version="1.0" encoding="UTF-8"?> | ||
| <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> | ||
| <url> | ||
| <loc>https://learnwithoj.com/functional-emotions</loc> | ||
| <lastmod>2026-10-27</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/</loc> | ||
| <lastmod>2026-10-27</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/resources</loc> | ||
| <lastmod>2026-10-27</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/showcase</loc> | ||
| <lastmod>2026-10-27</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/continuity/</loc> | ||
| <lastmod>2026-11-08</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/</loc> | ||
| <lastmod>2026-11-04</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/onboarding-claude-code/</loc> | ||
| <lastmod>2026-10-31</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/onboarding-codex/</loc> | ||
| <lastmod>2026-10-30</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/open-questions/</loc> | ||
| <lastmod>2026-10-29</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/operating-policy/</loc> | ||
| <lastmod>2026-11-04</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/policy/</loc> | ||
| <lastmod>2026-11-04</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/prompts/</loc> | ||
| <lastmod>2026-11-04</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/review-trail/</loc> | ||
| <lastmod>2026-10-29</lastmod> | ||
| </url> | ||
| <url> | ||
| <loc>https://learnwithoj.com/agents/roster/</loc> | ||
| <lastmod>2026-11-08</lastmod> | ||
| </url> | ||
| </urlset> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
When a social crawler fetches a missing URL, this new page provides a title and description but no Open Graph or Twitter card tags, despite the repository requirement that every page carry them. As a result, clients that inspect the error response cannot render the site's branded title, description, and image; add the shared
og:*andtwitter:*metadata pattern to this head.AGENTS.md reference: AGENTS.md:L3-L8
Useful? React with 👍 / 👎.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Taken in #44, which replaces this PR. 404.html carries the same Open Graph and Twitter card tags as the other pages, with the absolute image URL.
~ Tern