Skip to content

Identify crawler purposes with distinct Signature-Agent URLs - #23

Merged
garyillyes merged 2 commits into
garyillyes:mainfrom
e271828-:main
Oct 22, 2026
Merged

garyillyes merged 2 commits into
garyillyes:mainfrom
e271828-:main

Conversation

@e271828-

@e271828- e271828- commented Oct 6, 2026 •

Copy link
Copy Markdown
Contributor

Crawler operators using cryptographic authentication SHOULD use distinct Signature-Agent URLs and key directories for each crawler purpose. References Section 6.5 of the protocol draft to keep the crawler guidance aligned with its identity model.

Companion: webbotauth/draft-ietf-webbotauth-httpsig-protocol#140

@e271828- e271828- changed the title Prefer use of distinct subdomains for different crawl types Identify crawler purposes with distinct Signature-Agent URLs Oct 12, 2026
@garyillyes
garyillyes merged commit 3267c43 into garyillyes:main Oct 22, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants