Clerk scores 74/100 (Grade C), passing 12 of 22 checks (55%). The documentation is broadly accessible to AI agents but has 8 areas that could be improved to better serve automated tooling.
# Agent Score Fix Report — Clerk URL: https://clerk.com/docs Score: 74/100 (Grade C) I need help improving the AI-readiness of the documentation at https://clerk.com/docs. Agent Score found 4 failing checks and 4 warnings. ## Failing Checks (4) - [content-discoverability] Llms Txt Size: llms.txt is 297,392 characters (exceeds 100,000 threshold; will be truncated by most agents) - [content-discoverability] Llms Txt Directive: No llms.txt directive found in any of 10 sampled pages - [page-size] Page Size Html: 10 of 10 sampled pages convert to over 100K chars (max 628K, 27% boilerplate) - [observability] Markdown Content Parity: 6 of 8 pages have substantive content differences between markdown and HTML (avg 23% missing) ## Warnings (4) - [content-discoverability] Llms Txt Valid: llms.txt contains parseable links but doesn't fully follow the proposed structure: https://clerk.com/docs/llms.txt: No blockquote summary found - [markdown-availability] Markdown Url Support: 8/10 sampled pages support .md URLs (80%); inconsistent support - [markdown-availability] Content Negotiation: Content negotiation partially supported: 7 correct type, 0 wrong type, 3 HTML only - [observability] Llms Txt Freshness: llms.txt covers 2022/2213 sitemap doc pages (91%); 191 missing ## Fix Instructions For each issue above, please: 1. Analyze the documentation site at https://clerk.com/docs 2. Implement the specific fix 3. Verify the fix would cause the check to pass ### Common fixes: - **No llms.txt**: Create /llms.txt following https://llmstxt.org — list all doc pages in markdown format - **No .md URL support**: Configure your docs platform to serve pages at equivalent .md URLs (e.g. /docs/quickstart.md) - **No content negotiation**: Return markdown when request includes Accept: text/markdown header - **Large page size**: Reduce nav boilerplate, inline scripts, and repetitive markup - **No sitemap**: Generate /sitemap.xml listing all documentation URLs - **Auth walls**: Ensure docs pages return 200 without requiring login cookies or tokens - **No Last-Modified header**: Configure your server/CDN to include Last-Modified response headers - **Tab content hidden**: Ensure tabbed content is rendered in the HTML (not JS-only) so agents can read all variants ## Run afdocs Locally for More Detail To get deeper visibility into what's failing, run afdocs against your docs: npx afdocs https://clerk.com/docs --fixes --verbose - **--fixes**: Adds "Fix:" lines to the output for each warn/fail check with actionable remediation steps - **-v, --verbose**: Shows per-page details (specific URLs, character counts, error codes) for checks with issues — useful for per-URL visibility into what's failing
CHECK RESULTS
How your docs scored
markdown-url-support8/10 sampled pages support .md URLs (80%); inconsistent support
content-negotiationContent negotiation partially supported: 7 correct type, 0 wrong type, 3 HTML only
markdown-content-parity6 of 8 pages have substantive content differences between markdown and HTML (avg 23% missing)
llms-txt-freshnessllms.txt covers 2022/2213 sitemap doc pages (91%); 191 missing
cache-header-hygieneAll 12 endpoints have appropriate cache headers
auth-gate-detectionAll 10 sampled pages are publicly accessible
auth-alternative-accessAll docs pages are publicly accessible; no alternative access paths needed
llms-txt-sizellms.txt is 297,392 characters (exceeds 100,000 threshold; will be truncated by most agents)
llms-txt-directiveNo llms.txt directive found in any of 10 sampled pages
llms-txt-validllms.txt contains parseable links but doesn't fully follow the proposed structure: https://clerk.com/docs/llms.txt: No blockquote summary found
llms-txt-existsllms.txt found at 2 location(s)
llms-txt-links-resolveAll 10 same-origin sampled links resolve (2459 total links)
llms-txt-links-markdown9/10 same-origin sampled links point to markdown content (90%)
tabbed-content-serialization1 tab group(s) across 1 of 10 sampled pages; all serialize under 50K chars
markdown-code-fence-validityAll 9 code fences properly closed across 10 pages
section-header-quality1 page(s) with tabs found, but no section headers inside tab panels to evaluate
page-size-html10 of 10 sampled pages convert to over 100K chars (max 628K, 27% boilerplate)
rendering-strategyAll 10 sampled pages contain server-rendered content
page-size-markdownAll 8 pages under 50K chars (median 4K, max 18K)
content-start-positionContent starts within first 10% on all 10 sampled pages (median 2%)
http-status-codesAll 10 sampled pages return proper error codes for bad URLs
redirect-behaviorNo redirects detected across 10 sampled pages
