Leaderboard/OpenRouter

OpenRouter

openrouter.ai/docs/quickstart
Score: 87 out of 100, grade B87
Grade B
Last checked: April 3, 2026 · Rerun
Share on
Simulation: Fern // bud
Day 0
CategoryAI/ML
Checks passed15/22Warnings2Failed4

OpenRouter scores 87/100 (Grade B), passing 15 of 22 checks (68%). The documentation is broadly accessible to AI agents but has 6 areas that could be improved to better serve automated tooling.

# Agent Score Fix Report — OpenRouter
URL: https://openrouter.ai/docs/quickstart
Score: 87/100 (Grade B)

I need help improving the AI-readiness of the documentation at https://openrouter.ai/docs/quickstart.
Agent Score found 4 failing checks and 2 warnings.

## Failing Checks (4)
- [content-discoverability] Llms Txt Directive: No llms.txt directive found in any of 10 sampled pages
- [page-size] Page Size Html: 1 of 10 sampled pages convert to over 100K chars (max 1008K, 0% boilerplate)
- [url-stability] Http Status Codes: 1 of 3 sampled pages return 200 for non-existent URLs (soft 404); 7 failed to fetch
- [observability] Markdown Content Parity: 7 of 9 pages have substantive content differences between markdown and HTML (avg 41% missing)

## Warnings (2)
- [content-discoverability] Llms Txt Valid: llms.txt contains parseable links but doesn't fully follow the proposed structure: https://openrouter.ai/docs/quickstart/llms.txt: No H1 heading found, No blockquote summary found; https://openrouter.ai/docs/llms.txt: No blockquote summary found
- [page-size] Content Start Position: 5 of 10 sampled pages have content starting at 10–50% (worst 50%)

## Fix Instructions

For each issue above, please:
1. Analyze the documentation site at https://openrouter.ai/docs/quickstart
2. Implement the specific fix
3. Verify the fix would cause the check to pass

### Common fixes:
- **No llms.txt**: Create /llms.txt following https://llmstxt.org — list all doc pages in markdown format
- **No .md URL support**: Configure your docs platform to serve pages at equivalent .md URLs (e.g. /docs/quickstart.md)
- **No content negotiation**: Return markdown when request includes Accept: text/markdown header
- **Large page size**: Reduce nav boilerplate, inline scripts, and repetitive markup
- **No sitemap**: Generate /sitemap.xml listing all documentation URLs
- **Auth walls**: Ensure docs pages return 200 without requiring login cookies or tokens
- **No Last-Modified header**: Configure your server/CDN to include Last-Modified response headers
- **Tab content hidden**: Ensure tabbed content is rendered in the HTML (not JS-only) so agents can read all variants

## Run afdocs Locally for More Detail

To get deeper visibility into what's failing, run afdocs against your docs:

  npx afdocs https://openrouter.ai/docs/quickstart --fixes --verbose

- **--fixes**: Adds "Fix:" lines to the output for each warn/fail check with actionable remediation steps
- **-v, --verbose**: Shows per-page details (specific URLs, character counts, error codes) for checks with issues — useful for per-URL visibility into what's failing
CHECK RESULTS

How your docs scored

http-status-codes1 of 3 sampled pages return 200 for non-existent URLs (soft 404); 7 failed to fetch
redirect-behaviorNo redirects detected across 10 sampled pages
auth-gate-detectionAll 10 sampled pages are publicly accessible
auth-alternative-accessAll docs pages are publicly accessible; no alternative access paths needed
page-size-html1 of 10 sampled pages convert to over 100K chars (max 1008K, 0% boilerplate)
content-start-position5 of 10 sampled pages have content starting at 10–50% (worst 50%)
rendering-strategyAll 10 sampled pages contain server-rendered content
page-size-markdownAll 9 pages under 50K chars (median 7K, max 17K)
markdown-content-parity7 of 9 pages have substantive content differences between markdown and HTML (avg 41% missing)
llms-txt-freshnessllms.txt covers 100% of 1 sitemap doc pages
cache-header-hygieneAll 12 endpoints have appropriate cache headers
llms-txt-directiveNo llms.txt directive found in any of 10 sampled pages
llms-txt-validllms.txt contains parseable links but doesn't fully follow the proposed structure: https://openrouter.ai/docs/quickstart/llms.txt: No H1 heading found, No blockquote summary found; https://openrouter.ai/docs/llms.txt: No blockquote summary found
llms-txt-existsllms.txt found at 2 location(s)
llms-txt-sizellms.txt is 38,618 characters (under 50,000 threshold)
llms-txt-links-resolveAll 10 same-origin sampled links resolve (196 total links)
llms-txt-links-markdown10/10 same-origin sampled links point to markdown content (100%)
markdown-url-support9/9 sampled pages support .md URLs (100%)
content-negotiation9/9 sampled pages support content negotiation (100%)
tabbed-content-serializationNo tabbed content detected across 10 sampled pages
section-header-qualityNo tabbed content found; header quality check not applicable
markdown-code-fence-validityAll 69 code fences properly closed across 11 pages

Built by Fern

Fern-powered docs are agent-ready by default.

Trusted by