Evals
Work in Progress
This feature is currently not yet generally available. Please email us to get started.
Fern evaluates how accurately Ask Fern answers questions on your documentation site compared to competitor AI search solutions.
Fern first generates evaluation questions from your documentation files, then runs those questions through both Ask Fern and competitor systems. Finally, Fern evaluates each answer against the original documentation for accuracy. You receive detailed performance metrics and comparative analysis.
Availability
Evals are currently provided as custom analysis delivered directly by the Fern team.