Evals
A landscape catalog of the platforms, frameworks, libraries, and benchmark suites used to evaluate large language models, LLM-based applications, and AI agents. The topic spans human-rated, LLM-as-a-judge, reference-based, reference-free, and benchmark-aligned approaches to measuring AI system quality. Tracked alongside the eval platforms are the canonical multi-task and code/agent benchmark suites (MMLU, HumanEval, GAIA, AgentBench, BIG-Bench) that establish public points of comparison.
Provider: Evals
- apis_profiled: 20
- contract_governance: 23.5
- contract_quality: 14.7
- discoverability: 71.4
- kin_score: 21.6 / 100 (emerging)
- kin_score_rubric: 0.28.0
- kin_score_scored_at: 2026-11-13
- kin_score_trend: flat (+1.0 from 20.6)
Buying
- Public pricing
- Unknown
- Enterprise offering
- Unknown
- Founded
- Unknown
Unknown
Capabilities
- Model Selection
- Prompt Engineering Iteration
- Regression Detection in CI/CD
- RAG Pipeline Tuning
- Agent Trajectory Quality
- Hallucination and Safety Guardrails
- Frontier Capability and Safety Assessment
- Public Leaderboard Reporting
Categories
- LLM benchmarks
- LLM evaluation tools