Open-source CLI and MCP server for evaluating AI applications and agent behavior. It runs committed evaluation files, produces reliability evidence, and gates releases through CI or coding-agent workflows.
Prices and medians update for the tier you select.
Compare at
Autoeval · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
Autoeval doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
90th pctile
1136 competing vendors
Comparable listings · 30d
—
Platforms · Pro median
$35.3/mo
4 priced · —–— mid 50%
Price spectrum · Pro plans · 7 of 9 providers priced · log scale · $5 → $399/mo
MCP servers Platforms◻ shaded = middle 50% · line = median (all types)Autoeval has no comparable Pro price — not plotted
Products in this market
Ranked by how closely each one matches Autoeval's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.
Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.