agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around agent-evals

Open-source evaluation harness for AI agents. Define YAML task suites, run agents through pluggable runners and tool loops, score outputs, capture traces, compare runs, and track regressions.

Visit github.com ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
agent-evals · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
agent-evals doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
83rd pctile
521 competing vendors
Comparable listings · 30d
—
Platforms · Pro median
$49/mo
7 priced · $35.79–$89 mid 50%
Price spectrum · Pro plans · 10 of 14 providers priced · log scale · $5 → $208/mo
MCP servers APIs Platforms◻ shaded = middle 50% · line = median (all types)agent-evals has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches agent-evals's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther14Ranked by similarity
agent-evalsthis listing
● OTHER
no public price
Agentevals Via Github
● OTHER87% similar
no public price
16agents
● OTHER82% similar
no public price
EMO-X
● OTHER81% similar
no public price
aws-bench
● OTHER80% similar
no public price
Agentic Eval
● OTHER80% similar
no public price
Clawbench
● OTHER80% similar
no public price
Model Evaluation
● OTHER80% similar
no public price
Skillgrade
● OTHER79% similar
no public price
agentcheck
● OTHER78% similar
no public price
Kalytera
● OTHER78% similar
no Pro plan
entry $49/mo
Fusion First
● OTHER77% similar
no public price
Harness Lab
● OTHER77% similar
no public price
CheatBench
● OTHER75% similar
no public price
PPlatforms20Ranked by similarity
Agentsproof
● PLATFORM87% similar
$24.17/mo Pro
-51% vs Pro median
Agent Eval Harness
● PLATFORM85% similar
no public price
Daishi Studio
● PLATFORM84% similar
$49/mo Pro
0% vs Pro median
A2APark
● PLATFORM84% similar
no public price
Agentic Evaluation Platform
● PLATFORM82% similar
no public price
Etna
● PLATFORM81% similar
$208/mo Pro
+323% vs Pro median
AgentLasso
● PLATFORM81% similar
$79/mo Pro
+61% vs Pro median
Pome
● PLATFORM80% similar
no Pro plan
entry $500/mo
Litefuse
● PLATFORM79% similar
$199/mo Pro
+306% vs Pro median
Ctf Agent Benchmark
● PLATFORM79% similar
no public price
Lantern
● PLATFORM78% similar
no public price
BotGauge
● PLATFORM78% similar
no public price
Bottrade
● PLATFORM77% similar
$19.99/mo Pro
-59% vs Pro median
ContextIQ
● PLATFORM77% similar
$5/mo Pro
-90% vs Pro median
LIFE FORGE
● PLATFORM77% similar
no public price
VA
Vasari
● PLATFORM76% similar
no public price
Retrace
● PLATFORM76% similar
$99/mo Pro
+102% vs Pro median
Kolonie Platform
● PLATFORM76% similar
no public price
Monte Carlo Agent Observabilit
● PLATFORM75% similar
no public price
Papaya
● PLATFORM75% similar
no Pro plan
entry $500/mo
FFrameworks10Ranked by similarity
Niceeval
● FRAMEWORK86% similar
no public price
Agentspec
● FRAMEWORK81% similar
no public price
Beagle
● FRAMEWORK81% similar
no public price
Evalmonkey
● FRAMEWORK81% similar
no public price
Bound
● FRAMEWORK79% similar
no public price
Understudy
● FRAMEWORK79% similar
no public price
Langwatch
● FRAMEWORK78% similar
no Pro plan
entry $33/mo
Agentbench
● FRAMEWORK76% similar
no public price
ScaffoldScope
● FRAMEWORK76% similar
no public price
Firedrill
● FRAMEWORK76% similar
no public price
MMCP servers5Ranked by similarity
Evalgate
● MCP80% similar
no public price
ALPNAI
● MCP79% similar
$19/mo Pro
cold-run
● MCP78% similar
no public price
Iris
● MCP77% similar
no public price
ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox
● MCP76% similar
no public price
AAPIs1Ranked by similarity
Agent Observability
● API77% similar
$50/mo Pro

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.