agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around agent-evals

Open-source evaluation harness for AI agents. Define YAML task suites, run agents through pluggable runners and tool loops, score outputs, capture traces, compare runs, and track regressions.

Visit github.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
agent-evals · Pro
No Pro plan
—
Pro-platform median
$79
across 5 priced platforms
vs Pro platforms
No comparison
agent-evals doesn't sell Pro
ⓘ Comparisons are same provider type (platform) and same buyer tier (Pro). Never across tiers.
Market density
85th pctile
1038 competing vendors
Comparable listings · 30d
—
Platforms · Pro median
$79/mo
5 priced · $49–$99 mid 50%
Price spectrum · Pro plans · 7 of 11 providers priced · log scale · $19 → $299/mo
MCP servers Platforms◻ shaded = middle 50% · line = median (all types)agent-evals has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches agent-evals's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

PPlatforms18Ranked by similarity
agent-evalsthis listing
● PLATFORM
no public price
Agent Eval Harness
● PLATFORM85% similar
no public price
AgentLasso
● PLATFORM84% similar
$79/mo Pro
0% vs Pro median
Scorecard
● PLATFORM83% similar
no Pro plan
entry $299/mo
Agentsproof
● PLATFORM83% similar
$24.17/mo Pro
-69% vs Pro median
Agentic Evaluation Platform
● PLATFORM82% similar
no public price
Daishi Studio
● PLATFORM82% similar
$49/mo Pro
-38% vs Pro median
Pome
● PLATFORM81% similar
no public price
BotGauge
● PLATFORM81% similar
no Pro plan
entry $199/mo
VA
Vasari
● PLATFORM80% similar
no public price
Xonta Orchestrator
● PLATFORM80% similar
no public price
QAgent
● PLATFORM79% similar
no Pro plan
entry $29/mo
Ctf Agent Benchmark
● PLATFORM79% similar
no public price
Agent Score
● PLATFORM78% similar
$299/mo Pro
+278% vs Pro median
Lantern
● PLATFORM78% similar
no public price
Retrace
● PLATFORM78% similar
$99/mo Pro
+25% vs Pro median
Kayba
● PLATFORM78% similar
no public price
Etna
● PLATFORM78% similar
$208/mo Pro
+163% vs Pro median
OOther14Ranked by similarity
Agentevals Via Github
● OTHER87% similar
no public price
g-harness-evals
● OTHER84% similar
no public price
16agents
● OTHER82% similar
no public price
Agent-Eval-Pipeline
● OTHER82% similar
no public price
EMO-X
● OTHER81% similar
no public price
aws-bench
● OTHER80% similar
no public price
Agentic Eval
● OTHER80% similar
no public price
agentest
● OTHER80% similar
no public price
Clawbench
● OTHER80% similar
no public price
Model Evaluation
● OTHER80% similar
no public price
Skillgrade
● OTHER79% similar
no public price
Eval Skills
● OTHER79% similar
no public price
agentcheck
● OTHER78% similar
no public price
KradleBench
● OTHER78% similar
no public price
FFrameworks10Ranked by similarity
Niceeval
● FRAMEWORK87% similar
no public price
GEAR
● FRAMEWORK83% similar
no public price
AJX
● FRAMEWORK83% similar
no public price
Openjudge
● FRAMEWORK82% similar
no public price
Agentspec
● FRAMEWORK82% similar
no public price
Beagle
● FRAMEWORK81% similar
no public price
Evalmonkey
● FRAMEWORK81% similar
no public price
Bound
● FRAMEWORK79% similar
no public price
AI Agent Evaluation
● FRAMEWORK79% similar
no public price
caos-agent-harness
● FRAMEWORK78% similar
no public price
AAgents2Ranked by similarity
ReasonBlocks
● AGENT85% similar
no public price
Agentlint
● AGENT78% similar
no public price
MMCP servers6Ranked by similarity
ALPNAI
● MCP82% similar
$19/mo Pro
Evalgate
● MCP80% similar
no public price
testrun-mcp
● MCP79% similar
no public price
Mcp Test Tools
● MCP78% similar
no public price
Kore
● MCP78% similar
no Pro plan
entry $149/mo
Verifyax
● MCP78% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.