agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around Agent-Eval-Pipeline

An open-source Python pipeline for evaluating AI agents with LLM-as-a-Judge scoring, hallucination and faithfulness checks, latency monitoring, tool-call tracing, and LangFuse reporting.

Visit github.com ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
Agent-Eval-Pipeline · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
Agent-Eval-Pipeline doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
55th pctile
170 competing vendors
Comparable listings · 30d
—
Platforms · Pro median
$35.79/mo
6 priced · $13.4–$48 mid 50%
Price spectrum · Pro plans · 8 of 13 providers priced · log scale · $5 → $208/mo
MCP servers Platforms◻ shaded = middle 50% · line = median (all types)Agent-Eval-Pipeline has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches Agent-Eval-Pipeline's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther16Ranked by similarity
Agent-Eval-Pipelinethis listing
● OTHER
no public price
Agentevals Via Github
● OTHER78% similar
no public price
16agents
● OTHER76% similar
no public price
Clawbench
● OTHER75% similar
no public price
EMO-X
● OTHER75% similar
no public price
Agentic Eval
● OTHER74% similar
no public price
aws-bench
● OTHER74% similar
no public price
Eval Skills
● OTHER73% similar
no public price
Kalytera
● OTHER73% similar
no Pro plan
entry $49/mo
AI Deploy Bench
● OTHER73% similar
no public price
Skillgrade
● OTHER73% similar
no public price
Obzerve
● OTHER72% similar
no public price
Navital Gym
● OTHER72% similar
no public price
Plumloom
● OTHER72% similar
no public price
Model Evaluation
● OTHER72% similar
no public price
AgentPoints
● OTHER72% similar
$59 one-time Pro
not monthly-comparable
PPlatforms18Ranked by similarity
agent-evals
● PLATFORM82% similar
no public price
Agentsproof
● PLATFORM78% similar
$24.17/mo Pro
-32% vs Pro median
Agent Eval Harness
● PLATFORM76% similar
no public price
QAgent
● PLATFORM75% similar
no Pro plan
entry $29/mo
Etna
● PLATFORM75% similar
$208/mo Pro
+480% vs Pro median
Agentic Evaluation Platform
● PLATFORM75% similar
no public price
Daishi Studio
● PLATFORM74% similar
$49/mo Pro
+37% vs Pro median
AgentLasso
● PLATFORM74% similar
$79/mo Pro
+121% vs Pro median
CodeSentry
● PLATFORM74% similar
no public price
Scorecard
● PLATFORM74% similar
no Pro plan
entry $299/mo
VA
Vasari
● PLATFORM74% similar
no public price
ContextIQ
● PLATFORM73% similar
$5/mo Pro
-86% vs Pro median
Agent Tracking
● PLATFORM73% similar
$9/mo Pro
-75% vs Pro median
Papaya
● PLATFORM72% similar
no Pro plan
entry $500/mo
Ctf Agent Benchmark
● PLATFORM72% similar
no public price
Future Agi
● PLATFORM72% similar
no public price
Litefuse
● PLATFORM72% similar
no public price
Bottrade
● PLATFORM72% similar
$19.99/mo Pro
-44% vs Pro median
FFrameworks7Ranked by similarity
Agentspec
● FRAMEWORK76% similar
no public price
Bound
● FRAMEWORK75% similar
no public price
Evalmonkey
● FRAMEWORK75% similar
no public price
Lucid
● FRAMEWORK75% similar
no public price
GEAR
● FRAMEWORK74% similar
no public price
Niceeval
● FRAMEWORK73% similar
no public price
Deepeval
● FRAMEWORK72% similar
no public price
MMCP servers5Ranked by similarity
ALPNAI
● MCP75% similar
$19/mo Pro
Iris
● MCP75% similar
no public price
Autoeval
● MCP73% similar
no public price
Evalgate
● MCP73% similar
no public price
RAIL Score MCP Server
● MCP72% similar
no public price
AAgents2Ranked by similarity
Don't Kill the Vibes
● AGENT73% similar
no public price
Self-Auditing Agent
● AGENT72% similar
no public price
AAPIs2Ranked by similarity
Verity Suite
● API73% similar
no public price
KY
Kyla AI API
● API72% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.