agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around deepeval

Open-source LLM evaluation framework for testing AI agents, RAG pipelines, chatbots, and other LLM applications with metrics such as task completion, tool correctness, answer relevancy, hallucination, and G-Eval.

Visit github.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
deepeval · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
deepeval doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
44th pctile
55 strong substitutes
Price momentum · 30d
+2.6%
MCP servers · Pro median
$25/mo
1 priced · $25–$25 mid 50%
APIs · Pro median
$40/mo
1 priced · $40–$40 mid 50%
Platforms · Pro median
$29/mo
5 priced · $25–$35 mid 50%
Price spectrum · Pro plans · 6 of 9 providers priced · log scale · $24.17 → $40/mo
MCP servers APIs Platforms◻ shaded = middle 50% · line = median (all types)deepeval has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches deepeval's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

FFrameworks17Ranked by relevance
deepevalthis listing
● FRAMEWORK · relevance 100%
no public price
openjudge
● FRAMEWORK · relevance 83%
no public price
langwatch
● FRAMEWORK · relevance 79%
no Pro plan
entry $34/mo
Guardrails AI
● FRAMEWORK · relevance 76%
no public price
openai_agents
● FRAMEWORK · relevance 72%
no public price
giulia
● FRAMEWORK · relevance 71%
no public price
microsoft_autogen
● FRAMEWORK · relevance 70%
no public price
matrices
● FRAMEWORK · relevance 70%
no public price
orion_os
● FRAMEWORK · relevance 70%
no public price
deep_research_ai_agent
● FRAMEWORK · relevance 70%
no public price
TrueForge
● FRAMEWORK · relevance 70%
no public price
EV
EvoAgentX
● FRAMEWORK · relevance 70%
no public price
niceeval
● FRAMEWORK · relevance 70%
no public price
agentspec
● FRAMEWORK · relevance 70%
no public price
rllm
● FRAMEWORK · relevance 69%
no public price
evalmonkey
● FRAMEWORK · relevance 69%
no public price
alphatrion
● FRAMEWORK · relevance 69%
no public price
MMCP servers14Ranked by relevance
llm_evaluation_agent
● MCP · relevance 83%
no public price
CouchLoop EQ
● MCP · relevance 78%
no public price
mentor_mcp_server
● MCP · relevance 76%
no public price
ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox
● MCP · relevance 74%
no public price
mirror_mcp
● MCP · relevance 73%
no public price
cucumberstudio_mcp
● MCP · relevance 72%
no public price
Model Council
● MCP · relevance 71%
no public price
DC
dcl_trust_oracle
● MCP · relevance 71%
no public price
Prompt Injection Scanner MCP - LLM Security Testing
● MCP · relevance 70%
$25/mo Pro
Mult Hands Eyes MCP
● MCP · relevance 70%
no public price
toolroute - Intelligent Automated LLM Routing
● MCP · relevance 70%
no public price
DE
deepresearch_bench_ii
● MCP · relevance 70%
no public price
evalgate_mcp
● MCP · relevance 70%
no public price
getabrain
● MCP · relevance 69%
no public price
PPlatforms9Ranked by relevance
comet_opik
● PLATFORM · relevance 81%
no public price
vasari
● PLATFORM · relevance 81%
no public price
parea_ai
● PLATFORM · relevance 79%
no Pro plan
entry $150/mo
Orq.ai
● PLATFORM · relevance 75%
$35/mo Pro
+21% vs Pro median
langsmith
● PLATFORM · relevance 73%
$39/mo Pro
+34% vs Pro median
agentsproof
● PLATFORM · relevance 72%
$24.17/mo Pro
-17% vs Pro median
telemetry
● PLATFORM · relevance 71%
$25/mo Pro
-14% vs Pro median
DeepOpinion
● PLATFORM · relevance 70%
no Pro plan
entry $199/mo
village
● PLATFORM · relevance 69%
no public price
OOther7Ranked by relevance
retriEVAL
● OTHER · relevance 77%
no public price
skillgrade
● OTHER · relevance 72%
no public price
norms_mcp_engine
● OTHER · relevance 70%
no public price
ARIS (Auto-Research-In-Sleep)
● OTHER · relevance 70%
no public price
contextspy
● OTHER · relevance 70%
no public price
clawbench
● OTHER · relevance 70%
no public price
agentevals_via_github
● OTHER · relevance 69%
no public price
AAgents1Ranked by relevance
agent_opfor
● AGENT · relevance 72%
no public price
AAPIs2Ranked by relevance
opentools
● API · relevance 71%
no public price
AgentOps
● API · relevance 69%
$40/mo Pro

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.