agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around llm_evaluation_agent

An MCP-based agent for evaluating LLMs, AI agents, and prompts through natural-language configuration, synthetic dataset generation, multi-judge scoring, document-grounded tests, and PDF reporting.

Visit startups.aws.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
Llm Evaluation Agent · Pro
No Pro plan
—
Pro-MCP server median
—
insufficient comparable pricing
vs Pro MCP servers
No comparison
Llm Evaluation Agent doesn't sell Pro
ⓘ Comparisons are same provider type (MCP server) and same buyer tier (Pro). Never across tiers.
Market density
38th pctile
40 strong substitutes
Price momentum · 30d
+14.7%
MCP servers · Pro median
$25/mo
1 priced · $25–$25 mid 50%
Platforms · Pro median
$32/mo
6 priced · $29–$38 mid 50%
Price spectrum · Pro plans · 6 of 9 providers priced · log scale · $24.17 → $49/mo
MCP servers Platforms◻ shaded = middle 50% · line = median (all types)Llm Evaluation Agent has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches Llm Evaluation Agent's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

MMCP servers22Ranked by relevance
llm_evaluation_agentthis listing
● MCP · relevance 100%
no public price
mentor_mcp_server
● MCP · relevance 77%
no public price
cucumberstudio_mcp
● MCP · relevance 75%
no public price
retriEVAL
● MCP · relevance 74%
no public price
ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox
● MCP · relevance 74%
no public price
evalgate_mcp
● MCP · relevance 73%
no public price
mcp_prompts
● MCP · relevance 73%
no public price
Prompt Injection Scanner MCP - LLM Security Testing
● MCP · relevance 73%
$25/mo Pro
mcp_latex_server
● MCP · relevance 70%
no public price
DC
dcl_trust_oracle
● MCP · relevance 70%
no public price
ultimate_mcp_server
● MCP · relevance 70%
no public price
CouchLoop EQ
● MCP · relevance 70%
no public price
priorlabs_ai
● MCP · relevance 69%
no public price
getabrain
● MCP · relevance 69%
no public price
Model Council
● MCP · relevance 69%
no public price
mirror_mcp
● MCP · relevance 69%
no public price
toolroute - Intelligent Automated LLM Routing
● MCP · relevance 68%
no public price
NU
numguard
● MCP · relevance 68%
no Pro plan
entry $10/mo
RAIL Score MCP Server
● MCP · relevance 68%
no public price
codex_vision_bridge
● MCP · relevance 68%
no public price
MindBridge
● MCP · relevance 68%
no public price
Nexus Browser MCP
● MCP · relevance 67%
no public price
FFrameworks10Ranked by relevance
deepeval
● FRAMEWORK · relevance 83%
no public price
openjudge
● FRAMEWORK · relevance 80%
no public price
langwatch
● FRAMEWORK · relevance 76%
no Pro plan
entry $34/mo
Guardrails AI
● FRAMEWORK · relevance 70%
no public price
skillopt
● FRAMEWORK · relevance 69%
no public price
deep_research_ai_agent
● FRAMEWORK · relevance 69%
no public price
matrices
● FRAMEWORK · relevance 69%
no public price
EV
EvoAgentX
● FRAMEWORK · relevance 69%
no public price
niceeval
● FRAMEWORK · relevance 68%
no public price
openai_agents
● FRAMEWORK · relevance 68%
no public price
PPlatforms9Ranked by relevance
vasari
● PLATFORM · relevance 80%
no public price
comet_opik
● PLATFORM · relevance 78%
no public price
parea_ai
● PLATFORM · relevance 77%
no Pro plan
entry $150/mo
Orq.ai
● PLATFORM · relevance 74%
$35/mo Pro
+9% vs Pro median
promptlayer
● PLATFORM · relevance 70%
$49/mo Pro
+53% vs Pro median
agentsproof
● PLATFORM · relevance 69%
$24.17/mo Pro
-24% vs Pro median
agenta
● PLATFORM · relevance 69%
$29/mo Pro
-9% vs Pro median
langsmith
● PLATFORM · relevance 68%
$39/mo Pro
+22% vs Pro median
Agentic Evaluation Platform
● PLATFORM · relevance 68%
no public price
OOther6Ranked by relevance
contextspy
● OTHER · relevance 72%
no public price
skillgrade
● OTHER · relevance 71%
no public price
ARIS (Auto-Research-In-Sleep)
● OTHER · relevance 71%
no public price
agent_context_org_guides
● OTHER · relevance 69%
no public price
Anthropic
● OTHER · relevance 68%
no public price
github_harvardlillawskillshub_
● OTHER · relevance 68%
no public price
AAgents3Ranked by relevance
feedback_aide
● AGENT · relevance 69%
no public price
agent_opfor
● AGENT · relevance 68%
no public price
ctgt
● AGENT · relevance 68%
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.