agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around Llm Evaluation Agent

An MCP-based agent for evaluating LLMs, AI agents, and prompts through natural-language configuration, synthetic dataset generation, multi-judge scoring, document-grounded tests, and PDF reporting.

Visit startups.aws.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
Llm Evaluation Agent · Pro
No Pro plan
—
Pro-MCP server median
—
insufficient comparable pricing
vs Pro MCP servers
No comparison
Llm Evaluation Agent doesn't sell Pro
ⓘ Comparisons are same provider type (MCP server) and same buyer tier (Pro). Never across tiers.
Market density
29th pctile
6 competing vendors
Comparable listings · 30d
Flat
limited data · 0 priced comparables
Platforms · Pro median
$49/mo
3 priced · —–— mid 50%
Price spectrum · Pro plans · 4 of 6 providers priced · log scale · $24.17 → $49/mo
MCP servers Platforms◻ shaded = middle 50% · line = median (all types)Llm Evaluation Agent has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches Llm Evaluation Agent's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

MMCP servers15Ranked by similarity
Llm Evaluation Agentthis listing
● MCP
no public price
EvalForge Lite
● MCP78% similar
no public price
Overwing MCP
● MCP78% similar
no Pro plan
entry $29/mo
Mentor
● MCP77% similar
no public price
eval-builder
● MCP76% similar
no public price
Cucumberstudio
● MCP75% similar
no public price
ApplyGenie MCP
● MCP75% similar
no public price
RE
retriEVAL
● MCP74% similar
no public price
ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox
● MCP74% similar
no public price
Evalgate
● MCP73% similar
no public price
Mcp Prompts
● MCP73% similar
no public price
Prompt Injection Scanner MCP - LLM Security Testing
● MCP73% similar
$25/mo Pro
FreeLLM-MCP
● MCP70% similar
no public price
Mcp Latex
● MCP70% similar
no public price
GenPark Hallucination Fact Grounding Checker
● MCP70% similar
no public price
FFrameworks6Ranked by similarity
Deepeval
● FRAMEWORK83% similar
no public price
Openjudge
● FRAMEWORK80% similar
no public price
Langwatch
● FRAMEWORK76% similar
no Pro plan
entry $33/mo
manyagents
● FRAMEWORK72% similar
no public price
Understudy
● FRAMEWORK71% similar
no public price
paired-eval
● FRAMEWORK70% similar
no public price
PPlatforms6Ranked by similarity
VA
Vasari
● PLATFORM80% similar
no public price
Comet Opik
● PLATFORM78% similar
no public price
Parea Ai
● PLATFORM77% similar
no public price
Orq.ai
● PLATFORM74% similar
no public price
AcruxCore
● PLATFORM72% similar
no public price
Promptlayer
● PLATFORM70% similar
$49/mo Pro
0% vs Pro median
AAgents1Ranked by similarity
Multi-Judge Consensus
● AGENT74% similar
no public price
OOther3Ranked by similarity
Contextspy
● OTHER72% similar
no public price
Skillgrade
● OTHER71% similar
no public price
ARIS (Auto-Research-In-Sleep)
● OTHER71% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.