agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around EvalForge Lite

Open-source web app and MCP server for comparing text LLMs across OpenRouter, Amazon Bedrock, Google Vertex AI, and Microsoft Foundry using custom prompts, automated grading, rule checks, latency, and cost metrics.

Visit github.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
EvalForge Lite · Pro
No Pro plan
—
Pro-MCP server median
—
insufficient comparable pricing
vs Pro MCP servers
No comparison
EvalForge Lite doesn't sell Pro
ⓘ Comparisons are same provider type (MCP server) and same buyer tier (Pro). Never across tiers.
Market density
24th pctile
2 competing vendors
Comparable listings · 30d
—
based on 0 comparable products with price history
Price spectrum · Pro plans · 3 of 4 providers priced · log scale · $19 → $199/mo
Platforms◻ shaded = middle 50% · line = median (all types)EvalForge Lite has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches EvalForge Lite's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

MMCP servers6Ranked by similarity
EvalForge Litethis listing
● MCP
no public price
Llm Evaluation Agent
● MCP79% similar
no public price
evalpair
● MCP76% similar
no public price
Typecast
● MCP72% similar
no public price
Multi LLM Cross-Check MCP Server
● MCP71% similar
no public price
eval-builder
● MCP71% similar
no public price
OOther4Ranked by similarity
Deepeval
● OTHER76% similar
no public price
tool-eval-bench
● OTHER73% similar
no public price
Test Prompt AI
● OTHER72% similar
no public price
digline
● OTHER71% similar
no public price
PPlatforms3Ranked by similarity
LLM Task Bench
● PLATFORM76% similar
no public price
Plumloom
● PLATFORM73% similar
$59/mo Pro
Parea Ai
● PLATFORM70% similar
no public price
FFrameworks3Ranked by similarity
AgentFork
● FRAMEWORK74% similar
no public price
omegaprompt
● FRAMEWORK70% similar
no public price
AI Eval Routing Kit
● FRAMEWORK70% similar
no public price
AAPIs1Ranked by similarity
Opti Moa
● API71% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.