agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around openjudge

Open-source AI evaluation framework with 50+ production-grade graders for assessing LLM agents, multimodal models, code generation, and math reasoning. Integrates with LangSmith, Langfuse, and RL frameworks.

Visit openjudge.me ↗Pricing page ↗
Pricing (0 buyer tiers · 1 plan)
Free plan available Free
As parsed from openjudge.me/pricing on 2026-08-25.

Explore the market

Prices and medians update for the tier you select.

Compare at
openjudge · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
openjudge doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
50th pctile
74 strong substitutes
Price momentum · 31d
+16.1%
Platforms · Pro median
$29/mo
3 priced · $26.59–$32 mid 50%
Price spectrum · Pro plans · 2 of 4 providers priced · log scale · $24.17 → $35/mo
Platforms◻ shaded = middle 50% · line = median (all types)openjudge has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches openjudge's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

FFrameworks24Ranked by relevance
openjudgethis listing
● FRAMEWORK · relevance 100%
no public price
deepeval
● FRAMEWORK · relevance 83%
no public price
langwatch
● FRAMEWORK · relevance 78%
no Pro plan
entry $34/mo
EV
EvoAgentX
● FRAMEWORK · relevance 76%
no public price
TrueForge
● FRAMEWORK · relevance 75%
no public price
rllm
● FRAMEWORK · relevance 75%
no public price
microsoft_autogen
● FRAMEWORK · relevance 75%
no public price
Guardrails AI
● FRAMEWORK · relevance 74%
no public price
deep_research_ai_agent
● FRAMEWORK · relevance 73%
no public price
matrices
● FRAMEWORK · relevance 73%
no public price
AReaL
● FRAMEWORK · relevance 72%
no public price
rustyhand
● FRAMEWORK · relevance 72%
no public price
Keel
● FRAMEWORK · relevance 71%
no public price
alphatrion
● FRAMEWORK · relevance 71%
no public price
openai_agents
● FRAMEWORK · relevance 71%
no public price
orion_os
● FRAMEWORK · relevance 71%
no public price
giulia
● FRAMEWORK · relevance 71%
no public price
cobra_bias_toolkit
● FRAMEWORK · relevance 70%
no public price
art
● FRAMEWORK · relevance 70%
no public price
llm_council
● FRAMEWORK · relevance 70%
no public price
sema_lang
● FRAMEWORK · relevance 70%
no public price
volcano_agent_sdk
● FRAMEWORK · relevance 70%
no public price
harnessclaw_engine
● FRAMEWORK · relevance 70%
no public price
abcoder
● FRAMEWORK · relevance 70%
no public price
MMCP servers7Ranked by relevance
llm_evaluation_agent
● MCP · relevance 80%
no public price
mentor_mcp_server
● MCP · relevance 77%
no public price
Mult Hands Eyes MCP
● MCP · relevance 71%
no public price
chiasmus
● MCP · relevance 71%
no public price
CouchLoop EQ
● MCP · relevance 70%
no public price
ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox
● MCP · relevance 70%
no public price
toolroute - Intelligent Automated LLM Routing
● MCP · relevance 69%
no public price
PPlatforms8Ranked by relevance
vasari
● PLATFORM · relevance 76%
no public price
Orq.ai
● PLATFORM · relevance 76%
$35/mo Pro
+21% vs Pro median
parea_ai
● PLATFORM · relevance 75%
no Pro plan
entry $150/mo
comet_opik
● PLATFORM · relevance 75%
no public price
agentsproof
● PLATFORM · relevance 72%
$24.17/mo Pro
-17% vs Pro median
village
● PLATFORM · relevance 72%
no public price
anyscale
● PLATFORM · relevance 70%
no public price
splx
● PLATFORM · relevance 69%
no public price
OOther6Ranked by relevance
ARIS (Auto-Research-In-Sleep)
● OTHER · relevance 73%
no public price
skillgrade
● OTHER · relevance 73%
no public price
agent_context_org_guides
● OTHER · relevance 73%
no public price
Anthropic
● OTHER · relevance 72%
no public price
github_jenqyangawesomeaiagents
● OTHER · relevance 71%
no public price
Yuan-Mind
● OTHER · relevance 69%
no public price
AAgents3Ranked by relevance
AutoResearch
● AGENT · relevance 71%
no public price
peri
● AGENT · relevance 69%
no public price
pi
● AGENT · relevance 69%
no public price
AAPIs2Ranked by relevance
grps_trtllm
● API · relevance 70%
no public price
opentools
● API · relevance 70%
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.