agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around Openjudge

Open-source AI evaluation framework with 50+ production-grade graders for assessing LLM agents, multimodal models, code generation, and math reasoning. Integrates with LangSmith, Langfuse, and RL frameworks.

Visit openjudge.me ↗Pricing page ↗
Pricing (0 buyer tiers · 1 plan)
Free plan available Free
As parsed from openjudge.me/pricing on 2026-10-10.

Explore the market

Prices and medians update for the tier you select.

Compare at
openjudge · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
openjudge doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
52nd pctile
104 competing vendors
Comparable listings · 30d
—
Price spectrum · Pro plans · 2 of 3 providers priced · log scale · $20 → $24.17/mo
Platforms Other◻ shaded = middle 50% · line = median (all types)openjudge has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches openjudge's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

FFrameworks26Ranked by similarity
Openjudgethis listing
● FRAMEWORK
no public price
Deepeval
● FRAMEWORK83% similar
no public price
Langwatch
● FRAMEWORK78% similar
no Pro plan
entry $33/mo
EV
EvoAgentX
● FRAMEWORK76% similar
no public price
TrueForge
● FRAMEWORK75% similar
no public price
Rllm
● FRAMEWORK75% similar
no public price
Microsoft Autogen
● FRAMEWORK75% similar
no public price
Guardrails AI
● FRAMEWORK74% similar
no public price
Deep Research Ai Agent
● FRAMEWORK73% similar
no public price
Matrices
● FRAMEWORK73% similar
no public price
DecisionSmith
● FRAMEWORK72% similar
no public price
AReaL
● FRAMEWORK72% similar
no public price
Rustyhand
● FRAMEWORK72% similar
no public price
manyagents
● FRAMEWORK72% similar
no public price
KYVAutoResearch v2
● FRAMEWORK71% similar
no public price
Keel
● FRAMEWORK71% similar
no public price
Alphatrion
● FRAMEWORK71% similar
no public price
SMITH
● FRAMEWORK71% similar
no public price
paired-eval
● FRAMEWORK71% similar
no public price
Elja
● FRAMEWORK71% similar
no public price
Openai Agents
● FRAMEWORK71% similar
no public price
Orion Os
● FRAMEWORK71% similar
no public price
Giulia
● FRAMEWORK71% similar
no public price
Cobra Bias Toolkit
● FRAMEWORK70% similar
no public price
Understudy
● FRAMEWORK70% similar
no public price
Art
● FRAMEWORK70% similar
no public price
MMCP servers7Ranked by similarity
Llm Evaluation Agent
● MCP80% similar
no public price
Mentor
● MCP77% similar
no public price
EvalForge Lite
● MCP72% similar
no public price
Rostra
● MCP71% similar
no public price
Mult Hands Eyes MCP
● MCP71% similar
no public price
Chiasmus
● MCP71% similar
no public price
CouchLoop EQ
● MCP70% similar
no public price
PPlatforms9Ranked by similarity
VA
Vasari
● PLATFORM76% similar
no public price
Orq.ai
● PLATFORM76% similar
no public price
Parea Ai
● PLATFORM75% similar
no public price
Comet Opik
● PLATFORM75% similar
no public price
onPanda
● PLATFORM73% similar
no public price
Agentsproof
● PLATFORM72% similar
$24.17/mo Pro
Village
● PLATFORM72% similar
no public price
AgentForge
● PLATFORM72% similar
no public price
AcruxCore
● PLATFORM71% similar
no public price
AAgents2Ranked by similarity
Multi-Judge Consensus
● AGENT73% similar
no public price
AutoResearch
● AGENT71% similar
no public price
OOther6Ranked by similarity
ARIS (Auto-Research-In-Sleep)
● OTHER73% similar
no public price
Skillgrade
● OTHER73% similar
no public price
Agent Context Org Guides
● OTHER73% similar
no public price
Anthropic
● OTHER72% similar
$20/mo Pro
Phronesis
● OTHER72% similar
no public price
Github Jenqyangawesomeaiagents
● OTHER71% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.