agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around tool-eval-bench

Open-source benchmark for evaluating LLM tool-calling in agentic workflows across OpenAI-compatible serving endpoints, with deterministic scenarios, conversation traces, structured-output checks, and optional performance tests.

Visit github.com ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
tool-eval-bench · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
tool-eval-bench doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
55th pctile
126 competing vendors
Comparable listings · 30d
—
Price spectrum · Pro plans · 3 of 5 providers priced · log scale · $25 → $150/mo
Agents APIs Platforms◻ shaded = middle 50% · line = median (all types)tool-eval-bench has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches tool-eval-bench's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther7Ranked by similarity
tool-eval-benchthis listing
● OTHER
no public price
Phronesis
● OTHER78% similar
no public price
Contextspy
● OTHER74% similar
no public price
Cost-Tree
● OTHER73% similar
no public price
vco
● OTHER71% similar
no public price
Tool Evidence Guard
● OTHER71% similar
no public price
ARIS (Auto-Research-In-Sleep)
● OTHER71% similar
no public price
FFrameworks17Ranked by similarity
Deepeval
● FRAMEWORK80% similar
no public price
Openai Agents
● FRAMEWORK78% similar
no public price
Alphatrion
● FRAMEWORK76% similar
no public price
Langwatch
● FRAMEWORK75% similar
no Pro plan
entry $33/mo
EV
EvoAgentX
● FRAMEWORK75% similar
no public price
TrueForge
● FRAMEWORK74% similar
no public price
Rightnow Auto
● FRAMEWORK74% similar
no public price
Openjudge
● FRAMEWORK74% similar
no public price
Giulia
● FRAMEWORK74% similar
no public price
Sema Lang
● FRAMEWORK73% similar
no public price
Barbacane
● FRAMEWORK73% similar
no public price
Rllm
● FRAMEWORK72% similar
no public price
Orion Os
● FRAMEWORK72% similar
no public price
Microsoft Autogen
● FRAMEWORK72% similar
no public price
paired-eval
● FRAMEWORK72% similar
no public price
Ouroboros
● FRAMEWORK72% similar
no public price
Longe
● FRAMEWORK71% similar
no public price
PPlatforms11Ranked by similarity
AcruxCore
● PLATFORM77% similar
no public price
Respan
● PLATFORM75% similar
no Pro plan
entry $199/mo
Comet Opik
● PLATFORM75% similar
no public price
Parea Ai
● PLATFORM73% similar
no public price
Feenion
● PLATFORM73% similar
no public price
Selfware
● PLATFORM72% similar
no public price
Openheim
● PLATFORM72% similar
no public price
Orq.ai
● PLATFORM72% similar
no public price
onPanda
● PLATFORM72% similar
no public price
Telemetry
● PLATFORM72% similar
$25/mo Pro
Village
● PLATFORM72% similar
no public price
AAPIs3Ranked by similarity
Opentools
● API77% similar
no public price
AgentOps
● API72% similar
$40/mo Pro
Grps Trtllm
● API72% similar
no public price
MMCP servers10Ranked by similarity
Model Council
● MCP76% similar
no public price
CouchLoop EQ
● MCP75% similar
no public price
DeepTeam MCP
● MCP73% similar
no public price
Llm Evaluation Agent
● MCP73% similar
no public price
Universal AI Agent Bridge
● MCP73% similar
no public price
EvalForge Lite
● MCP73% similar
no public price
MCP Tool Execution
● MCP73% similar
no public price
RE
retriEVAL
● MCP73% similar
no public price
Cucumberstudio
● MCP72% similar
no public price
Testing
● MCP72% similar
no public price
AAgents2Ranked by similarity
KORA Doctor
● AGENT73% similar
no public price
Canvas Agent
● AGENT72% similar
$150/mo Pro

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.