agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around Plumloom

AI evaluation platform for engineers and product managers building AI agents and LLM applications. Supports calibrated judges, multi-judge agreement, and statistical multi-run evaluations for live scenarios.

Visit plumloom.ai ↗Pricing page ↗
Pricing (2 buyer tiers · 3 plans)
Free plan available Free
As parsed from plumloom.ai/pricing on 2026-11-06.

Explore the market

Prices and medians update for the tier you select.

Compare at
Plumloom · Pro
$59/mo
Professional plan
Pro-platform median
$35.79
across 6 priced platforms
vs Pro platforms
65% above
above Pro platforms
ⓘ Comparisons are same provider type (platform) and same buyer tier (Pro). Never across tiers.
Market density
54th pctile
159 competing vendors
Comparable listings · 30d
—
Platforms · Pro median
$35.79/mo
6 priced · $20.9–$48 mid 50%
Price spectrum · Pro plans · 9 of 12 providers priced · log scale · $19 → $800/mo
Agents Platforms◻ shaded = middle 50% · line = median (all types)large ringed dot = Plumloom ($59/mo)

Products in this market

Ranked by how closely each one matches Plumloom's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

PPlatforms19Ranked by similarity
Plumloomthis listing
● PLATFORM
$59/mo Pro
+65% vs Pro median
VA
Vasari
● PLATFORM84% similar
no public price
Comet Opik
● PLATFORM83% similar
$19/mo Pro
-47% vs Pro median
Parea Ai
● PLATFORM80% similar
no public price
Daishi Studio
● PLATFORM78% similar
$49/mo Pro
+37% vs Pro median
Agentsproof
● PLATFORM78% similar
$24.17/mo Pro
-32% vs Pro median
Orq.ai
● PLATFORM77% similar
no public price
Agentic Evaluation Platform
● PLATFORM76% similar
no public price
Tokenwise
● PLATFORM76% similar
$79/mo Pro
+121% vs Pro median
agent-evals
● PLATFORM75% similar
no public price
Langsmith
● PLATFORM75% similar
$39/mo Pro
+9% vs Pro median
Plainwright
● PLATFORM74% similar
no public price
Bottrade
● PLATFORM73% similar
$19.99/mo Pro
-44% vs Pro median
Matraix
● PLATFORM73% similar
no public price
Scorecard
● PLATFORM73% similar
no Pro plan
entry $299/mo
Mphora
● PLATFORM73% similar
no public price
Alcock Arena
● PLATFORM72% similar
no public price
Manifest
● PLATFORM72% similar
$19/mo Pro
-47% vs Pro median
Xonta Orchestrator
● PLATFORM72% similar
no public price
FFrameworks7Ranked by similarity
Deepeval
● FRAMEWORK87% similar
no public price
Openjudge
● FRAMEWORK82% similar
no public price
Langwatch
● FRAMEWORK82% similar
no Pro plan
entry $33/mo
Niceeval
● FRAMEWORK74% similar
no public price
AgentFork
● FRAMEWORK73% similar
no public price
Understudy
● FRAMEWORK73% similar
no public price
SOV City
● FRAMEWORK72% similar
no public price
MMCP servers14Ranked by similarity
Llm Evaluation Agent
● MCP84% similar
no public price
Scorable MCP Server
● MCP81% similar
no public price
Mentor
● MCP76% similar
no public price
toolroute - Intelligent Automated LLM Routing
● MCP75% similar
no public price
Autoeval
● MCP74% similar
no public price
FreeLLM-MCP
● MCP74% similar
no public price
WorldCore
● MCP73% similar
no public price
Xzar MCP
● MCP73% similar
no public price
EvalForge Lite
● MCP73% similar
no public price
Evalgate
● MCP72% similar
no public price
Overwing MCP
● MCP72% similar
no Pro plan
entry $29/mo
DE
Deepresearch Bench Ii
● MCP72% similar
no public price
Agent Analytics Eval
● MCP72% similar
no public price
Laya Jev MCP
● MCP72% similar
no public price
AAgents3Ranked by similarity
Multi-Judge Consensus
● AGENT79% similar
no public price
Decision Agent
● AGENT73% similar
$800/mo Pro
TALENS
● AGENT73% similar
no public price
OOther7Ranked by similarity
AeroEval-SWE
● OTHER75% similar
no public price
tool-eval-bench
● OTHER74% similar
no public price
Agentevals Via Github
● OTHER73% similar
no public price
Agentic Eval
● OTHER72% similar
no public price
Skillgrade
● OTHER72% similar
no public price
Agent-Eval-Pipeline
● OTHER72% similar
no public price
Navital Gym
● OTHER72% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.