agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around niceeval

Agent-native evaluation framework for testing AI agents and coding agents. Write evals like unit tests, run across targets with built-in sandbox and observability.

Visit niceeval.com ↗Pricing page ↗
Pricing (0 buyer tiers · 1 plan)
Free plan available Free
As parsed from niceeval.com/ on 2026-08-24.

Explore the market

Prices and medians update for the tier you select.

Compare at
niceeval · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
niceeval doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
92nd pctile
634 strong substitutes
Price momentum · 31d
Flat
Agents · Pro median
$29/mo
1 priced · $29–$29 mid 50%
APIs · Pro median
$50/mo
1 priced · $50–$50 mid 50%
Platforms · Pro median
$39/mo
8 priced · $23.13–$77.49 mid 50%
Price spectrum · Pro plans · 8 of 10 providers priced · log scale · $14.5 → $199/mo
Agents APIs Platforms◻ shaded = middle 50% · line = median (all types)niceeval has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches niceeval's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

FFrameworks13Ranked by relevance
niceevalthis listing
● FRAMEWORK · relevance 100%
no public price
agentspec
● FRAMEWORK · relevance 83%
no public price
evalmonkey
● FRAMEWORK · relevance 82%
no public price
langwatch
● FRAMEWORK · relevance 82%
no Pro plan
entry $34/mo
acs
● FRAMEWORK · relevance 79%
no public price
bound
● FRAMEWORK · relevance 78%
no public price
agentbench
● FRAMEWORK · relevance 78%
no public price
factorly
● FRAMEWORK · relevance 77%
no public price
access_github
● FRAMEWORK · relevance 77%
no public price
cage_lite
● FRAMEWORK · relevance 76%
no public price
Automaker
● FRAMEWORK · relevance 76%
no public price
sagefs
● FRAMEWORK · relevance 76%
no public price
ScaffoldScope
● FRAMEWORK · relevance 75%
no public price
PPlatforms22Ranked by relevance
agentsproof
● PLATFORM · relevance 85%
$24.17/mo Pro
-38% vs Pro median
Agentic Evaluation Platform
● PLATFORM · relevance 81%
no public price
agent_eval_harness
● PLATFORM · relevance 80%
no public price
klavis_ai
● PLATFORM · relevance 79%
no public price
litefuse
● PLATFORM · relevance 79%
$199/mo Pro
+410% vs Pro median
Bartholomew
● PLATFORM · relevance 79%
no public price
ctf_agent_benchmark
● PLATFORM · relevance 78%
no public price
future_agi
● PLATFORM · relevance 78%
no public price
bottrade
● PLATFORM · relevance 78%
$19.99/mo Pro
-49% vs Pro median
promptlayer
● PLATFORM · relevance 78%
$49/mo Pro
+26% vs Pro median
matraix
● PLATFORM · relevance 77%
no public price
monte_carlo_agent_observabilit
● PLATFORM · relevance 77%
no public price
dexto
● PLATFORM · relevance 77%
no public price
fiveonefour
● PLATFORM · relevance 77%
no public price
dros_vep_lite
● PLATFORM · relevance 77%
no public price
agentic_design
● PLATFORM · relevance 76%
$14.5/mo Pro
-63% vs Pro median
wolli
● PLATFORM · relevance 76%
no public price
aming_claw
● PLATFORM · relevance 76%
no public price
Galileo
● PLATFORM · relevance 76%
$100/mo Pro
+156% vs Pro median
agentleak
● PLATFORM · relevance 76%
no public price
comet_opik
● PLATFORM · relevance 75%
no public price
agent_ci
● PLATFORM · relevance 75%
no public price
OOther4Ranked by relevance
agentevals_via_github
● OTHER · relevance 81%
no public price
kalytera
● OTHER · relevance 79%
no Pro plan
entry $49/mo
clawbench
● OTHER · relevance 78%
no public price
solarbench
● OTHER · relevance 75%
no public price
MMCP servers8Ranked by relevance
evalgate_mcp
● MCP · relevance 80%
no public price
mk_family
● MCP · relevance 79%
no public price
verifyax_mcp
● MCP · relevance 78%
no public price
opentester
● MCP · relevance 78%
no public price
mithril
● MCP · relevance 77%
no public price
cold-run
● MCP · relevance 76%
no public price
guide
● MCP · relevance 76%
no public price
ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox
● MCP · relevance 75%
no public price
AAPIs1Ranked by relevance
Agent Observability
● API · relevance 79%
$50/mo Pro
AAgents2Ranked by relevance
operative
● AGENT · relevance 78%
$29/mo Pro
TestTrout
● AGENT · relevance 75%
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.