Agent Observability Eval
Query this niche via MCP
niche_report({ niche: "agent-observability-eval" })Agents · median
$99/mo
MCP servers · median
$29/mo
3.4×
Agents cost 3.4× MCPs across all tiers — median $99 vs $29. Two different markets; a blended figure would mislead either buyer.
All plans — Agents vs MCPs
each dot = one provider · log scaleAgents $99
clawmetry · $9
Swe Agent Arena · $15
Ml Intern · $15
retrace · $29
Agnost Ai · $49
kalytera · $49
Agentwatch 2 · $49
oversai · $499
Aapanel Ai Assistant · $17
clawmetry · $19
telemetry · $25
agentsproof · $27
agenta · $29
agentops · $40
Swe Agent Arena · $50
Arize Agent Observability · $50
Livekit Agent Observability · $50
Ml Intern · $50
voker · $80
agentcat · $90
retrace · $99
Honeycomb Canvas · $150
litefuse · $199
Agnost Ai · $499
oversai · $1,750
agnys · $49
telemetry · $100
kalytera · $149
Parea Ai · $150
agentcat · $160
Respan Gateway · $199
agentell · $250
agenta · $299
litefuse · $300
Failproof Ai · $349
Agentwatch 2 · $399
retrace · $399
voker · $400
mirrors · $499
Livekit Agent Observability · $500
oversai · $1,499
MCP servers $29
Llm Abacus · $4
watchfor · $8
Mcp Judge · $10
My First Mcp · $10
Ai Gateway · $10
operations · $15
monitor · $19
goodeye · $20
watchfor · $29
toolrank · $29
Llm Abacus · $100
watchfor · $56
monitor · $74
operations · $79
toolrank · $99
operations · $399
toolrank · $499
$5
$10
$25
$50
$100
$250
$500
$1,000
AgentsMCP serversshaded = middle half · line = median
All plans
58 pricedProvidervs its cohort medianMonthly
Llm Abacusmcp
$4 below
watchformcp
$8 below
clawmetryagent
$9 below
Mcp Judgemcp
$10 below
My First Mcpmcp
$10 below
Ai Gatewaymcp
$10 below
Swe Agent Arenaagent
$15 below
Ml Internagent
$15 below
operationsmcp
$15 below
Aapanel Ai Assistantagent
$17 below
clawmetryagent
$19 below
monitormcp
$19 below
goodeyemcp
$20 below
telemetryagent
$25 below
agentsproofagent
$27 below
retraceagent
$29 below
agentaagent
$29 below
watchformcp
$29 ~median
toolrankmcp
$29 ~median
agentopsagent
$40 below
Agnost Aiagent
$49 below
kalyteraagent
$49 below
Agentwatch 2agent
$49 below
agnysagent
$49 below
Swe Agent Arenaagent
$50 below
Arize Agent Observabilityagent
$50 below
Livekit Agent Observabilityagent
$50 below
Ml Internagent
$50 below
watchformcp
$56 above
monitormcp
$74 above
operationsmcp
$79 above
vokeragent
$80 below
agentcatagent
$90 ~median
retraceagent
$99 ~median
toolrankmcp
$99 above
telemetryagent
$100 ~median
Llm Abacusmcp
$100 above
kalyteraagent
$149 above
Honeycomb Canvasagent
$150 above
Parea Aiagent
$150 above
agentcatagent
$160 above
litefuseagent
$199 above
Respan Gatewayagent
$199 above
agentellagent
$250 above
agentaagent
$299 above
litefuseagent
$300 above
Failproof Aiagent
$349 above
Agentwatch 2agent
$399 above
retraceagent
$399 above
operationsmcp
$399 above
vokeragent
$400 above
oversaiagent
$499 above
Agnost Aiagent
$499 above
mirrorsagent
$499 above
toolrankmcp
$499 above
Livekit Agent Observabilityagent
$500 above
oversaiagent
$1,499 above
oversaiagent
$1,750 above
Position is relative to the provider's own delivery-type median at this tier — never a blended one.
This page is the human view of the MCP answer. The same structured `niche_report` / `price_benchmark` an agent receives over MCP or REST.
niche_reportprice_benchmark
See the MCP response behind this pageniche_report
{
"niche": "agent-observability-eval",
"parent_sector": "developer-tools-infra",
"provider_type_pricing": {
"slug": "agent-observability-eval",
"pricing_basis": "lowest_observed_monthly_usd",
"provider_type_methodology": "commercial-form-v2",
"provider_type_methodology_published_at": "2026-07-31",
"blended": {
"median": 40,
"p25": 16.5,
"p75": 99,
"providers": 45
},
"by_provider_type": {
"agent": {
"median": 49,
"p25": 29,
"p75": 162.25,
"providers": 36,
"publishable": true,
"confidence": "normal"
},
"mcp": {
"median": 10,
"p25": null,
"p75": null,
"providers": 9,
"publishable": true,
"confidence": "moderate"
}
},
"recommended_cohort": null,
"recommendation_reason": "Choose the cohort according to the commercial delivery type being assessed.",
"fallback_context": null,
"context_note": null
},
"crowding_level": "sparse",
"observed_node_count": 2,
"adjacent_niches": [
"ai-frontend-coding",
"incident-response-sre",
"mcp-platform-provider",
"database-query-agent",
"on-call-management-agent",
"infrastructure-provisioning-iac"
],
"market_pulse": {
"pulse": 50,
"drivers": [
"enterprise money present",
"1 new builder in 30d"
],
"price_move_30d_pct": 1.1,
"money_share": 0.49295774647887325,
"entry_rate": 0.00546448087431694,
"alive_share": 0.9690721649484536
},
"price_move": {
"d_pct": -1.1,
"w_pct": -1.1,
"m_pct": -0.4,
"comparable_agents": 44,
"quarantined_agents": 1,
"confidence": "high",
"published": {
"d": true,
"w": true,
"m": false
},
"held_reason": {
"d": null,
"w": null,
"m": null
},
"driver": {
"d": "llm_abacus's \"ChatGPT Go\" $8→$4.17 (-48%)",
"w": "llm_abacus's \"ChatGPT Go\" $8→$4.17 (-48%)",
"m": "turva_dev's \"Audit\" $7410→$4902 (-34%)"
},
"tier_contribution": {
"d": {
"individual": -0.99,
"pro": -0.11,
"team_sme": 0,
"enterprise": 0
},
"w": {
"individual": -0.99,
"pro": -0.11,
"team_sme": 0,
"enterprise": 0
},
"m": {
"individual": 0.01,
"pro": -0.11,
"team_sme": 0,
"enterprise": -0.31
}
},
"tier_series": {
"individual": [
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100.992,
100.992,
100.992,
100.992,
100.992,
100.992,
100.992,
100.015
],
"pro": [
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
99.015,
98.906
],
"team_sme": [
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457,
99.457
],
"enterprise": [
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
100,
99.678,
99.678,
99.678,
99.678,
99.678,
99.678,
99.678,
99.678,
99.678
]
},
"tier_own_move": {
"d": {
"individual": -4.5,
"pro": -0.3,
"team_sme": 0,
"enterprise": 0
},
"w": {
"individual": -4.5,
"pro": -0.3,
"team_sme": 0,
"enterprise": 0
},
"m": {
"individual": 0,
"pro": -0.3,
"team_sme": 0,
"enterprise": -2.9
}
},
"tier_agents": {
"individual": 14,
"pro": 23,
"team_sme": 23,
"enterprise": 7
},
"obs_range": {
"d": {
"min": 67,
"max": 67,
"days": 1
},
"w": {
"min": 67,
"max": 67,
"days": 1
},
"m": {
"min": 64,
"max": 67,
"days": 3
}
},
"tier_obs_range": {
"d": {
"individual": {
"min": 14,
"max": 14,
"days": 1
},
"pro": {
"min": 23,
"max": 23,
"days": 1
},
"team_sme": null,
"enterprise": null
},
"w": {
"individual": {
"min": 14,
"max": 14,
"days": 1
},
"pro": {
"min": 23,
"max": 23,
"days": 1
},
"team_sme": null,
"enterprise": null
},
"m": {
"individual": {
"min": 14,
"max": 14,
"days": 2
},
"pro": {
"min": 23,
"max": 23,
"days": 1
},
"team_sme": null,
"enterprise": {
"min": 7,
"max": 7,
"days": 1
}
}
}
},
"pricing": {
"sampleSize": 178,
"observed": 71,
"byPersona": {
"free": {
"n": 55,
"nPriced": 0,
"reliability": "none",
"median": null,
"p25": null,
"p75": null,
"min": null,
"max": null,
"mean": null,
"stdev": null,
"usageShare": 0.11
},
"individual": {
"n": 58,
"nPriced": 48,
"reliability": "high",
"median": 2.25,
"p25": 0.3,
"p75": 10,
"min": 0.01,
"max": 49,
"mean": 8.31,
"stdev": 13.39,
"usageShare": 0.64
},
"pro": {
"n": 34,
"nPriced": 29,
"reliability": "high",
"median": 40,
"p25": 24.17,
"p75": 90,
"min": 0.07,
"max": 499,
"mean": 77.74,
"stdev": 102.42,
"usageShare": 0.06
},
"team_sme": {
"n": 31,
"nPriced": 27,
"reliability": "high",
"median": 150,
"p25": 91.13,
"p75": 299.5,
"min": 29,
"max": 599,
"mean": 212.62,
"stdev": 176.09,
"usageShare": 0.06
},
"enterprise": {
"n": 43,
"nPriced": 5,
"reliability": "medium",
"median": 500,
"p25": 499,
"p75": 500,
"min": 399,
"max": 1500,
"mean": 679.6,
"stdev": 460.68,
"usageShare": 0
}
},
"byPersonaMonthly": {
"free": {
"nMonthly": 0,
"p25": null,
"median": null,
"p75": null,
"confidence": "none",
"usageShare": 0.11,
"mixedBilling": true,
"monthlyComparable": false
},
"individual": {
"nMonthly": 11,
"p25": 9,
"median": 20,
"p75": 39,
"confidence": "medium",
"usageShare": 0.64,
"mixedBilling": true,
"monthlyComparable": true
},
"pro": {
"nMonthly": 27,
"p25": 24.59,
"median": 40,
"p75": 85,
"confidence": "high",
"usageShare": 0.06,
"mixedBilling": true,
"monthlyComparable": true
},
"team_sme": {
"nMonthly": 25,
"p25": 99,
"median": 150,
"p75": 300,
"confidence": "high",
"usageShare": 0.06,
"mixedBilling": true,
"monthlyComparable": true
},
"enterprise": {
"nMonthly": 5,
"p25": 499,
"median": 500,
"p75": 500,
"confidence": "medium",
"usageShare": 0,
"mixedBilling": false,
"monthlyComparable": true
}
},
"byTierCohorts": {
"status": "ok",
"cohorts": [
{
"tier": "individual",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 14.5,
"provider_count": 13,
"plan_observation_count": 15,
"data_confidence": 0.95,
"data_confidence_basis": {
"provider_component": 1,
"observation_component": 0.75,
"provider_count": 13,
"plan_observation_count": 15
},
"reliability": "high",
"members": [
{
"provider": "llm_abacus",
"usd": 4.17
},
{
"provider": "watchfor",
"usd": 7.98
},
{
"provider": "clawmetry",
"usd": 9
},
{
"provider": "mcp_judge",
"usd": 10
},
{
"provider": "my_first_mcp",
"usd": 10
},
{
"provider": "ai_gateway",
"usd": 10
},
{
"provider": "swe_agent_arena",
"usd": 14.5
},
{
"provider": "ml_intern",
"usd": 14.5
},
{
"provider": "retrace",
"usd": 29
},
{
"provider": "agentwatch_2",
"usd": 49
},
{
"provider": "agnost_ai",
"usd": 49
},
{
"provider": "kalytera",
"usd": 49
},
{
"provider": "oversai",
"usd": 499
}
],
"p25": 10,
"p75": 49
},
{
"tier": "pro",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 50,
"provider_count": 23,
"plan_observation_count": 27,
"data_confidence": 1,
"data_confidence_basis": {
"provider_component": 1,
"observation_component": 1,
"provider_count": 23,
"plan_observation_count": 27
},
"reliability": "high",
"members": [
{
"provider": "operations",
"usd": 15
},
{
"provider": "aapanel_ai_assistant",
"usd": 16.5
},
{
"provider": "clawmetry",
"usd": 19
},
{
"provider": "monitor",
"usd": 19
},
{
"provider": "goodeye",
"usd": 20
},
{
"provider": "telemetry",
"usd": 25
},
{
"provider": "agentsproof",
"usd": 26.59
},
{
"provider": "watchfor",
"usd": 28.5
},
{
"provider": "toolrank",
"usd": 29
},
{
"provider": "agenta",
"usd": 29
},
{
"provider": "agentops",
"usd": 40
},
{
"provider": "swe_agent_arena",
"usd": 50
},
{
"provider": "arize_agent_observability",
"usd": 50
},
{
"provider": "livekit_agent_observability",
"usd": 50
},
{
"provider": "ml_intern",
"usd": 50
},
{
"provider": "voker",
"usd": 80
},
{
"provider": "agentcat",
"usd": 90
},
{
"provider": "retrace",
"usd": 99
},
{
"provider": "llm_abacus",
"usd": 100
},
{
"provider": "honeycomb_canvas",
"usd": 150
},
{
"provider": "litefuse",
"usd": 199
},
{
"provider": "agnost_ai",
"usd": 499
},
{
"provider": "oversai",
"usd": 1749.5
}
],
"p25": 25.8,
"p75": 94.5
},
{
"tier": "team_sme",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 224.5,
"provider_count": 20,
"plan_observation_count": 24,
"data_confidence": 1,
"data_confidence_basis": {
"provider_component": 1,
"observation_component": 1,
"provider_count": 20,
"plan_observation_count": 24
},
"reliability": "high",
"members": [
{
"provider": "agnys",
"usd": 49
},
{
"provider": "watchfor",
"usd": 55.86
},
{
"provider": "monitor",
"usd": 74
},
{
"provider": "operations",
"usd": 79
},
{
"provider": "toolrank",
"usd": 99
},
{
"provider": "telemetry",
"usd": 100
},
{
"provider": "kalytera",
"usd": 149
},
{
"provider": "parea_ai",
"usd": 150
},
{
"provider": "agentcat",
"usd": 160
},
{
"provider": "respan_gateway",
"usd": 199
},
{
"provider": "agentell",
"usd": 250
},
{
"provider": "agenta",
"usd": 299
},
{
"provider": "litefuse",
"usd": 300
},
{
"provider": "failproof_ai",
"usd": 349
},
{
"provider": "agentwatch_2",
"usd": 399
},
{
"provider": "retrace",
"usd": 399
},
{
"provider": "voker",
"usd": 400
},
{
"provider": "mirrors",
"usd": 499
},
{
"provider": "livekit_agent_observability",
"usd": 500
},
{
"provider": "oversai",
"usd": 1499
}
],
"p25": 99.75,
"p75": 399
},
{
"tier": "team_sme",
"currency": "USD",
"period": "month",
"unit": "per_seat",
"median": 38,
"provider_count": 3,
"plan_observation_count": 3,
"data_confidence": 0.23,
"data_confidence_basis": {
"provider_component": 0.25,
"observation_component": 0.15,
"provider_count": 3,
"plan_observation_count": 3
},
"reliability": "low",
"members": [
{
"provider": "langwatch",
"usd": 33.06
},
{
"provider": "mcpjam",
"usd": 38
},
{
"provider": "runtime",
"usd": 99
}
]
},
{
"tier": "enterprise",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 499,
"provider_count": 3,
"plan_observation_count": 3,
"data_confidence": 0.23,
"data_confidence_basis": {
"provider_component": 0.25,
"observation_component": 0.15,
"provider_count": 3,
"plan_observation_count": 3
},
"reliability": "low",
"members": [
{
"provider": "operations",
"usd": 399
},
{
"provider": "toolrank",
"usd": 499
},
{
"provider": "cekura",
"usd": 500
}
]
}
],
"rejected": {
"free_or_zero": 7,
"ambiguous_cadence": 36,
"usage_not_monthly": 34,
"one_time": 13,
"unrankable_or_unparseable": 3
},
"evidence": {
"status": "ok",
"single_observations": [],
"observed_offers": [
{
"billing": "monthly",
"unit": "flat",
"count": 69,
"offers": [
{
"provider": "aapanel_ai_assistant",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$198.00 / Year",
"monthly_usd": 16.5
},
{
"provider": "agenta",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$29 /month",
"monthly_usd": 29
},
{
"provider": "agenta",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$299 /month",
"monthly_usd": 299
},
{
"provider": "agentcat",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$160 / month",
"monthly_usd": 160
},
{
"provider": "agentcat",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$90 / month",
"monthly_usd": 90
},
{
"provider": "agentell",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$250 /mo",
"monthly_usd": 250
},
{
"provider": "agentops",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$40 per month",
"monthly_usd": 40
},
{
"provider": "agentsproof",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$29 / month",
"monthly_usd": 29
},
{
"provider": "agentsproof",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$290/yr",
"monthly_usd": 24.17
},
{
"provider": "agentwatch_2",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$49/mo",
"monthly_usd": 49
},
{
"provider": "agentwatch_2",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$199/mo",
"monthly_usd": 199
},
{
"provider": "agentwatch_2",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$599/mo",
"monthly_usd": 599
},
{
"provider": "agnost_ai",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$49/mo",
"monthly_usd": 49
},
{
"provider": "agnost_ai",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$499/mo",
"monthly_usd": 499
},
{
"provider": "agnys",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$49 /mo",
"monthly_usd": 49
},
{
"provider": "ai_gateway",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$10/mo",
"monthly_usd": 10
},
{
"provider": "arize_agent_observability",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$50/mo",
"monthly_usd": 50
},
{
"provider": "cekura",
"tier": "enterprise",
"billing": "monthly",
"unit": "flat",
"price": "$500/month",
"monthly_usd": 500
},
{
"provider": "clawmetry",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$9/mo",
"monthly_usd": 9
},
{
"provider": "clawmetry",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$19/mo",
"monthly_usd": 19
},
{
"provider": "failproof_ai",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$99 / mo",
"monthly_usd": 99
},
{
"provider": "failproof_ai",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$599 / mo",
"monthly_usd": 599
},
{
"provider": "goodeye",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$20/mo",
"monthly_usd": 20
},
{
"provider": "honeycomb_canvas",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "Starting at $150 per month",
"monthly_usd": 150
},
{
"provider": "kalytera",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$49 / month",
"monthly_usd": 49
},
{
"provider": "kalytera",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$149 / month",
"monthly_usd": 149
},
{
"provider": "litefuse",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$199 / month",
"monthly_usd": 199
},
{
"provider": "litefuse",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$300/mo",
"monthly_usd": 300
},
{
"provider": "livekit_agent_observability",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$50/mo",
"monthly_usd": 50
},
{
"provider": "livekit_agent_observability",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$500/mo",
"monthly_usd": 500
},
{
"provider": "llm_abacus",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$4.17",
"monthly_usd": 4.17
},
{
"provider": "llm_abacus",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$16.01",
"monthly_usd": 16.01
},
{
"provider": "llm_abacus",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$100.00",
"monthly_usd": 100
},
{
"provider": "llm_abacus",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$200.00",
"monthly_usd": 200
},
{
"provider": "mcp_judge",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$10/mo",
"monthly_usd": 10
},
{
"provider": "mirrors",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$499 /mo",
"monthly_usd": 499
},
{
"provider": "ml_intern",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$9 /mo",
"monthly_usd": 9
},
{
"provider": "ml_intern",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$20 /mo",
"monthly_usd": 20
},
{
"provider": "ml_intern",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$50 /mo",
"monthly_usd": 50
},
{
"provider": "monitor",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$19 /mo",
"monthly_usd": 19
},
{
"provider": "monitor",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$49 /mo",
"monthly_usd": 49
},
{
"provider": "monitor",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$99 /mo",
"monthly_usd": 99
},
{
"provider": "my_first_mcp",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$10/mo",
"monthly_usd": 10
},
{
"provider": "operations",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$15 /mo",
"monthly_usd": 15
},
{
"provider": "operations",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$79 /mo",
"monthly_usd": 79
},
{
"provider": "operations",
"tier": "enterprise",
"billing": "monthly",
"unit": "flat",
"price": "$399 /mo",
"monthly_usd": 399
},
{
"provider": "oversai",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$500/month billed annually",
"monthly_usd": 500
},
{
"provider": "oversai",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$499/mo billed annually",
"monthly_usd": 499
},
{
"provider": "oversai",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$999/mo billed annually",
"monthly_usd": 999
},
{
"provider": "oversai",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$1,999/mo billed annually",
"monthly_usd": 1999
},
{
"provider": "oversai",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$2,999/mo billed annually",
"monthly_usd": 2999
},
{
"provider": "parea_ai",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$150 / month",
"monthly_usd": 150
},
{
"provider": "respan_gateway",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$ 199 per month",
"monthly_usd": 199
},
{
"provider": "retrace",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$29 /mo",
"monthly_usd": 29
},
{
"provider": "retrace",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$99 /mo",
"monthly_usd": 99
},
{
"provider": "retrace",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$399 /mo",
"monthly_usd": 399
},
{
"provider": "swe_agent_arena",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$9 /mo",
"monthly_usd": 9
},
{
"provider": "swe_agent_arena",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "$20 /mo",
"monthly_usd": 20
},
{
"provider": "swe_agent_arena",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$50 /mo",
"monthly_usd": 50
},
{
"provider": "telemetry",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$25/m",
"monthly_usd": 25
},
{
"provider": "telemetry",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$100/m",
"monthly_usd": 100
},
{
"provider": "toolrank",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$29 /month",
"monthly_usd": 29
},
{
"provider": "toolrank",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$99 /month",
"monthly_usd": 99
},
{
"provider": "toolrank",
"tier": "enterprise",
"billing": "monthly",
"unit": "flat",
"price": "$499/month",
"monthly_usd": 499
},
{
"provider": "voker",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "$80 / mo",
"monthly_usd": 80
},
{
"provider": "voker",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "$400 / mo",
"monthly_usd": 400
},
{
"provider": "watchfor",
"tier": "individual",
"billing": "monthly",
"unit": "flat",
"price": "€7.00/mo",
"monthly_usd": 7.98
},
{
"provider": "watchfor",
"tier": "pro",
"billing": "monthly",
"unit": "flat",
"price": "€25.00/mo",
"monthly_usd": 28.5
},
{
"provider": "watchfor",
"tier": "team_sme",
"billing": "monthly",
"unit": "flat",
"price": "€49.00/mo",
"monthly_usd": 55.86
}
]
},
{
"billing": "monthly",
"unit": "per_seat",
"count": 4,
"offers": [
{
"provider": "langsmith",
"tier": "pro",
"billing": "monthly",
"unit": "per_seat",
"price": "$39 / seat per month",
"monthly_usd": 39
},
{
"provider": "langwatch",
"tier": "team_sme",
"billing": "monthly",
"unit": "per_seat",
"price": "€29 / core-seat / month",
"monthly_usd": 33.06
},
{
"provider": "mcpjam",
"tier": "team_sme",
"billing": "monthly",
"unit": "per_seat",
"price": "$38 /seat/mo",
"monthly_usd": 38
},
{
"provider": "runtime",
"tier": "team_sme",
"billing": "monthly",
"unit": "per_seat",
"price": "Starting from $99 /seat/month",
"monthly_usd": 99
}
]
},
{
"billing": "one_time",
"unit": "flat",
"count": 13,
"offers": [
{
"provider": "aapanel_ai_assistant",
"tier": "pro",
"billing": "one_time",
"unit": "flat",
"price": "$699.00 / Lifetime",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "individual",
"billing": "one_time",
"unit": "flat",
"price": "$10",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "team_sme",
"billing": "one_time",
"unit": "flat",
"price": "$50",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "pro",
"billing": "one_time",
"unit": "flat",
"price": "$90",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "team_sme",
"billing": "one_time",
"unit": "flat",
"price": "$400",
"monthly_usd": null
},
{
"provider": "sef_agent_reliability_pack",
"tier": "enterprise",
"billing": "one_time",
"unit": "flat",
"price": "$4,800",
"monthly_usd": null
},
{
"provider": "sef_agent_reliability_pack",
"tier": "enterprise",
"billing": "one_time",
"unit": "flat",
"price": "$12,500",
"monthly_usd": null
},
{
"provider": "sef_agent_reliability_pack",
"tier": "enterprise",
"billing": "one_time",
"unit": "flat",
"price": "$25,000",
"monthly_usd": null
},
{
"provider": "termi_protocol",
"tier": "individual",
"billing": "one_time",
"unit": "flat",
"price": "$5.59 one-time",
"monthly_usd": null
},
{
"provider": "tokentime",
"tier": "individual",
"billing": "one_time",
"unit": "flat",
"price": "$5",
"monthly_usd": null
},
{
"provider": "turva_dev",
"tier": "enterprise",
"billing": "one_time",
"unit": "flat",
"price": "€1,900",
"monthly_usd": null
},
{
"provider": "turva_dev",
"tier": "enterprise",
"billing": "one_time",
"unit": "flat",
"price": "€4,300",
"monthly_usd": null
},
{
"provider": "witness_protocol",
"tier": "pro",
"billing": "one_time",
"unit": "flat",
"price": "49 USDC",
"monthly_usd": null
}
]
},
{
"billing": "usage",
"unit": "flat",
"count": 32,
"offers": [
{
"provider": "clawbench",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$4.4425",
"monthly_usd": null
},
{
"provider": "clawbench",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.3325",
"monthly_usd": null
},
{
"provider": "clawbench",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.1935",
"monthly_usd": null
},
{
"provider": "clawbench",
"tier": "pro",
"billing": "usage",
"unit": "flat",
"price": "$0.0721",
"monthly_usd": null
},
{
"provider": "clawbench",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.3704",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "1.35 credits/MB/day",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "0.5 credits/query",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "0.2 credits/query",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "0.5 credits/1k tokens",
"monthly_usd": null
},
{
"provider": "clawtrace",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "2.5 credits/1k tokens",
"monthly_usd": null
},
{
"provider": "future_agi",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "From $2/GB",
"monthly_usd": null
},
{
"provider": "future_agi",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$10/1K credits",
"monthly_usd": null
},
{
"provider": "future_agi",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$5/100K req",
"monthly_usd": null
},
{
"provider": "future_agi",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$2/1M tokens",
"monthly_usd": null
},
{
"provider": "future_agi",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$10/1K credits",
"monthly_usd": null
},
{
"provider": "honeycomb_canvas",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "Starting at $0.10 / GB",
"monthly_usd": null
},
{
"provider": "langsmith",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$1.50 / LCU",
"monthly_usd": null
},
{
"provider": "langsmith",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$1.00 / LSU",
"monthly_usd": null
},
{
"provider": "langwatch",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "€5 / 100k",
"monthly_usd": null
},
{
"provider": "langwatch",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "€3 / GB",
"monthly_usd": null
},
{
"provider": "mcp_judge",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.05",
"monthly_usd": null
},
{
"provider": "my_first_mcp",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.10 / 1K RPCs",
"monthly_usd": null
},
{
"provider": "newrelic",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.40/GB ingested beyond the free allowance",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.075 with credits; $0.094 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.075 with credits; $0.094 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.075 with credits; $0.094 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.035 with credits; $0.044 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$1 with credits; $1.25 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$15 with credits; $18.75 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$5 with credits; $6.25 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.03 with credits; $0.038 after credits",
"monthly_usd": null
},
{
"provider": "oversai",
"tier": "individual",
"billing": "usage",
"unit": "flat",
"price": "$0.99 with credits; $1.24 after credits",
"monthly_usd": null
}
]
},
{
"billing": "usage",
"unit": "other_usage",
"count": 1,
"offers": [
{
"provider": "witness_protocol",
"tier": "individual",
"billing": "usage",
"unit": "other_usage",
"price": "$0.01 per page",
"monthly_usd": null
}
]
},
{
"billing": "usage",
"unit": "per_minute",
"count": 1,
"offers": [
{
"provider": "future_agi",
"tier": "individual",
"billing": "usage",
"unit": "per_minute",
"price": "$0.08/minute",
"monthly_usd": null
}
]
},
{
"billing": "unspecified_period",
"unit": "flat",
"count": 36,
"offers": [
{
"provider": "agenta",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "agentell",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "agentops",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "agnost_ai",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "agnys",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "ai_gateway",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "arize_agent_observability",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "bitdive",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "cekura",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "failproof_ai",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "goodeye",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "hamming_ai_enterprise_voice_ag",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "hamming_ai_enterprise_voice_ag",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "hamming_ai_enterprise_voice_ag",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "honeycomb_canvas",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom plans to fit your needs",
"monthly_usd": null
},
{
"provider": "kalytera",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "custom contract",
"monthly_usd": null
},
{
"provider": "lagotto_meter",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "500EUR",
"monthly_usd": null
},
{
"provider": "lagotto_meter",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "1500EUR",
"monthly_usd": null
},
{
"provider": "langsmith",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom pricing",
"monthly_usd": null
},
{
"provider": "langwatch",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "litefuse",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "mcp_judge",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "mirrors",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom pricing",
"monthly_usd": null
},
{
"provider": "monte_carlo_agent_observabilit",
"tier": "team_sme",
"billing": "unspecified_period",
"unit": "flat",
"price": "Request pricing",
"monthly_usd": null
},
{
"provider": "monte_carlo_agent_observabilit",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Request pricing",
"monthly_usd": null
},
{
"provider": "monte_carlo_agent_observabilit",
"tier": "team_sme",
"billing": "unspecified_period",
"unit": "flat",
"price": "Request pricing",
"monthly_usd": null
},
{
"provider": "my_first_mcp",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "newrelic",
"tier": "pro",
"billing": "unspecified_period",
"unit": "flat",
"price": "Get Standard Pricing",
"monthly_usd": null
},
{
"provider": "newrelic",
"tier": "pro",
"billing": "unspecified_period",
"unit": "flat",
"price": "Get Pro Pricing",
"monthly_usd": null
},
{
"provider": "newrelic",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Get Custom Pricing",
"monthly_usd": null
},
{
"provider": "parea_ai",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "parea_ai",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "respan_gateway",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "retrace",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Contact us",
"monthly_usd": null
},
{
"provider": "runtime",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
},
{
"provider": "voker",
"tier": "enterprise",
"billing": "unspecified_period",
"unit": "flat",
"price": "Custom",
"monthly_usd": null
}
]
}
],
"coverage": {
"priced_providers": 52,
"normalized_observations": 73,
"comparable_providers": 39,
"strict_cohorts": 5,
"exclusion_reasons": {
"free_or_zero": 7,
"ambiguous_cadence": 36,
"usage_not_monthly": 34,
"one_time": 13,
"unrankable_or_unparseable": 3
}
}
}
},
"billingMix": {
"free": 17,
"freemium": 40,
"subscription": 5,
"one-time": 3,
"usage": 4,
"contact_sales": 2
},
"freeTierShare": 0.8,
"medianLowestUsd": 40
},
"movement": {
"niche": "agent-observability-eval",
"sector": "developer-tools-infra",
"pricedNow": 45,
"pairs": 43,
"repriced": [
{
"handle": "llm_abacus",
"from": 8,
"to": 4.17,
"pct": -47.9
},
{
"handle": "clawmetry",
"from": 7.5,
"to": 9,
"pct": 20
},
{
"handle": "turva_dev",
"from": 2219.56,
"to": 2205.35,
"pct": -0.6
},
{
"handle": "langwatch",
"from": 33.88,
"to": 33.66,
"pct": -0.6
}
],
"newlyPriced": [
"witness_protocol",
"watchfor"
],
"droppedFromPriced": [],
"likeForLikePct": -1.1,
"kind": "mixed",
"narrative": "Repricing + composition: 4 agents repriced — 1 up, 3 down; 2 newly published pricing."
},
"index_series": {
"series": [
{
"day": "2026-08-01",
"index": 98.478,
"pairs": 58,
"dayChangePct": 0
},
{
"day": "2026-08-02",
"index": 98.478,
"pairs": 57,
"dayChangePct": 0
},
{
"day": "2026-08-03",
"index": 98.478,
"pairs": 57,
"dayChangePct": 0
},
{
"day": "2026-08-04",
"index": 98.478,
"pairs": 57,
"dayChangePct": 0
},
{
"day": "2026-08-05",
"index": 98.478,
"pairs": 58,
"dayChangePct": 0
},
{
"day": "2026-08-06",
"index": 98.478,
"pairs": 58,
"dayChangePct": 0
},
{
"day": "2026-08-07",
"index": 98.478,
"pairs": 58,
"dayChangePct": 0
},
{
"day": "2026-08-08",
"index": 98.478,
"pairs": 60,
"dayChangePct": 0
},
{
"day": "2026-08-09",
"index": 98.478,
"pairs": 62,
"dayChangePct": 0
},
{
"day": "2026-08-10",
"index": 98.478,
"pairs": 61,
"dayChangePct": 0
},
{
"day": "2026-08-11",
"index": 98.478,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-12",
"index": 98.478,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-13",
"index": 98.478,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-14",
"index": 98.478,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-15",
"index": 98.478,
"pairs": 65,
"dayChangePct": 0
},
{
"day": "2026-08-16",
"index": 98.478,
"pairs": 66,
"dayChangePct": 0
},
{
"day": "2026-08-17",
"index": 98.478,
"pairs": 66,
"dayChangePct": 0
},
{
"day": "2026-08-18",
"index": 98.478,
"pairs": 66,
"dayChangePct": 0
},
{
"day": "2026-08-19",
"index": 98.478,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-20",
"index": 98.478,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-21",
"index": 98.478,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-22",
"index": 98.16,
"pairs": 64,
"dayChangePct": -0.32
},
{
"day": "2026-08-23",
"index": 99.134,
"pairs": 66,
"dayChangePct": 0.99
},
{
"day": "2026-08-24",
"index": 99.134,
"pairs": 64,
"dayChangePct": 0
},
{
"day": "2026-08-25",
"index": 99.134,
"pairs": 66,
"dayChangePct": 0
},
{
"day": "2026-08-26",
"index": 99.134,
"pairs": 66,
"dayChangePct": 0
},
{
"day": "2026-08-27",
"index": 99.134,
"pairs": 66,
"dayChangePct": 0
},
{
"day": "2026-08-28",
"index": 99.134,
"pairs": 66,
"dayChangePct": 0
},
{
"day": "2026-08-29",
"index": 99.134,
"pairs": 67,
"dayChangePct": 0
},
{
"day": "2026-08-30",
"index": 98.066,
"pairs": 67,
"dayChangePct": -1.08
}
],
"latest": 98.066,
"day_change_pct": -1.08,
"methodology": "Chained daily price index, base 100 on the first priced scan day (29 Jun 2026). The overall index is the COMPOSITE of the four buyer-tier indices (individual / pro / team&sme / enterprise): each day it moves by the equal-weighted average of the tiers' moves. Each tier index is like-for-like — only agents priced on both consecutive scan days (per-agent ratios, geometric mean, clipped to [0.2, 5]) — so composition changes (agents revealing or hiding prices) can never move it."
},
"top_agents": [
{
"agent_id": "agentevals_via_github",
"name": "Agentevals Via Github",
"url": "https://github.com/agentevals-dev/agentevals",
"short_summary": "evaluates and scores AI agent behavior and performance from OpenTelemetry traces, benchmarking agents before production",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public pricing for agentevals is shown in the supplied repository content."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "agentops",
"name": "AgentOps",
"url": "https://agentops.ai",
"short_summary": "monitors, traces, debugs, and tracks costs of AI agents and LLM apps in production (observability)",
"price": {
"observed": true,
"billing": "freemium",
"lowest_monthly_usd": 40,
"monthly_usd": 40,
"headline": "Free tier, then from $40/mo",
"summary": "Free tier, then from $40/mo. AgentOps offers a free tier up to 5,000 events, Pro starting at $40/month with unlimited events, and custom Enterprise pricing."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "cekura",
"name": "Cekura",
"url": "https://cekura.ai/",
"short_summary": "tests, monitors, and helps improve voice and chat AI agents through pre-production simulation and production observability",
"price": {
"observed": true,
"billing": "usage",
"lowest_monthly_usd": 500,
"monthly_usd": 500,
"headline": "From $500/mo",
"summary": "From $500/mo. Cekura offers pay-as-you-go usage pricing, a $500/month Startup plan, and custom Enterprise pricing, with usage rates starting at $0.25 per minute."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "ceq",
"name": "CouchLoop EQ",
"url": "https://mcp.couchloop.com",
"short_summary": "behavioral governance for LLMs - monitors AI responses for hallucination, inconsistency, tone drift, and unsafe reasoning patterns",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public price found on the vendor site."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "clawbench",
"name": "Clawbench",
"url": "https://claw-bench.com/",
"short_summary": "Open benchmark that evaluates AI browser agents on real, live websites by giving them everyday online tasks (booking flights, ordering food, shopping, applying…",
"price": {
"observed": true,
"billing": "usage",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "Paid (price not published)",
"summary": "The homepage reports model-specific usage rates ranging from $0.0000 to $4.4425 per task."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "facticityai",
"name": "Facticity AI",
"url": "https://www.facticity.ai/",
"short_summary": "Real-time, multi-modal fact-checking for AI systems and content verification",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public subscription or usage pricing was observed on the homepage."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "github_crystianskillmap_map_in",
"name": "Github Crystianskillmap Map In",
"url": "https://github.com/crystian/skill-map",
"short_summary": "Maps, inspects, and audits AI-agent markdown ecosystems (skills, agents, commands, hooks) as a graph; detects collisions, orphans, semantic duplicates, token c…",
"price": {
"observed": false,
"billing": "unknown",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "GitHub offers a free plan, a Team plan at $4 per user/month, and Enterprise starting at $21 per user/month."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "hamming_ai_enterprise_voice_ag",
"name": "Hamming Ai Enterprise Voice Ag",
"url": "https://hamming.ai/",
"short_summary": "automated QA testing and production monitoring for voice and chat AI agents (auto-generates test scenarios, replays production calls, scores 50+ metrics, red-t…",
"price": {
"observed": true,
"billing": "contact_sales",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "Contact sales (no public price)",
"summary": "Hamming lists Agency, Startup, and Enterprise plans, but requires contacting the company for pricing."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "ia_qa_api",
"name": "ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox",
"url": "https://www.ia-qa.com/mcp-server",
"short_summary": "Provides 147+ QA, testing, and developer tools (prompt injection scan, hallucination check, semantic eval, RAG testing, agent trajectory validation, guardrails…",
"price": {
"observed": false,
"billing": "free",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "IA-QA offers its MCP server and developer tools for free with no signup or API key required."
},
"evidence_quality": "high",
"upvotes": 0
},
{
"agent_id": "langsmith",
"name": "Langsmith",
"url": "https://www.langchain.com/langsmith/observability",
"short_summary": "provides observability for AI agents and LLM applications via tracing, monitoring, and automated insights to debug failures and track cost/latency",
"price": {
"observed": true,
"billing": "freemium",
"lowest_monthly_usd": 39,
"monthly_usd": 39,
"headline": "Free tier, then from $39/mo",
"summary": "Free tier, then from $39/mo. LangSmith offers a free Developer plan, a $39-per-seat monthly Plus plan, custom Enterprise pricing, and additional usage-based charges."
},
"evidence_quality": "high",
"upvotes": 0
}
],
"platforms_also_here": [
{
"agent_id": "agent_analytics",
"name": "Agent Analytics",
"url": "https://agentanalytics.sh/",
"short_summary": "provides AI agents with product analytics they can operate: create projects, define events, shape funnels, set goals, run experiments, and remember experiment…",
"price": {
"observed": true,
"billing": "freemium",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "Free tier + paid plans (price not published)",
"summary": "The service offers a $0 tier with usage limits and usage-based pricing of $1 per 10k events for expanded capabilities."
},
"home_niche": "ai-data-platform",
"also_covers": true,
"upvotes": 0
},
{
"agent_id": "agent_ci",
"name": "Agent Ci",
"url": "https://agent-ci.com/",
"short_summary": "Continuous integration platform for AI agent development teams. Provides Git-native evaluation, automated testing on pull requests, performance regression dete…",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "Agent CI publicly promotes early access but does not show pricing in the supplied homepage content."
},
"home_niche": "ci-cd-optimization-agent",
"also_covers": true,
"upvotes": 0
},
{
"agent_id": "agent_versioningprompt_amp_age",
"name": "Agent Versioningprompt Amp Age",
"url": "https://automatic.co/agent-versioning",
"short_summary": "designs and implements versioning frameworks to track prompt updates and manage agent behavior changes across AI deployments",
"price": {
"observed": true,
"billing": "contact_sales",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "Contact sales (no public price)",
"summary": "Automatic offers three engagement models (sprint, milestone build, managed retainer) with fixed pricing structures, but no public prices are disclosed; contact sales required."
},
"home_niche": "prompt-management-platform",
"also_covers": true,
"upvotes": 0
},
{
"agent_id": "agentrx_systematic_debugging_f",
"name": "Agentrx Systematic Debugging F",
"url": "https://microsoft.com/en-us/research/blog/systematic-debugging-for-ai-agents-introducing-the-agentrx-framework",
"short_summary": "diagnoses AI agent failures by pinpointing the first unrecoverable 'critical failure step' in agent execution trajectories",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public price found on the vendor site."
},
"home_niche": "ai-debugging-agent",
"also_covers": true,
"upvotes": 0
},
{
"agent_id": "agntcy",
"name": "Agntcy",
"url": "https://docs.agntcy.org/",
"short_summary": "Open-source infrastructure for discovering, verifying, communicating with, and coordinating AI agents across frameworks and organizations, including directory…",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public price found on the vendor site."
},
"home_niche": "agent-network-protocol",
"also_covers": true,
"upvotes": 0
},
{
"agent_id": "boucle_framework",
"name": "Boucle Framework",
"url": "https://github.com/Bande-a-Bonnot/Boucle-framework",
"short_summary": "Autonomous agent framework with structured memory, safety hooks, and loop management. Includes Claude Code hooks that enforce security rules and prevent danger…",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public pricing for Boucle Framework was observed on the repository homepage."
},
"home_niche": "agent-framework-open-source",
"also_covers": true,
"upvotes": 0
},
{
"agent_id": "datarobot_agentic",
"name": "Agentic AI",
"url": "https://datarobot.com/product/agentic-ai/",
"short_summary": "provides a platform to develop, deploy, and govern multi-agent AI workflows and AI tools",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No clear public plan names, billing periods, or reliable price mapping were observed in the supplied content."
},
"home_niche": "agent-deployment-platform",
"also_covers": true,
"upvotes": 0
},
{
"agent_id": "dispatch_agents",
"name": "Dispatch Agents",
"url": "https://dispatchagents.ai/",
"short_summary": "Platform for deploying and managing AI agents in production. Handles event routing, retries, scaling, and observability for agents built on Claude SDK, CrewAI,…",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public price found on the vendor site."
},
"home_niche": "agent-deployment-platform",
"also_covers": true,
"upvotes": 0
}
],
"page_url": "https://agentery.com/market/agent-observability-eval",
"summary": {
"niche": "agent-observability-eval",
"sector": "developer-tools-infra",
"pricing_by_provider_type": {
"headline": "Prices differ by provider type and buyer tier — no blended headline is used. Strongest cohort: Agents · Pro median $50/mo (17 providers). See benchmarks_by_provider_type_and_tier for the full matrix.",
"benchmarks": [
{
"provider_type": "agent",
"provider_type_label": "Agents",
"buyer_tier": "pro",
"buyer_tier_label": "Pro",
"pricing_unit": "flat",
"pricing_unit_label": "flat monthly",
"comparable_provider_count": 17,
"reliability": "high",
"median": 50,
"p25": 29,
"p75": 99,
"status": "ok"
},
{
"provider_type": "agent",
"provider_type_label": "Agents",
"buyer_tier": "team_sme",
"buyer_tier_label": "Team / SME",
"pricing_unit": "flat",
"pricing_unit_label": "flat monthly",
"comparable_provider_count": 16,
"reliability": "high",
"median": 299.5,
"p25": 157.5,
"p75": 399.25,
"status": "ok"
},
{
"provider_type": "agent",
"provider_type_label": "Agents",
"buyer_tier": "individual",
"buyer_tier_label": "Individual",
"pricing_unit": "flat",
"pricing_unit_label": "flat monthly",
"comparable_provider_count": 8,
"reliability": "medium",
"median": 39,
"p25": 14.5,
"p75": 49,
"status": "ok"
},
{
"provider_type": "mcp",
"provider_type_label": "MCP servers",
"buyer_tier": "pro",
"buyer_tier_label": "Pro",
"pricing_unit": "flat",
"pricing_unit_label": "flat monthly",
"comparable_provider_count": 6,
"reliability": "medium",
"median": 24.25,
"p25": 19.25,
"p75": 28.88,
"status": "ok"
},
{
"provider_type": "mcp",
"provider_type_label": "MCP servers",
"buyer_tier": "individual",
"buyer_tier_label": "Individual",
"pricing_unit": "flat",
"pricing_unit_label": "flat monthly",
"comparable_provider_count": 5,
"reliability": "medium",
"median": 10,
"p25": 7.98,
"p75": 10,
"status": "ok"
},
{
"provider_type": "mcp",
"provider_type_label": "MCP servers",
"buyer_tier": "team_sme",
"buyer_tier_label": "Team / SME",
"pricing_unit": "flat",
"pricing_unit_label": "flat monthly",
"comparable_provider_count": 4,
"reliability": "low",
"median": 76.5,
"p25": null,
"p75": null,
"status": "median_only"
},
{
"provider_type": "mcp",
"provider_type_label": "MCP servers",
"buyer_tier": "enterprise",
"buyer_tier_label": "Enterprise",
"pricing_unit": "flat",
"pricing_unit_label": "flat monthly",
"comparable_provider_count": 2,
"reliability": "low",
"median": null,
"p25": null,
"p75": null,
"status": "observed_offers_only",
"observed_offers": [
399,
499
]
}
],
"warnings": [],
"full_pricing_via": {
"tool": "price_benchmark",
"arguments": {
"niche": "agent-observability-eval"
},
"note": "add provider_type + buyer_tier for a specific cohort"
}
},
"page_url": "https://agentery.com/market/agent-observability-eval",
"counts": {
"listings_with_price_capture": 178,
"listings_with_observed_public_price": 71,
"providers_with_numeric_monthly_price_latest_scan": 45,
"like_for_like_comparable_pairs": 43
},
"movement": {
"d": {
"published": true,
"value_pct": -1.1,
"driver": "llm_abacus's \"ChatGPT Go\" $8→$4.17 (-48%)"
},
"w": {
"published": true,
"value_pct": -1.1,
"driver": "llm_abacus's \"ChatGPT Go\" $8→$4.17 (-48%)"
},
"m": {
"published": false,
"value_pct": null,
"held_reason": null
}
},
"pricing_version": "cohorts-1",
"pricing_status": "ok",
"pricing_by_tier": [
{
"tier": "individual",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 14.5,
"provider_count": 13,
"plan_observation_count": 15,
"data_confidence": 0.95,
"data_confidence_basis": {
"provider_component": 1,
"observation_component": 0.75,
"provider_count": 13,
"plan_observation_count": 15
},
"reliability": "high",
"members": [
{
"provider": "llm_abacus",
"usd": 4.17
},
{
"provider": "watchfor",
"usd": 7.98
},
{
"provider": "clawmetry",
"usd": 9
},
{
"provider": "mcp_judge",
"usd": 10
},
{
"provider": "my_first_mcp",
"usd": 10
},
{
"provider": "ai_gateway",
"usd": 10
},
{
"provider": "swe_agent_arena",
"usd": 14.5
},
{
"provider": "ml_intern",
"usd": 14.5
},
{
"provider": "retrace",
"usd": 29
},
{
"provider": "agentwatch_2",
"usd": 49
},
{
"provider": "agnost_ai",
"usd": 49
},
{
"provider": "kalytera",
"usd": 49
},
{
"provider": "oversai",
"usd": 499
}
],
"p25": 10,
"p75": 49
},
{
"tier": "pro",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 50,
"provider_count": 23,
"plan_observation_count": 27,
"data_confidence": 1,
"data_confidence_basis": {
"provider_component": 1,
"observation_component": 1,
"provider_count": 23,
"plan_observation_count": 27
},
"reliability": "high",
"members": [
{
"provider": "operations",
"usd": 15
},
{
"provider": "aapanel_ai_assistant",
"usd": 16.5
},
{
"provider": "clawmetry",
"usd": 19
},
{
"provider": "monitor",
"usd": 19
},
{
"provider": "goodeye",
"usd": 20
},
{
"provider": "telemetry",
"usd": 25
},
{
"provider": "agentsproof",
"usd": 26.59
},
{
"provider": "watchfor",
"usd": 28.5
},
{
"provider": "toolrank",
"usd": 29
},
{
"provider": "agenta",
"usd": 29
},
{
"provider": "agentops",
"usd": 40
},
{
"provider": "swe_agent_arena",
"usd": 50
},
{
"provider": "arize_agent_observability",
"usd": 50
},
{
"provider": "livekit_agent_observability",
"usd": 50
},
{
"provider": "ml_intern",
"usd": 50
},
{
"provider": "voker",
"usd": 80
},
{
"provider": "agentcat",
"usd": 90
},
{
"provider": "retrace",
"usd": 99
},
{
"provider": "llm_abacus",
"usd": 100
},
{
"provider": "honeycomb_canvas",
"usd": 150
},
{
"provider": "litefuse",
"usd": 199
},
{
"provider": "agnost_ai",
"usd": 499
},
{
"provider": "oversai",
"usd": 1749.5
}
],
"p25": 25.8,
"p75": 94.5
},
{
"tier": "team_sme",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 224.5,
"provider_count": 20,
"plan_observation_count": 24,
"data_confidence": 1,
"data_confidence_basis": {
"provider_component": 1,
"observation_component": 1,
"provider_count": 20,
"plan_observation_count": 24
},
"reliability": "high",
"members": [
{
"provider": "agnys",
"usd": 49
},
{
"provider": "watchfor",
"usd": 55.86
},
{
"provider": "monitor",
"usd": 74
},
{
"provider": "operations",
"usd": 79
},
{
"provider": "toolrank",
"usd": 99
},
{
"provider": "telemetry",
"usd": 100
},
{
"provider": "kalytera",
"usd": 149
},
{
"provider": "parea_ai",
"usd": 150
},
{
"provider": "agentcat",
"usd": 160
},
{
"provider": "respan_gateway",
"usd": 199
},
{
"provider": "agentell",
"usd": 250
},
{
"provider": "agenta",
"usd": 299
},
{
"provider": "litefuse",
"usd": 300
},
{
"provider": "failproof_ai",
"usd": 349
},
{
"provider": "agentwatch_2",
"usd": 399
},
{
"provider": "retrace",
"usd": 399
},
{
"provider": "voker",
"usd": 400
},
{
"provider": "mirrors",
"usd": 499
},
{
"provider": "livekit_agent_observability",
"usd": 500
},
{
"provider": "oversai",
"usd": 1499
}
],
"p25": 99.75,
"p75": 399
},
{
"tier": "team_sme",
"currency": "USD",
"period": "month",
"unit": "per_seat",
"median": 38,
"provider_count": 3,
"plan_observation_count": 3,
"data_confidence": 0.23,
"data_confidence_basis": {
"provider_component": 0.25,
"observation_component": 0.15,
"provider_count": 3,
"plan_observation_count": 3
},
"reliability": "low",
"members": [
{
"provider": "langwatch",
"usd": 33.06
},
{
"provider": "mcpjam",
"usd": 38
},
{
"provider": "runtime",
"usd": 99
}
]
},
{
"tier": "enterprise",
"currency": "USD",
"period": "month",
"unit": "flat",
"median": 499,
"provider_count": 3,
"plan_observation_count": 3,
"data_confidence": 0.23,
"data_confidence_basis": {
"provider_component": 0.25,
"observation_component": 0.15,
"provider_count": 3,
"plan_observation_count": 3
},
"reliability": "low",
"members": [
{
"provider": "operations",
"usd": 399
},
{
"provider": "toolrank",
"usd": 499
},
{
"provider": "cekura",
"usd": 500
}
]
}
],
"pricing_coverage": {
"listings_with_price_capture": 178,
"listings_with_observed_public_price": 71,
"normalized_observations": 73,
"comparable_providers": 39,
"strict_cohorts": 5,
"exclusion_reasons": {
"free_or_zero": 7,
"ambiguous_cadence": 36,
"usage_not_monthly": 34,
"one_time": 13,
"unrankable_or_unparseable": 3
}
},
"pricing_note": "Provider-deduped, FX-normalized monthly medians, separated by buyer tier AND billing unit (flat/per_seat/per_user/per_agent) — incompatible units are never blended. Ranges (p25/p75) only at >=5 providers; data_confidence is provider-count-weighted. Usage-metered, promo, range, one-time and ambiguous-cadence plans are excluded.",
"pricing_excluded_observations": {
"free_or_zero": 7,
"ambiguous_cadence": 36,
"usage_not_monthly": 34,
"one_time": 13,
"unrankable_or_unparseable": 3
},
"billing_mix": {
"free": 17,
"freemium": 40,
"subscription": 5,
"one-time": 3,
"usage": 4,
"contact_sales": 2
},
"free_tier_share": 0.8,
"top_providers": [
{
"agent_id": "agentevals_via_github",
"name": "Agentevals Via Github",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public pricing for agentevals is shown in the supplied repository content."
},
"observed": false
},
{
"agent_id": "agentops",
"name": "AgentOps",
"price": {
"observed": true,
"billing": "freemium",
"lowest_monthly_usd": 40,
"monthly_usd": 40,
"headline": "Free tier, then from $40/mo",
"summary": "Free tier, then from $40/mo. AgentOps offers a free tier up to 5,000 events, Pro starting at $40/month with unlimited events, and custom Enterprise pricing."
},
"observed": true
},
{
"agent_id": "cekura",
"name": "Cekura",
"price": {
"observed": true,
"billing": "usage",
"lowest_monthly_usd": 500,
"monthly_usd": 500,
"headline": "From $500/mo",
"summary": "From $500/mo. Cekura offers pay-as-you-go usage pricing, a $500/month Startup plan, and custom Enterprise pricing, with usage rates starting at $0.25 per minute."
},
"observed": true
},
{
"agent_id": "ceq",
"name": "CouchLoop EQ",
"price": {
"observed": false,
"billing": "not_found",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public price found on the vendor site."
},
"observed": false
},
{
"agent_id": "clawbench",
"name": "Clawbench",
"price": {
"observed": true,
"billing": "usage",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "Paid (price not published)",
"summary": "The homepage reports model-specific usage rates ranging from $0.0000 to $4.4425 per task."
},
"observed": true
}
],
"suggested_next_calls": [
{
"tool": "price_benchmark",
"arguments": {
"niche": "agent-observability-eval"
},
"purpose": "full observed price distribution + per-tier medians for this niche"
},
{
"tool": "niche_report",
"arguments": {
"niche": "agent-observability-eval",
"response_mode": "full"
},
"purpose": "the complete report incl. index series and tier decomposition"
},
{
"tool": "suggest_alternatives",
"arguments": {
"agent_id": "agentevals_via_github"
},
"purpose": "comparable (optionally cheaper) providers to a named agent"
},
{
"tool": "get_agent_profile",
"arguments": {
"agent_id": "agentevals_via_github"
},
"purpose": "full profile, integrations and pricing for one provider"
}
]
}
}Full market
65 providers, one sortable view
Dense enough for many listings; progressive disclosure keeps mobile usable.
ProviderTypeFromVs niche medianLiveness
AgentOpsmonitors, traces, debugs, and tracks costs of AI agents and LLM apps in production (observability)
Cekuratests, monitors, and helps improve voice and chat AI agents through pre-production simulation and production observability
ia-qa.com/mcp llm and RAG testing - Dev/QA toolboxProvides 147+ QA, testing, and developer tools (prompt injection scan, hallucination check, semantic eval, RAG testing, agent trajectory validation, guardrails…
Langsmithprovides observability for AI agents and LLM applications via tracing, monitoring, and automated insights to debug failures and track cost/latency
Langwatchtests, evaluates, simulates, and monitors AI agents and LLM applications to prevent regressions and ensure reliability
Openai AgentsInstruments OpenAI Agents to capture traces, monitor agent execution, LLM calls, and tool usage for observability and evaluations
OperationsProvides structured methodology for AI agents to produce reliable deliverables through task classification, intelligent routing, quality gates, and proven fram…
Parea Aiexperiment tracking, evaluation, observability, and human annotation for LLM applications
QueueSimruns discrete event queueing simulations inside AI conversations
DeepOpinionRoutes LLM API traffic through a gateway, observes/traces calls, monitors usage and spend, and runs evaluations on LLM outputs
RuntimeProvides sandboxed coding agents (harnesses, orchestration, observability, guardrails) that teams can deploy to run investigations, ship PRs, draft replies, bu…
Toolrankscores and optimizes MCP tool definitions for AI agent discovery
Vokerprovides analytics for AI agents by classifying user intents, tracking agent performance, and correlating conversational data with business outcomes
Agent Observabilityprovides observability, tracing, and evaluation for AI agents and multi-agent systems
Eralabs Ai Oraora.ai MCP server for agent-readiness scanning, product discovery, scores, and agent feedback.
Goodeyeprovides reusable AI workflow templates with verifiers that score agents against measurable outcomes
Agent Observabilityprovides observability for voice AI agents in production, offering traces, logs, metrics, and session insights
Llm AbacusMCP server (no description provided).
MonitorKnow when your n8n workflows, URLs, and AI apps break, before your customers do
Agentic Platformbuilds, deploys, and manages custom AI agents for observability that automate operational tasks, incident investigation and remediation
Notion AI Hubreads Claude Code and Codex agent coding sessions and generates session reports highlighting what to keep, fix, or review
Watchfor**WatchFor** — uptime & infrastructure monitoring for AI agents. Check what's down, diagnose incidents, and manage monitors for websites, APIs, SSL certificate…Showing only providers with a published price or a free plan. $29 = lowest observed monthly · Free = free to use · Free tier = free plan + paid options.