~indexdeveloper-tools-infraagent-observability-eval · 155niche intel · updated daily

Agent Observability Eval

sparse·market pulse 59/100·enterprise money present · 112 new builders in 30d·155 listings·59 new in 7d
Prices · index
100.00— 0.0%
99.88100100.1307-0507-0807-1107-1407-162026-07-05 · 1002026-07-06 · 1002026-07-07 · 1002026-07-08 · 1002026-07-09 · 1002026-07-10 · 1002026-07-11 · 1002026-07-12 · 1002026-07-13 · 1002026-07-14 · 1002026-07-15 · 1002026-07-16 · 100

Price index for this niche · 100 = 5 Jul 2026. how it’s calculated →

Growth
155 listings▲ +59 this week
Agents
81
041812026-05-13 · 12026-05-14 · 52026-05-15 · 72026-05-16 · 132026-05-17 · 162026-05-19 · 232026-05-20 · 242026-05-24 · 322026-07-02 · 332026-07-03 · 352026-07-04 · 392026-07-05 · 402026-07-06 · 412026-07-07 · 422026-07-08 · 452026-07-09 · 522026-07-10 · 772026-07-12 · 792026-07-14 · 81
MCP servers
38
019382026-06-19 · 182026-06-30 · 232026-07-03 · 242026-07-07 · 252026-07-09 · 322026-07-10 · 38

Cumulative listings over time, split by what each listing IS — agents vs MCP servers.

Individual
0.0%tier price move · 7d
99.88100100.132026-07-05 · 1002026-07-06 · 1002026-07-07 · 1002026-07-08 · 1002026-07-09 · 1002026-07-10 · 1002026-07-11 · 1002026-07-12 · 1002026-07-13 · 1002026-07-14 · 1002026-07-15 · 1002026-07-16 · 100
median $2.25/mo · 51 priced
Pro
0.0%tier price move · 7d
99.88100100.132026-07-05 · 1002026-07-06 · 1002026-07-07 · 1002026-07-08 · 1002026-07-09 · 1002026-07-10 · 1002026-07-11 · 1002026-07-12 · 1002026-07-13 · 1002026-07-14 · 1002026-07-15 · 1002026-07-16 · 100
median $40/mo · 29 priced
Team & SME
0.0%tier price move · 7d
99.88100100.132026-07-05 · 1002026-07-06 · 1002026-07-07 · 1002026-07-08 · 1002026-07-09 · 1002026-07-10 · 1002026-07-11 · 1002026-07-12 · 1002026-07-13 · 1002026-07-14 · 1002026-07-15 · 1002026-07-16 · 100
median $150/mo · 20 priced
Enterprise
0.0%tier price move · 7d
99.88100100.132026-07-05 · 1002026-07-06 · 1002026-07-07 · 1002026-07-08 · 1002026-07-09 · 1002026-07-10 · 1002026-07-11 · 1002026-07-12 · 1002026-07-13 · 1002026-07-14 · 1002026-07-15 · 1002026-07-16 · 100
median $1,000/mo · 34 priced

Per buyer tier: the headline % is how that tier's own prices moved over the selected window (D/W/M above); the line below is its contribution to the niche's move(those contributions — not the headline moves — sum to the niche figure above). A thin tier (1–2 comparable agents) is shown and flagged, not hidden.

Last 7 days
Price changes here
0.0%Prices were stable across 31 comparable agents over the last 7 days.

When a listing starts or stops showing a public price, the niche average moves even though nobody actually repriced — that's why the headline figure above only counts real price changes.

Price ladder
What this niche charges

Median $/month per buyer level, with the typical range (middle half of observed prices), across 67 listings with observed public pricing — median cheapest paid entry $32/mo, 84% free/freemium entry.

Free$0
48 free
Individual$2.25/mo
42 pricestypical range $0.38$9.00
Pro$40/mo
26 pricestypical range $17$73
Team / SME$150/mo
17 pricestypical range $83$199
Enterprise$1,000/mo
4 pricestypical range $474$1,875
Billing mix
How this niche charges

Billing model across the 67 listings with observed public pricing.

Freemium
40 (60%)
Subscription
5 (7%)
Usage-based
3 (4%)
Free
16 (24%)
Contact sales
1 (1%)
One-time
2 (3%)
Try free
Try it free

Agents in this niche with a stated free-tier quota — zero-cost ways to feel out the space.

Players
Who's here

155 agents tracked in this niche — most upvoted first.

ctf_agent_benchmark logo
@ctf_agent_benchmark
Benchmarking platform for evaluating AI agents on CTF-style security challenges using MCP protocol. Agents autonomously solve tasks, manage environments, and submit flags.
free tier · from $4/mo· github project
skill_optimizer logo
@skill_optimizer
Benchmark, evaluate, and optimize agent skills across LLMs. Provides deterministic eval suites and Docker workbench for testing skill reliability.
free tier · from $4/mo· github project
openclaw_monitor logo
@openclaw_monitor
Real-time 3D dashboard for visualizing and monitoring OpenClaw AI agents. Each agent is represented as a continent with sessions as interactive minions; includes live chat, thinking bubbles, and physics-based world.
free tier · from $4/mo· github project
skillgrade logo
@skillgrade
An open-source CLI and web UI for evaluating agent skills. It runs AI-agent tasks against SKILL.md files, supports deterministic and LLM-based graders, and produces pass-rate reports for regression testing and CI.
free tier · from $4/mo· github project
makoto logo
@makoto
Integrity verification tool for Claude AI agents that monitors tool calls and blocks fake claims. Validates agent statements against actual execution records to ensure claimed actions were genuinely performed.
free tier · from $4/mo· agent framework
testing logo
@testing
Testing functionalities, likely part of a GitHub project or agent framework, providing tools and methods for evaluating the performance and reliability of AI agents.
free tier · from $4/mo· agent marketplace
hermescheck logo
@hermescheck
Architecture audit and health-check tool for AI agent runtimes, specifically Hermes Agent. Scans codebases for memory drift, tool boundaries, runtime sprawl, and failure modes; generates structured reports and PNG cards.
free tier · from $4/mo· github project
perfly_perfly_mcp logo
@perfly_perfly_mcp
Perfly Agent Sync is a hosted MCP server for sending approved coding-agent work summaries into perfly.dev. It is built for narrow, write-only ingestion: agents can preview and submit selected summary items, but they cannot read your Perfly history, reports, profile, billing, inte
free tier · from $6/mo· mcp server
clawmetry logo
@clawmetry
Real-time observability dashboard for AI agents. Monitor token costs, sub-agents, tool calls, memory, and session history. Open-source, works with OpenClaw, NemoClaw, and 12+ runtimes.
free tier · from $8/mo· agent framework
wakatime logo
@wakatime
WakaTime offers automatic time tracking for developers, integrating with code editors and delivering dashboards on coding activity, project progress, and productivity
free tier · from $9/mo· mcp server
deepresearch_bench logo
@deepresearch_bench
DeepResearch Bench, hosted on Hugging Face, the AI community building the future. Offers documentation and API documentation for AI research and development.
from $9/mo· research demo
swe_agent_arena logo
@swe_agent_arena
Comparative arena for CLI coding agents. Submit software tasks and repository URLs; two anonymous agents compete on the same codebase with viewable code changes and follow-up messaging.
from $9/mo· research demo

see all 155 in the index →

Nearby
Adjacent niches

Methodology. Prices are observed daily from vendor pricing pages (headless render + LLM extraction), normalised to monthly USD, and tagged with a confidence level. Figures are conservative — a price is never invented; agents whose pricing can't be verified are counted as unobserved. Agents can pull this same per-niche report programmatically via our MCP server's niche_report tool — see the docs. Last price scan: 2026-07-16 06:14 UTC · 4,921 captures today · liveness probe: 2026-07-16 14:30 UTC.