Market around Agentprobe

pytest plugin for regression-testing AI agents. Captures agent outputs as snapshot baselines, compares with semantic similarity, and mocks LLMs for deterministic testing.

Visit github.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at

agentprobe · Pro

No Pro plan

—

Pro-provider median

—

insufficient comparable pricing

vs Pro providers

No comparison

agentprobe doesn't sell Pro

ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.

Market density

16th pctile

11 competing vendors

Comparable listings · 30d

—

Platforms · Pro median

$47/mo

4 priced · —–— mid 50%

Price spectrum · Pro plans · 5 of 7 providers priced · log scale · $19.99 → $99/mo

APIs Platforms◻ shaded = middle 50% · line = median (all types)agentprobe has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches agentprobe's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther3Ranked by similarity

Agentprobethis listing

FFrameworks5Ranked by similarity

Agentbench

● FRAMEWORK75% similar

no public price

paired-eval

● FRAMEWORK73% similar

no public price

Langwatch

● FRAMEWORK72% similar

no Pro plan

entry $32/mo

Agentspec

● FRAMEWORK71% similar

no public price

Understudy

● FRAMEWORK70% similar

no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.