Market around evalpair

An open-source CLI and MCP server for running LLM evaluation suites, caching model calls, and comparing paired runs with statistical intervals and noise-floor analysis.

Visit github.com ↗

Explore the market

Prices and medians update for the tier you select.

Compare at

evalpair · Pro

No Pro plan

—

Pro-provider median

—

insufficient comparable pricing

vs Pro providers

No comparison

evalpair doesn't sell Pro

ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.

Market density

23rd pctile

26 competing vendors

Comparable listings · 30d

—

Platforms · Pro median

$79/mo

3 priced · —–— mid 50%

Price spectrum · Pro plans · 4 of 7 providers priced · log scale · $19 → $199/mo

MCP servers Platforms◻ shaded = middle 50% · line = median (all types)evalpair has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches evalpair's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther5Ranked by similarity