agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around repeatability-evals

An open-source Python toolkit for evaluating consistency and drift in LLM generation, agentic retrieval, RAG systems, and agent workflows without requiring labeled data.

Visit github.com ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
repeatability-evals · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
repeatability-evals doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
20th pctile
21 competing vendors
Comparable listings · 30d
—
Price spectrum · Pro plans · 2 of 3 providers priced · log scale · $19 → $40/mo
APIs Platforms◻ shaded = middle 50% · line = median (all types)repeatability-evals has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches repeatability-evals's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther3Ranked by similarity
repeatability-evalsthis listing
● OTHER
no public price
tool-eval-bench
● OTHER76% similar
no public price
Tool Evidence Guard
● OTHER71% similar
no public price
FFrameworks8Ranked by similarity
Deepeval
● FRAMEWORK74% similar
no public price
AgentFork
● FRAMEWORK74% similar
no public price
Openjudge
● FRAMEWORK72% similar
no public price
EV
EvoAgentX
● FRAMEWORK72% similar
no public price
Langwatch
● FRAMEWORK72% similar
no Pro plan
entry $32/mo
paired-eval
● FRAMEWORK71% similar
no public price
Agent Chaos Engineering
● FRAMEWORK70% similar
no public price
Guardrails AI
● FRAMEWORK70% similar
no public price
PPlatforms1Ranked by similarity
VA
Vasari
● PLATFORM72% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.