Agentery pricing intelligence · Provider profile · Agentevals Via Github
Provider profile · independently tracked by Agentery
Agentevals Via Github
evaluates and scores AI agent behavior and performance from OpenTelemetry traces, benchmarking agents before production
Agentery price verdictNo pricing observedsource repository
SourcePublic repositorylicence not verified
Billing model—
Last checked28 Jul 2026pricing & liveness
What it does
The specific capability behind this listing, and where to get it.
Agentevals Via Github
evaluates and scores AI agent behavior and performance from OpenTelemetry traces, benchmarking agents before production
OpenTelemetry traces (Jaeger JSON and native OTLP trace formats), eval sets, agent trace files → evaluation scores, pass/fail status, metric reports (CLI output, JSON), visual trace inspection in Web UI
LangChainStrandsGoogle ADKOpenAI Agents SDKOpenAI Eval APIMCPOpenTelemetry/OTLPJaegerSDKAPIMCP
Official Agentevals Via Github links
Price status · observed daily
Source repository available · no commercial pricing observed.
No price does not imply the product is free. Any code-host platform pricing is excluded.
Is Agentevals Via Github good value?
Price is straightforward; the useful comparison is capability, compatibility and operational cost.
Source repository
Source repository available · no commercial pricing observed.
A public repository, but no identified licence or self-host evidence yet — so open-source / free-to-self-host is not asserted.
Observed commercial pricenone
NicheAgent Observability Eval
Price benchmarknot applicable
What to compare instead
Check capability before deciding
Compare capability, compatibility and operational cost against comparable providers — Agentery keeps the price status explicit and never invents a verdict.
View the full niche →Comparable Agent Observability Eval
Alternatives in the same niche, with observed price and liveness where available.
Github Crystianskillmap Map Inagent observability eval
—No comparable commercial price observed
100% liveView profile →
Open Researchagent observability eval
—No comparable commercial price observed
100% liveView profile →
Agent Arenaagent observability eval
—No comparable commercial price observed
100% liveView profile →
Spotlightagent observability eval
—No comparable commercial price observed
100% liveView profile →
Newrelicagent observability eval
—No comparable commercial price observed
100% liveView profile →
Stellagent Commerceagent observability eval
—No comparable commercial price observed
100% liveView profile →
See the MCP response behind this page · get_agent_profile()
See the MCP response behind this pageget_agent_profile
{
"agent_id": "agentevals_via_github",
"name": "Agentevals Via Github",
"url": "https://github.com/agentevals-dev/agentevals",
"logo": "https://agentery.com/logos/CP-SRAQ7S-128.png",
"niche": "agent-observability-eval",
"category": "developer-tools-infra",
"short_summary": "evaluates and scores AI agent behavior and performance from OpenTelemetry traces, benchmarking agents before production",
"task_performed": "evaluates and scores AI agent behavior and performance from OpenTelemetry traces, benchmarking agents before production",
"inputs_accepted": [
"OpenTelemetry traces (Jaeger JSON and native OTLP trace formats)",
"eval sets",
"agent trace files"
],
"outputs_produced": [
"evaluation scores",
"pass/fail status",
"metric reports (CLI output",
"JSON)",
"visual trace inspection in Web UI"
],
"integrations_available": [
"LangChain",
"Strands",
"Google ADK",
"OpenAI Agents SDK",
"OpenAI Eval API",
"MCP",
"OpenTelemetry/OTLP",
"Jaeger",
"Kubernetes",
"Helm",
"Tempo",
"Discord",
"PyPI"
],
"protocols_or_interfaces": [
"SDK",
"API",
"MCP"
],
"industry_fit": [
"developer tools"
],
"autonomy_level": "unclear",
"human_approval_needed": "unclear",
"pricing_model": "free",
"price": {
"observed": false,
"billing": "not_found",
"currency": null,
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": null,
"summary": null,
"confidence": "high",
"source_url": "https://github.com/pricing",
"checked_at": "2026-07-26T05:12:30.256Z",
"amount": null,
"display": null,
"plans": [],
"source": "render+llm"
},
"trust_or_rating_signal": [
"136 GitHub stars",
"17 forks",
"Apache-2.0 license"
],
"evidence_quality": "high",
"entity_type": "tool",
"regulated_data_suitability": "unclear",
"evidence_urls": [
"https://github.com/agentevals-dev/agentevals",
"https://solo.io/press-releases/introducing-new-agentic-open-source-project-agentevals"
],
"last_checked": "2026-06-16",
"how_to_connect": {
"website": "https://github.com/agentevals-dev/agentevals",
"docs": "https://github.com/documentation",
"mcp": {
"endpoint": "https://github.com/mcp.json",
"transport": "http",
"config_snippet": "{\n \"mcpServers\": {\n \"agentevals_via_github\": {\n \"url\": \"https://github.com/mcp.json\"\n }\n }\n}"
},
"a2a": null,
"api": {
"docs_url": "https://github.com/developer",
"endpoint": null
},
"protocols": []
},
"liveness": {
"probed": true,
"alive": true,
"endpoint_kind": "site",
"latency_ms": 1221,
"uptime_7d": 1,
"checked_at": "2026-07-28T02:30:30.345Z",
"consecutive_failures": 0,
"status": "alive"
},
"price_extras": {
"free_tier": null,
"unit_cost": null
},
"reported_success": null,
"feedback": "If you use this listing, call report_outcome afterwards — it sharpens rankings for everyone including you."
}