Llm Evaluation Agent
An MCP-based agent for evaluating LLMs, AI agents, and prompts through natural-language configuration, synthetic dataset generation, multi-judge scoring, docum…
What it does
The specific capability behind this listing, and where to get it.
Llm Evaluation Agent
An MCP-based agent for evaluating LLMs, AI agents, and prompts through natural-language configuration, synthetic dataset generation, multi-judge scoring, docum…
Agentery has not yet captured structured capability detail for this provider.
Official Llm Evaluation Agent links
No public commercial pricing observed.
No price does not imply the product is free. Any code-host platform pricing is excluded.
Is Llm Evaluation Agent good value?
Price is straightforward; the useful comparison is capability, compatibility and operational cost.
No public commercial pricing observed.
Agentery has not observed a public price for this provider. No price does not mean free.
Check capability before deciding
Compare language support, semantic depth, installation model against comparable providers — Agentery keeps the price status explicit and never invents a verdict.
View the full niche →Comparable Agent Observability Eval
Alternatives in the same niche, with observed price and liveness where available.
See the MCP response behind this page · get_agent_profile()
See the MCP response behind this pageget_agent_profile
{
"agent_id": "llm_evaluation_agent",
"name": "Llm Evaluation Agent",
"url": "https://startups.aws.com/prompt-library/llm-eval-agent",
"logo": "https://www.google.com/s2/favicons?domain=startups.aws.com&sz=128",
"niche": "agent-observability-eval",
"category": "developer-tools-infra",
"short_summary": "An MCP-based agent for evaluating LLMs, AI agents, and prompts through natural-language configuration, synthetic dataset generation, multi-judge scoring, docum…",
"task_performed": "unclear",
"inputs_accepted": [],
"outputs_produced": [],
"integrations_available": [],
"protocols_or_interfaces": [],
"industry_fit": [],
"autonomy_level": "unclear",
"human_approval_needed": "unclear",
"pricing_model": "unclear",
"price": {
"observed": false,
"billing": "not_found",
"currency": null,
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "No public price found",
"summary": "No public price found on the vendor site.",
"confidence": "high",
"source_url": "https://startups.aws.com/prompt-library/llm-eval-agent",
"checked_at": "2026-07-26T08:49:16.688Z",
"amount": null,
"display": null,
"plans": [],
"source": "render+llm"
},
"trust_or_rating_signal": [],
"evidence_quality": "unclear",
"entity_type": "mcp_server",
"regulated_data_suitability": "unclear",
"evidence_urls": [
"https://startups.aws.com/prompt-library/llm-eval-agent"
],
"last_checked": null,
"how_to_connect": {
"website": "https://startups.aws.com/prompt-library/llm-eval-agent",
"docs": null,
"mcp": null,
"a2a": null,
"api": null,
"protocols": []
},
"liveness": {
"probed": true,
"alive": true,
"endpoint_kind": "site",
"latency_ms": 567,
"uptime_7d": 1,
"checked_at": "2026-07-28T02:35:22.349Z",
"consecutive_failures": 0,
"status": "alive"
},
"price_extras": {
"free_tier": null,
"unit_cost": null
},
"reported_success": null,
"feedback": "If you use this listing, call report_outcome afterwards — it sharpens rankings for everyone including you."
}