Ai Crawler Readiness
Can AI assistants actually read a website? This server answers from the **Agent Web Index**: 45,000+ domains probed with real HTTP requests — once as a browser…
What it does
The specific capability behind this listing, and where to get it.
Can AI assistants actually read a website? This server answers from the **Agent Web Index**: 45,000+ domains probed with real HTTP requests — once as a browser, once as each published AI crawler user-agent (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot and others) — so it can tell apart what `robots.txt` says from what the server actually does. **Tools** - `domain_readiness` — readiness score, per-crawler verdict and the edge vendor answering for a host. - `web_readiness` — the aggregate state of the measured web. - `edge_blocking` — refusal rate per CDN/WAF vendor, over domain×crawler pairs robots.txt allows. - `measure_domain` — measures any domain on demand: six real requests made while you wait. No key, no signup. Dataset is CC BY 4.0. Most AI-crawler blocking is not in robots.txt — it is an edge default nobody chose, and this is the data that shows it.
Official Ai Crawler Readiness links
Pricing & plans
Observed public pricing for Ai Crawler Readiness, benchmarked against comparable providers. Plans, tiers, history and scenario below.
$13.40 /mo
This plan sits close to the comparable median.
No monthly-comparable cohort to benchmark this plan against yet.
Why Agentery reaches that view
price_benchmarkNot monthly-comparable.
get_provider_profile · plan historyPro observed 2026-11-02.
pricing recommendationPercentile unavailable for this basis.
confidenceSource page rechecked daily.
Test a different price for this plan.
Move the proposed monthly price. Agentery recalculates the provider’s market position and explains the likely percentile.
Is Ai Crawler Readiness good value?
How its price compares with genuinely comparable providers.
Not enough evidence yet to call it good — or poor — value.
Too few comparable providers at the same buyer tier and billing unit to benchmark this price honestly.
Check capability before deciding
Compare capability, compatibility and operational cost against the few observed peers — Agentery keeps the price status explicit and never invents a verdict.
Ai Crawler Readiness's local market
Nearest products by what they do — a different cohort from the buyer-tier benchmark above.
See the MCP response behind this page · get_provider_profile()
See the MCP response behind this pageget_provider_profile (get_agent_profile remains a callable alias)
{
"agent_id": "ai_crawler_readiness",
"name": "Ai Crawler Readiness",
"url": "https://shop.lumnika.com/ai-readiness/?src=smithery",
"logo": null,
"niche": null,
"category": null,
"short_summary": "Can AI assistants actually read a website? This server answers from the **Agent Web Index**: 45,000+ domains probed with real HTTP requests — once as a browser…",
"task_performed": "Can AI assistants actually read a website? This server answers from the **Agent Web Index**: 45,000+ domains probed with real HTTP requests — once as a browser, once as each published AI crawler user-agent (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot and others) — so it can tell apart what `robots.txt` says from what the server actually does.\n\n**Tools**\n- `domain_readiness` — readiness score, per-crawler verdict and the edge vendor answering for a host.\n- `web_readiness` — the aggregate state of the measured web.\n- `edge_blocking` — refusal rate per CDN/WAF vendor, over domain×crawler pairs robots.txt allows.\n- `measure_domain` — measures any domain on demand: six real requests made while you wait.\n\nNo key, no signup. Dataset is CC BY 4.0. Most AI-crawler blocking is not in robots.txt — it is an edge default nobody chose, and this is the data that shows it.",
"inputs_accepted": [],
"outputs_produced": [],
"integrations_available": [
"MCP"
],
"protocols_or_interfaces": [
"MCP"
],
"industry_fit": [
"general business"
],
"autonomy_level": "infrastructure",
"human_approval_needed": "unclear",
"pricing_model": "unclear",
"price": {
"observed": true,
"billing": "freemium",
"source_kind": "vendor",
"currency": "EUR",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "Free; One-time AI visibility report €9 (one-time)",
"commercial": {
"currency": "EUR",
"notes": [
"prices in EUR as published; USD figures are conversions at 2026-11-04"
],
"lines": [
{
"name": "Free",
"price": "Free",
"kind": "free",
"billed": "monthly"
},
{
"name": "One-time AI visibility report",
"price": "€9",
"kind": "one_off",
"billed": "one_off"
}
]
},
"summary": "Free; One-time AI visibility report €9 (one-time). Aivis offers a free plan and a €9 one-time report, while the listed Pro, Business, and Agency subscriptions are not yet open for purchase.",
"confidence": "high",
"source_url": "https://aivis.lumnika.com/en/pricing",
"checked_at": "2026-11-05T00:10:58.148Z",
"amount": null,
"display": null,
"plans": [
{
"name": "Free",
"price": "Free",
"period": null,
"persona": "free",
"highlights": [
"1 site",
"On-demand scans with a shareable public report",
"3 tracked prompts across 1 AI engine"
],
"promo_note": null,
"price_promo": null,
"price_annual": null
},
{
"name": "One-time AI visibility report",
"price": "€9",
"period": "one-time",
"persona": "individual",
"highlights": [
"Complete AI visibility report for one domain as a PDF",
"Fix bundle included",
"No subscription or account required"
],
"promo_note": null,
"price_promo": null,
"price_annual": null
}
],
"source": "render+llm"
},
"trust_or_rating_signal": [],
"evidence_quality": "medium",
"entity_type": "infrastructure",
"regulated_data_suitability": "unclear",
"evidence_urls": [
"https://shop.lumnika.com/ai-readiness/?src=smithery"
],
"last_checked": "2026-11-05",
"profile_checked": "2026-09-20",
"price_checked": "2026-11-05",
"how_to_connect": {
"website": "https://shop.lumnika.com/ai-readiness/?src=smithery",
"docs": null,
"mcp": null,
"a2a": null,
"api": null,
"protocols": [
"MCP"
],
"install": null,
"repository": null,
"note": "Speaks MCP but publishes no endpoint we could verify — check the docs/website."
},
"deployment": {
"model": "unknown",
"both_offered": false,
"hosted_endpoint": null,
"install": null,
"note": "No deployment evidence held — Agentery has no endpoint, install instruction or directory attribute for this listing.",
"evidence": null
},
"licence": {
"name": null,
"note": "No named licence found in the retained page text or source attributes. A public repository alone does not establish an open-source licence.",
"evidence": null
},
"evidence_checks": {
"price": {
"source_url": "https://aivis.lumnika.com/en/pricing",
"last_observed_day": "2026-11-05",
"age_days": 1,
"verified_day": "2026-11-05",
"note": "verified = the page-text gate ran for that scan day (day-before/day-of text check)"
},
"agent_card": {
"status": "unknown",
"note": "no Agent Card URL recorded for this listing"
},
"endpoint": {
"status": "unknown",
"note": "endpoint not yet checked"
}
},
"price_applies_to": "price observed on aivis.lumnika.com, not on this listing's site (shop.lumnika.com) — likely the vendor platform, not this connector",
"price_reading": {
"status": "stale_pending",
"as_of": "2026-11-05",
"page_captured": "2026-11-05",
"reading_made_from_capture": null,
"reading_coverage": null,
"changed_since_reading_observed": "2026-11-04",
"summary": "The pricing page changed by 2026-11-04 after this price was read; a re-read is pending. The price shown may be out of date.",
"last_valid_observation": "2026-11-05",
"review_status": "not_reviewed"
},
"product_group": {
"group_id": 33,
"group": "Website audit and optimization tools",
"change_90d_pct": -0.64,
"fair_price_by_tier_monthly_usd": {
"individual": 22.46,
"pro": 37,
"team / small business": 101.13,
"enterprise": 499.5
},
"note": "Change of the group's price index over the last 90 days. Call get_group_fair_price with group_id for tier and payment-model detail.",
"page": "https://agentery.com/aepi/groups/33"
},
"liveness": {
"probed": true,
"alive": true,
"endpoint_kind": "site",
"latency_ms": 479,
"uptime_7d": 1,
"checked_at": "2026-11-05T02:31:31.096Z",
"consecutive_failures": 0,
"status": "alive"
},
"price_extras": {
"free_tier": null,
"unit_cost": null
},
"reported_success": null,
"feedback": "If you actually use this provider, call report_outcome with the result. Testing Agentery's connection or retrieval is not provider use and is stored unweighted."
}