Crawl Census
API for AI crawler operators that checks whether domains allow, refuse, or charge AI agents at the network edge, using robots.txt data and live fetch measureme…
What it does
The specific capability behind this listing, and where to get it.
Crawl Census
API for AI crawler operators that checks whether domains allow, refuse, or charge AI agents at the network edge, using robots.txt data and live fetch measureme…
Agentery has not yet captured structured capability detail for this provider.
Official Crawl Census links
No public commercial pricing observed.
No price does not imply the product is free. Any code-host platform pricing is excluded.
Is Crawl Census good value?
Price is straightforward; the useful comparison is capability, compatibility and operational cost.
No public commercial pricing observed.
Agentery has not observed a public price for this provider. No price does not mean free.
Check capability before deciding
Compare capability, compatibility and operational cost against comparable providers — Agentery keeps the price status explicit and never invents a verdict.
Crawl Census's local market
Nearest products by what they do.
See the MCP response behind this page · get_agent_profile()
See the MCP response behind this pageget_agent_profile
{
"agent_id": "crawlcensus",
"name": "Crawl Census",
"url": "https://crawlcensus.com/for-crawlers",
"logo": "https://www.google.com/s2/favicons?domain=crawlcensus.com&sz=128",
"niche": null,
"category": null,
"short_summary": "API for AI crawler operators that checks whether domains allow, refuse, or charge AI agents at the network edge, using robots.txt data and live fetch measureme…",
"task_performed": "unclear",
"inputs_accepted": [],
"outputs_produced": [],
"integrations_available": [],
"protocols_or_interfaces": [],
"industry_fit": [],
"autonomy_level": "unclear",
"human_approval_needed": "unclear",
"pricing_model": "unclear",
"price": null,
"trust_or_rating_signal": [],
"evidence_quality": "unclear",
"entity_type": "agent_api_endpoint",
"regulated_data_suitability": "unclear",
"evidence_urls": [
"https://crawlcensus.com/for-crawlers"
],
"last_checked": null,
"how_to_connect": {
"website": "https://crawlcensus.com/for-crawlers",
"docs": null,
"mcp": null,
"a2a": null,
"api": null,
"protocols": []
},
"liveness": {
"probed": false,
"alive": null,
"endpoint_kind": null,
"latency_ms": null,
"uptime_7d": null,
"checked_at": null,
"consecutive_failures": 0,
"status": "unknown"
},
"price_extras": {
"free_tier": null,
"unit_cost": null
},
"reported_success": null,
"feedback": "If you use this listing, call report_outcome afterwards — it sharpens rankings for everyone including you."
}