agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around Crawl Census

API for AI crawler operators that checks whether domains allow, refuse, or charge AI agents at the network edge, using robots.txt data and live fetch measurements.

Visit crawlcensus.com

Explore the market

Prices and medians update for the tier you select.

Compare at
Crawl Census · Pro
No Pro plan
Pro-provider median
insufficient comparable pricing
vs Pro providers
No comparison
Crawl Census doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
19th pctile
12 strong substitutes
Price momentum · 31d
-33.6%
MCP servers · Pro median
$49/mo
7 priced · $39–$56 mid 50%
APIs · Pro median
$53/mo
2 priced · $50–$56 mid 50%
Platforms · Pro median
$19/mo
1 priced · $19–$19 mid 50%
Price spectrum · Pro plans · 9 of 17 providers priced · log scale · $19$79/mo
MCP servers APIs Platforms◻ shaded = middle 50% · line = median (all types)Crawl Census has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches Crawl Census's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther6Ranked by relevance
Crawl Censusthis listing
OTHER · relevance 100%
no public price
Crawl Census Client
OTHER · relevance 87%
no public price
centinel_agent_trust
OTHER · relevance 79%
no public price
clawbench
OTHER · relevance 67%
no public price
Bristlecone Logic
OTHER · relevance 65%
no public price
ai_vendor_risk_assessment
OTHER · relevance 64%
no public price
AAPIs6Ranked by relevance
AI Agent Trust Management
API · relevance 73%
no public price
dnsskills
API · relevance 69%
no public price
fastcrw
API · relevance 67%
$59/mo Pro
+11% vs Pro median
broke2built Data & Intelligence Skills
API · relevance 66%
no public price
HI
hivegate
API · relevance 65%
no Pro plan
entry $10/mo
omniroute
API · relevance 65%
no public price
MMCP servers30Ranked by relevance
MC
mccauleyloren56_agent_prefligh
MCP · relevance 73%
no public price
URL security scanner to protect AI agent workflows.
MCP · relevance 70%
$49/mo Pro
0% vs Pro median
just_domain
MCP · relevance 69%
no public price
BR
breeze-mcp
MCP · relevance 69%
no public price
Name Brewery Domain Checker
MCP · relevance 69%
$19/mo Pro
-61% vs Pro median
agent_ready_kit
MCP · relevance 68%
$99 one-time Pro
not monthly-comparable
URL Scanner Online by Aprensec — URL & Domain Security Scanner
MCP · relevance 68%
no public price
web_intelligence
MCP · relevance 68%
no public price
CLIRank - API directory for AI agents
MCP · relevance 68%
no public price
Instant Domain Search
MCP · relevance 67%
no public price
dechonet
MCP · relevance 67%
no public price
agentready
MCP · relevance 67%
$49/mo Pro
0% vs Pro median
citerank
MCP · relevance 67%
$79/mo Pro
+61% vs Pro median
DI
discoveryagent
MCP · relevance 66%
no Pro plan
entry $10/mo
0mod_mcp_server
MCP · relevance 66%
no public price
RAIL Score MCP Server
MCP · relevance 66%
no public price
AEO Scanner
MCP · relevance 66%
no public price
WebVector
MCP · relevance 66%
no public price
MCP Security Scanner Server
MCP · relevance 66%
no public price
crawlbase
MCP · relevance 65%
no Pro plan
entry $99/mo
crawlie_cloud
MCP · relevance 65%
$29/mo Pro
-41% vs Pro median
foura_mcp
MCP · relevance 65%
$62/mo Pro
+27% vs Pro median
Tickerr Live Status
MCP · relevance 65%
no public price
string_ai_web_access
MCP · relevance 65%
no public price
compliapi
MCP · relevance 65%
no Pro plan
entry $149/mo
bassethound
MCP · relevance 65%
$49.99/mo Pro
+2% vs Pro median
SMESH Crawler
MCP · relevance 65%
no public price
BotHub - The Trust Layer for AI Agents
MCP · relevance 64%
no public price
SI
Site Scorer
MCP · relevance 64%
no Pro plan
entry $10/mo
anishdasmail_groundtruth
MCP · relevance 64%
no public price
AAgents3Ranked by relevance
Agent Disco
AGENT · relevance 73%
no public price
spekto
AGENT · relevance 68%
no public price
CrawlBit
AGENT · relevance 68%
no Pro plan
entry $390/mo
PPlatforms5Ranked by relevance
Agentic Evaluation Platform
PLATFORM · relevance 67%
no public price
agentery
PLATFORM · relevance 66%
no public price
agentwatch_2
PLATFORM · relevance 65%
no Pro plan
entry $49/mo
AgentReady
PLATFORM · relevance 65%
$19/mo Pro
Lunar
PLATFORM · relevance 65%
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.