agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around CrawlerPeek

CLI, library, GitHub Action, and MCP server that checks whether AI crawlers can access site URLs, evaluates robots.txt rules and bot responses, detects block pages, and generates robots.txt files.

Visit github.com ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
CrawlerPeek · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
CrawlerPeek doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
69th pctile
304 competing vendors
Comparable listings · 30d
—
MCP servers · Pro median
$29/mo
9 priced · $21.66–$32.21 mid 50%
Price spectrum · Pro plans · 11 of 18 providers priced · log scale · $9 → $490/mo
MCP servers Platforms◻ shaded = middle 50% · line = median (all types)CrawlerPeek has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches CrawlerPeek's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther4Ranked by similarity
CrawlerPeekthis listing
● OTHER
no public price
Centinel Agent Trust
● OTHER86% similar
no public price
IDAEO
● OTHER78% similar
no Pro plan
entry $20/mo
Botscent
● OTHER77% similar
no public price
MMCP servers36Ranked by similarity
Siteiz
● MCP89% similar
$490/mo Pro
+1590% vs Pro median
RO
Robotsgate
● MCP88% similar
$9/mo Pro
-69% vs Pro median
AI
Ai Crawler Readiness
● MCP88% similar
$19/mo Pro
-34% vs Pro median
Therankingfactory Site Check
● MCP80% similar
no Pro plan
entry $49/mo
GEO Tool MCP Server
● MCP80% similar
no public price
Registry402
● MCP80% similar
no public price
Agent Ready Kit
● MCP80% similar
$99 one-time Pro
not monthly-comparable
Crawl Readiness MCP Server
● MCP79% similar
$29/mo Pro
0% vs Pro median
Crawl Census Client
● MCP79% similar
no public price
CitedBy MCP
● MCP79% similar
no public price
AI Visibility MCP
● MCP79% similar
no public price
Agentbuilt MCP
● MCP79% similar
no public price
Indexlinks
● MCP79% similar
no Pro plan
entry $49/mo
CitedBy
● MCP79% similar
$49/mo Pro
+69% vs Pro median
Unrendered
● MCP79% similar
no public price
GEO Optimizer MCP
● MCP78% similar
no public price
TrustSource
● MCP78% similar
no public price
SI
Site Scorer
● MCP78% similar
no public price
Cuescout
● MCP78% similar
$59 one-time Pro
not monthly-comparable
SAG RANK MCP
● MCP78% similar
no public price
Q Y0oi Ai Visibility
● MCP77% similar
no public price
Answer Checkup
● MCP77% similar
no public price
Ai Crawler Claims
● MCP77% similar
no public price
Frankensurf
● MCP77% similar
no public price
Blockquote
● MCP77% similar
$12/mo Pro
-59% vs Pro median
polite-crawler
● MCP77% similar
no public price
Crawlbase
● MCP76% similar
no Pro plan
entry $99/mo
Auth Your Agent
● MCP76% similar
no public price
Web Scraper API
● MCP76% similar
$29/mo Pro
0% vs Pro median
Crawlbrulee MCP
● MCP76% similar
no public price
Seo Records
● MCP76% similar
$28.25/mo Pro
-3% vs Pro median
Crawlie
● MCP76% similar
$27/mo Pro
-7% vs Pro median
CrawlEngine MCP
● MCP75% similar
no public price
MC
Mccauleyloren56 Agent
● MCP75% similar
no public price
X1 Baas
● MCP75% similar
no public price
HiveCrawl
● MCP75% similar
no public price
PPlatforms2Ranked by similarity
AI Web Signals
● PLATFORM83% similar
$49/mo Pro
Faro
● PLATFORM76% similar
$9/mo Pro
AAPIs6Ranked by similarity
AI Crawler Index
● API81% similar
no public price
Citewren by CyberMax
● API79% similar
no Pro plan
entry $8/mo
AI Agent Trust Management
● API79% similar
no public price
Crawl Census
● API78% similar
no public price
AgentReady x402
● API77% similar
no public price
PublicParse AI-readiness audit
● API76% similar
no public price
AAgents2Ranked by similarity
Agent Disco
● AGENT80% similar
no public price
BotVisibility
● AGENT77% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.