API for AI crawler operators that checks whether domains allow, refuse, or charge AI agents at the network edge, using robots.txt data and live fetch measurements.
Prices and medians update for the tier you select.
Ranked by how closely each one matches Crawl Census's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.
Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.