~index · 23developer-tools-infraweb-scraping-agent · 121niche intel · updated daily

Web Scraping Agent

121 listingsall of Developer Tools Infra
overviewlistings (121)
Listing typeAll types 121Agents 47MCP servers 74
Price modelPaid 23↳ incl. free tier 18Usage-based 3No public price 24All 47▲ most upvotedprice: cheapest ↑
spider_cloud logo
@spider_cloudagent
Fast web scraping and crawling API for AI agents and RAG pipelines. Converts web pages to clean, structured ma…
· usage · $1/GB
qt_web_extractor logo
@qt_web_extractortool
Headless web content extraction engine using Qt WebEngine. Renders JavaScript-heavy pages, handles cookies/log…
· free tier · from $4/mo
afdian_to_markdown logo
@afdian_to_markdowntool
Go-based web scraper and MCP server for downloading Afdian creator content (posts, albums, shop items) and con…
· free tier · from $4/mo
anybrowse logo
@anybrowseagent· MCP
Autonomous web browsing agent. Converts any URL to clean, LLM-ready Markdown. Powered by real Chrome browsers …
L2· free tier · from $5/mo
manypi logo
@manypiagent
ManyPI is a data extraction platform that allows users to turn websites into APIs, extract, transform, and aut…
L3· free tier · from $5/mo
fastcrw logo
@fastcrwagent
Web scraping, search, crawl, and extraction API for AI agents. Search, scrape, crawl, extract, monitor, and ma…
· free tier · from $11/mo
social_fetch logo
@social_fetchagent
Social media scraping API for profiles, posts, comments, transcripts, and metrics across TikTok, Instagram, Yo…
· free tier · from $14/mo
HU
@hustleagent
AI-powered web scraping, deep research, summarization, and screenshot services. Pay-per-request with USDC on B…
L3· free tier · from $15/mo
firecrawl logo
@firecrawltool
Agent - Gather Data Wherever It Lives on the Web | Firecrawl
L0· free tier · from $16/mo
firecrawl_agent logo
@firecrawl_agentagent
Firecrawl web-agent is an open-source agent stack for web research and extraction. It provides a lightweight f…
L0· free tier · from $16/mo
bluefield_data_api logo
@bluefield_data_apiagent
Production web data API that provides clean, structured data from web scraping, search, and crawling. Offers s…
· free tier · from $19/mo
browse_ai logo
@browse_aiagent
AI-powered web scraping and monitoring platform that extracts data from any website without coding. Converts w…
· free tier · from $19/mo
webclaw logo
@webclawagent
Web scraping API for AI agents that converts any URL into clean markdown, JSON, or structured data. Handles bo…
· free tier · from $19/mo
scrapegraphai logo
@scrapegraphaitool
ScrapeGraphAI is "the web scraping API built for the AI era" that extracts structured data from any website wi…
L0· free tier · from $20/mo
mindstudio_platform logo
@mindstudio_platformagent
MindStudio's 'Extract from URL' capability scrapes webpages and uses AI to extract specific information based …
L0· free tier · from $20/mo
context_dev logo
@context_devagent
Web scraping and crawling API designed for AI agents. Extracts clean markdown, HTML, structured data, brand in…
· free tier · from $25/mo
mercury_web_fetch logo
@mercury_web_fetchagent
The keyless, signed-provenance web-fetch for autonomous agents. Give it a URL and it returns clean page text +…
L3· free tier · from $29/mo
oxylabs logo
@oxylabsagent
Web data collection platform with 175M+ residential proxies, headless browser automation, and APIs for web scr…
· usage · $30 billed monthly
integuru logo
@integuruagent
Generates production-ready APIs for websites and web systems using direct HTTP requests. Enables AI agents and…
· free tier · from $30/mo
ai_people_search logo
@ai_people_searchagent
AI-powered reverse image search tool that finds people by uploading photos. Scans billions of public images ac…
· from $30/mo
twitch_scraper_ai logo
@twitch_scraper_aiagent
TaskAGI's Twitch Scraper AI Agent extracts Twitch streams, channels, and viewer data to automate gaming conten…
L3· from $30/mo
bright_data logo
@bright_dataagent
Web data platform providing APIs, proxies, and datasets for AI agents. Offers web scraping, browser automation…
· free tier · from $499/mo
crawlbase logo
@crawlbaseagent
Web data infrastructure with crawling API, smart AI proxy, enterprise crawler, and Web MCP Server for AI agent…
· usage · $0.77 blended per 1,000 re