h4ckf0r0day/awesome-ai-web-scraping
85 24CC0-1.0Updated 5 months ago
A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.
aiawesomeawesome-listllmscrapingweb-scraping
Our verdict: worth keeping an eye on
Curated index of LLM-friendly crawlers, MCP servers and extraction infrastructure. Better-targeted than the generic awesome-web-agents list for the scraping slot. Index only.
Filed under design inspiration in our directory.