Loading…
A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.
Our verdict: worth keeping an eye on
Curated index of LLM-friendly crawlers, MCP servers and extraction infrastructure. Better-targeted than the generic awesome-web-agents list for the scraping slot. Index only.
Filed under design inspiration in our directory.