Skip to content

D4Vinci/Scrapling

73,290 7,310PythonBSD-3-ClauseUpdated 3 months ago
View on GitHub

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath

Project homepage

Our verdict: worth keeping an eye on

Tested 13 Oct 2026 (security CAUTION, learn-from only). Adaptive selectors were NOT safer: 7/14 right and 6/14 silently wrong (picks a different record that looks similar) vs 14/14 for an identity-checked selector; parse speed equal to lxml (9.67 vs 9.94 ms per 1,000 cards). Its adaptive store is shared per domain, not per client. Allowed: a bounded offline parser test. Not allowed: its MCP, agent skill, stealth stack or logged-in fetchers. Supersedes the Aug CLUSTER WINNER (scraping) call, which was never measured.

Filed under browser automation in our directory.

Similar repos