unclecode/crawl4ai
85,488 8,878PythonApache-2.0Updated 2 weeks ago
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
aiai-agentscrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
Our verdict: worth using
crawl4ai is a ready‑to‑install Python library that converts any webpage into clean LLM‑ready Markdown, matching the engineer's need for fast, reliable scraping for AI agents