Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Crawlee is a web scraping and browser automation library for Node.js that helps developers build reliable crawlers for data extraction, AI/ML applications, and file downloads. It provides both HTTP and headless browser crawling capabilities with built-in proxy rotation, session management, and human-like behavior to bypass bot protections.
Recipients
How the donated funds are distributed
Support the dependencies
Support the repos that depend on this repository
Top contributors
![renovate[bot]'s profile](https://avatars.githubusercontent.com/renovate[bot])
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
