Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Crawlee is a Node.js library for web scraping and browser automation that helps developers build reliable crawlers with features like proxy rotation, session management, and integrated storage. It's designed for developers who need to extract data from websites at scale, supporting both HTTP crawling and headless browser automation through Playwright and Puppeteer.
Recipients
How the donated funds are distributed
Support the dependencies
Support the repos that depend on this repository
Top contributors
![renovate[bot]'s profile](https://avatars.githubusercontent.com/renovate[bot])
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
