Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript
17317
784
Apache License 2.0
Total donated
Undistributed
Share with your subscribers:
Recipients
How the donated funds are distributed
Support the dependencies of apifytech/apify-js
Tools and constants shared across Apify projects.
TypeScript configuration shared across projects in Apify.
Biome is a toolchain for the web: formatter, linter and more
Shareable commitlint config enforcing conventional commits
Playwright package that automatically installs Chromium
Playwright package that automatically installs Firefox
Playwright package that automatically installs WebKit
TypeScript definitions for content-type
TypeScript definitions for deep-equal
TypeScript definitions for express
TypeScript definitions for fs-extra
TypeScript definitions for inquirer
TypeScript definitions for is-ci
TypeScript definitions for lodash.isequal
TypeScript definitions for lodash.merge
TypeScript definitions for mime-types
TypeScript definitions for node
TypeScript definitions for proper-lockfile
TypeScript definitions for ps-tree
TypeScript definitions for sax
TypeScript definitions for semver
TypeScript definitions for stream-json
TypeScript definitions for yargs
TypeScript plugin for ESLint
An ESLint custom parser which leverages TypeScript ESTree
V8 coverage provider for Vitest
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
A wrapper around cURL-impersonate, a binary which can be used to bypass TLS fingerprinting.
Parse Basic Auth `Authorization` HTTP headers
Lint your commit messages
Run scripts that set and use environment variables across platforms
node's assert.deepEqual algorithm
fs-extra contains methods that aren't included in the vanilla Node.js fs package. Such as recursive mkdir, copy, and remove.
Generate ESM wrapper files for CommonJS modules
Modern native Git hooks
Detect if the current environment is a CI server
Lerna is a fast, modern build system for managing and publishing multiple JavaScript/TypeScript packages from the same repository
Lint files staged by git
HTTP server mocking and expectations library for Node.js
A high-level API to automate web browsers
Top contributors
mnmkng
1149 contributions
![renovate[bot]'s profile](https://avatars.githubusercontent.com/renovate[bot])
renovate[bot]
748 contributions
jancurn
711 contributions
B4nan
559 contributions
mtrunkat
444 contributions
petrpatek
242 contributions
barjin
118 contributions
vladfrangu
106 contributions
szmarczak
47 contributions
drobnikj
46 contributions
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
No events yet