aknibircse

aknibircse/anycrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

0
0
MIT License

AnyCrawl is a Node.js/TypeScript web crawling and scraping toolkit that extracts structured data from websites and search engines for AI applications. It's designed for developers building LLM-ready data pipelines who need efficient, multi-threaded crawling with support for various engines and automated JSON extraction.

Total donated
Undistributed
Share with your subscribers:

Recipients

How the donated funds are distributed

Support the dependencies of aknibircse/anycrawl

Account's avatar
Promise based HTTP client for the browser and node.js
Account's avatar
Find and fix unused dependencies, exports and files in your TypeScript and JavaScript projects
Account's avatar
Turborepo is a high-performance build system for JavaScript and TypeScript codebases.
Account's avatar
TypeScript is a language for application scale JavaScript development

Support the repos that depend on this repository

Top contributors

QThans's profile
QThans
236 contributions
turbobot-temp's profile
turbobot-temp
4 contributions
any4ai's profile
any4ai
1 contributions

Recent events

Kivach works on the Obyte network, and therefore you can track all donations.

No events yet