Kivach
Cascading donations
Add repoPopularDonorsF.A.Q.
My repos

Footer

Subscribe to our newsletter

The latest news, articles, and resources, sent to your inbox.

DiscordTelegramTwitterMediumFacebookYouTubeGitHub

All information about repositories belongs to their owners.

More information about Kivach in the introductory article.

Built on Obyte

This is a Node.js web crawler library that allows users to scrape websites and extract data from HTML pages. It provides features like configurable connection pooling, rate limiting, priority queues, and automatic jQuery insertion with Cheerio. The library is designed for developers who need to build web scraping applications or extract data from websites programmatically in Node.js.

Total donated
Undistributed
Share with your subscribers:

Recipients

How the donated funds are distributed

Support the dependencies

Support the repos that depend on this repository

Top contributors

Recent events

Kivach works on the Obyte network, and therefore you can track all donations.

No events yet
bda-research

bda-research/node-crawler

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

TypeScript
6796
866
MIT License
mike442144's profile
mike442144
167 contributions
paulvalla's profile
paulvalla
136 contributions
Miniast's profile
Miniast
103 contributions
sylvinus's profile
sylvinus
65 contributions
darrenqc's profile
darrenqc
11 contributions
jhurliman's profile
jhurliman
8 contributions
bkw's profile
bkw
5 contributions
rauno56's profile
rauno56
5 contributions
Zhubaoheng's profile
Zhubaoheng
5 contributions
authuir's profile
authuir
4 contributions

Support the dependencies of bda-research/node-crawler

Account's avatar
cheeriojs/cheerio
The fast, flexible & elegant library for parsing and manipulating HTML and XML.
Account's avatar
delvedor/hpagent
A ready to use http and https agent for working with proxies that keeps connections alive!
Account's avatar
szmarczak/http2-wrapper
HTTP2 client, just with the familiar `https` API
Account's avatar
pillarjs/iconv-lite
Convert character encodings in pure javascript.
Account's avatar
mike442144/seenreq
A library to test if a url(request) is crawled, usually used in a web crawler. Compatible with `request` and `node-crawler`
Account's avatar
fullstack-build/tslog
Extensible TypeScript Logger for Node.js and Browser.
Account's avatar
eslint/eslint
ESLint JavaScript language implementation
Account's avatar
DefinitelyTyped/DefinitelyTyped
TypeScript definitions for node
Account's avatar
avajs/ava
Node.js test runner that lets you develop with confidence.
Account's avatar
bcoe/c8
output coverage reports using Node.js' built in coverage
Account's avatar
nock/nock
HTTP server mocking and expectations library for Node.js
Account's avatar
sinonjs/sinon
JavaScript test spies, stubs and mocks.
Account's avatar
salesforce/tough-cookie
RFC6265 Cookies and Cookie Jar for node.js
Account's avatar
egoist/tsup
Bundle your TypeScript library with no config, powered by esbuild
Account's avatar
microsoft/TypeScript
TypeScript is a language for application scale JavaScript development
Account's avatar
typescript-eslint/typescript-eslint
Tooling which enables you to use TypeScript with ESLint