Kivach
Cascading donations
Add repoPopularDonorsF.A.Q.
My repos

Footer

Subscribe to our newsletter

The latest news, articles, and resources, sent to your inbox.

DiscordTelegramTwitterMediumFacebookYouTubeGitHub

All information about repositories belongs to their owners.

More information about Kivach in the introductory article.

Built on Obyte

Total donated
Undistributed
Share with your subscribers:

Recipients

How the donated funds are distributed

Support the dependencies of tudorilisoi/trawl4

Account's avatar
babel/babel-loader
babel module loader for webpack
Account's avatar
cheeriojs/cheerio
The fast, flexible & elegant library for parsing and manipulating HTML and XML.
Account's avatar
debug-js/debug
Lightweight debugging utility for Node.js and the browser
Account's avatar
moment/moment
Parse, validate, manipulate, and display dates
Account's avatar
JCMais/node-libcurl
The fastest http(s) client (and much more) for Node.js - Node.js bindings for libcurl
Account's avatar
dresende/node-orm2
NodeJS Object-relational mapping
Account's avatar
kriskowal/q
A library for promises (CommonJS/Promises/A,B,D)
Account's avatar
ekalinin/robots.js
Parser for robots.txt
Account's avatar
erikdubbelboer/node-sleep
Add sleep() and usleep() to nodejs
Account's avatar
webpack/webpack
Packs ECMAScript/CommonJs/AMD modules for the browser. Allows you to split your codebase into multiple bundles, which can be loaded on demand. Supports loaders to preprocess files, i.e. json, jsx, es7
Account's avatar
yargs/yargs
yargs the modern, pirate-themed, successor to optimist.

Support the repos that depend on this repository

Top contributors

tudorilisoi's profile
tudorilisoi
173 contributions

Recent events

Kivach works on the Obyte network, and therefore you can track all donations.

No events yet
tudorilisoi

tudorilisoi/trawl4

A low memory footprint node.js web crawler with a MySQL backend

JavaScript
0
0
No license

TRAWL4 is a lightweight, command‑line Node.js web crawler that recursively follows links across a site, respects robots.txt, and stores each page’s URL and content in a MySQL database for later analysis. It’s built for developers or data‑engineers who need an inexpensive, low‑memory (≈240 MB) solution for site‑wide scraping or spidering without using heavyweight frameworks.