Kivach
Cascading donations
Add repoPopularDonorsF.A.Q.
My repos

Footer

Subscribe to our newsletter

The latest news, articles, and resources, sent to your inbox.

DiscordTelegramTwitterMediumFacebookYouTubeGitHub

All information about repositories belongs to their owners.

More information about Kivach in the introductory article.

Built on Obyte

Total donated
Undistributed
Share with your subscribers:

Recipients

How the donated funds are distributed

Support the dependencies of tidoust/fetch-filecache-for-crawling

Account's avatar
isaacs/rimraf
A deep deletion module for node (like `rm -rf`)

Support the repos that depend on this repository

Top contributors

tidoust's profile
tidoust
46 contributions
dependabot[bot]'s profile
dependabot[bot]
4 contributions
dontcallmedom's profile
dontcallmedom
3 contributions

Recent events

Kivach works on the Obyte network, and therefore you can track all donations.

No events yet
tidoust

tidoust/fetch-filecache-for-crawlin...

Implementation of a `fetch` that extends the implementation from `node-fetch` to add an HTTP cache using a local cache folder for crawling purpose

JavaScript
5
1
MIT License

The repository provides a drop‑in replacement for Node’s native `fetch` that adds a persistent, file‑system‑based HTTP cache optimized for web‑crawling. It stores GET responses in a configurable folder, supports various cache‑refresh strategies (e.g., force, once, never, or time‑based), and lets callers control cache reset, logging, and other options—making it useful for developers building crawlers that need fast, repeatable fetching without repeatedly downloading unchanged resources.