fffunction/backstop-crawl

The fast, flexible & elegant library for parsing and manipulating HTML and XML.

Easily read/write JSON files.

ES2017 spec-compliant Object.entries shim.

Small footprint URL parser that works seamlessly across Node.js and browser environments

URI validation functions

An ES7/ES2016 spec-compliant `Array.prototype.includes` shim/polyfill/replacement that works as far down as ES3.

takes json-cov output into stdin and POSTs to coveralls.io

simple development http server with live reload capability

the Istanbul command line interface

Make all directories in a path, like mkdir -p

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.