JavaScript
0
0
Other
WARCannon is a tool for efficiently processing large-scale Common Crawl data using parallel computing on AWS, designed for researchers and developers who need to analyze web data at scale. It allows users to build and test regex patterns against real web data, scale processing across hundreds of CPU cores, and store results in S3, making it ideal for tasks like identifying specific technologies or patterns across the internet.
Total donated
Undistributed
Share with your subscribers:
Recipients
How the donated funds are distributed
Support the dependencies
Support the repos that depend on this repository
Top contributors
c6fc
37 contributions
girishbarca
5 contributions
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
No events yet
