scrappy

powerful web spidering, scraping, creeping crawling framework

Install

All systems
curl cmd.cat/scrappy.sh
Debian Debian
apt-get install libscrappy-perl
Ubuntu
apt-get install libscrappy-perl
image/svg+xml Kali Linux
apt-get install libscrappy-perl
Windows (WSL2)
sudo apt-get update sudo apt-get install libscrappy-perl
Raspbian
apt-get install libscrappy-perl

libscrappy-perl

powerful web spidering, scraping, creeping crawling framework

Scrappy is an easy (and hopefully fun) way of scraping, spidering, and/or harvesting information from web pages, web services, and more. Scrappy is a feature rich, flexible, intelligent web automation tool.