DistScaper retrieves where the various images (.iso files) are located for a number of Linux distributions. It is being used for DriveDroid to show a list of downloadable images.
The distributions that are supported can be found in scrapers.
$ git clone git://github.com/FrozenCow/distscraper.git
$ cd distscraper
$ npm install
To let distscaper retrieve all images of all distributions, execute:
$ node index.js
To let distscaper only retrieve specified distributions, for example only Debian, execute:
$ node index.js -s scrapers/debian.js
Retrieval of logo-images of the different distribution is done through retrievelogos.sh. This script downloads images of the distributions from various sources and transforms them to 48x48-PNG logos:
$ ./retrievelogos.sh
To add new scrapers, look at the different scrapers that are already in place (under scrapers/). The output of a scraper should look like scraper-output.json.
If you have a new or updated scraper, please do a pull request.