Skip to content

Latest commit

 

History

History
39 lines (21 loc) · 557 Bytes

README.md

File metadata and controls

39 lines (21 loc) · 557 Bytes
Raw

Node Exam

Scraper API

Install API

npm install

Start app

npm start
TODO

  1. Add handler to check instance of error

  2. recurseGetData - improvements needed, such as - save to redis partially, improve logic for getting level data

  3. Add filter for already parsed urls

  4. Swagger - fix problems

  5. Add more tests

CLI app for Scraper API

Install tool

npm install

Before using tool need to link it

npm link

Using tool

scraper -u http://stackoverflow.com -l 1 -e h3
TODO
  1. Add progress bar