Different examples of scraping techniques. Cheerio is used in all the examples to extract the desired content.
Show a few examples of screen scraping.
- Scrape static content with request.
- Scrape dynamic content (Angular/Ember) using Nightmare.
- Take screen shots of page and programmatically interact with the page using Nightmare.
- Open Google and interact with page (WIP).
- npm install
- https://www.npmjs.com/package/cheerio
- https://www.npmjs.com/package/request
- https://www.npmjs.com/package/q
- https://www.npmjs.com/package/colors
- https://www.npmjs.com/package/sleep
- https://www.npmjs.com/package/nightmare / http://www.nightmarejs.org/
- https://www.npmjs.com/package/prompt
- https://www.npmjs.com/package/phantom
- https://www.npmjs.com/package/vo
- node-debug --nodejs --harmony index.js
- node --harmony index.js