Skip to content

It is robust web scraping tool that focuses specifically on extracting data from the renowned e-commerce giant, Amazon. By leveraging Puppeteer's capabilities, I was able to navigate through Amazon's web pages, interact with elements, and effortlessly retrieve valuable product information.

Notifications You must be signed in to change notification settings

harshit0571/ScrapeMaster

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

32 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ScrapeMaster

It is robust web scraping tool that focuses specifically on extracting data from the renowned e-commerce giant, Amazon. By leveraging Puppeteer's capabilities, I was able to navigate through Amazon's web pages, interact with elements, and effortlessly retrieve valuable product information.

image

How To Use

Create a post request to http://15.207.100.214:8000/ with body that contains search query in json format.
eg:

{
    "search":"smartphones"
}

Setup

Here are the steps to run ScrapeMaster in your system.

Step 1

Clone and cd to the repo

$ git clone https://github.com/harshit/ScarpeMaster
$ cd ScrapeMaster

Step 2

Download node modules

$ npm i

step 3

To run the Amazon scrapper run:

$ npm run amazon

step 4

To practice Puppeteer run:

$ npm run practice

Features

ScrapeMaster can retreive data from amazon product page and store it int json format

image

image

Contributing

Feel free to contribute by opening an issue.

License

This project is licensed under the MIT License.

About

It is robust web scraping tool that focuses specifically on extracting data from the renowned e-commerce giant, Amazon. By leveraging Puppeteer's capabilities, I was able to navigate through Amazon's web pages, interact with elements, and effortlessly retrieve valuable product information.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published