Flipkart_API

I developed a web application called "Flipkart Scraping API." The primary objective of this project was to create an API that allows users to sign up, log in using JWT-based authentication, and scrape product details from Flipkart URLs. The scraped data is then stored in a MongoDB database with a proper schema, including user information.

Table of Contents

• Features
• Getting Started
• Tech Stack
• Project Demo
• Author

Features

• 1. JWT-Based Authentication

  Users could sign up and log in using JWT-based authentication, which ensured secure access to the application's functionalities.

• 2. Post API for Scraping

  The application provided a post API that allowed users to input a Flipkart URL as a payload. When invoked, the API scraped essential product information from the URL, such as title, price, description (if available), number of reviews, ratings, and the number of media counts in the product display box..

• 3. Data Storage in MongoDB

  The scraped data was stored in a Postgres database with a proper schema design that accommodated the scraped fields and user information.

• 4. URL Validation and Ownership Check

  Before scraping data, the application checked if the URL corresponded to the logged-in user. If the URL was already present in the database for the user, the application returned the data from the database. Otherwise, if the URL was not present or did not belong to the logged-in user, appropriate error messages were shown.

Getting Started

• 1.   Clone Git Repo
  ---- git clone https://github.com/Sahil-Sayyad/Flipkart_API.git
  
  
• 2.  Install NPM dependencies
  ---- npm install
  
  
• 2.  Set Up .env file
  ---- add mongodb your url
  ---- add access_token_sceret
  
  
• 3.   Then simply start your app
  ----npm start
  
  
• 4.   Set up Auth
  ---- after login you got a access token you can simply add this token in postman or thunder-client at auth section as jwt Bearer then you can make req.

Prerequisites

• NodeJs Any Version

Usage

Tech Stack

• Back-end

  Node.js: For server-side development and handling API requests. Express.js: As a framework to create the application's server-side routes and manage the HTTP requests and responses. MongoDB: served as the database to store the scraped data and user information with a well-defined schema.

• 2. Authentication

  jwt: For implementing the authentication system and managing user sign-up and sign-in.

Project Demo

• Scraped Data Demo
  
  

• Access Token Demo
  
  

• Adding Access Token Demo
  
  

• Passing URL For Scraping Data Demo
  
  

Author

• Name: Sahil Sayyad
• GitHub: Link
• Email:
• Website: