Skip to content

Dynamic Web scraper built using Beautiful Soup (Python)

Notifications You must be signed in to change notification settings

Raghav2305/web_scraping

Repository files navigation

Scraping Engine App

Welcome to the Scraping Engine App! This versatile tool empowers users to extract various types of content from web pages and social media platforms. Whether you need images, text, tables, or even PDFs, our app has got you covered. You can also gather insights from Twitter and, soon, Facebook and Instagram.

Features

  • Web Scraping:

    • Extract images, text, tables, and PDFs from URLs provided by users.

    Scraping1

  • Social Media Scraping:

    • Gather tweets using Twitter handles and hashtags to collect valuable social media data.
    • (Coming Soon) Scrape data from Facebook and Instagram to analyze trends and engagement.

    Scraping2

Getting Started

Follow these steps to get started with the Scraping Engine App:

  1. Clone the repository:
    git clone https://github.com/your-username/scraping-engine-app.git
    
  2. Navigate to the project directory:
    cd scraping-engine-app 
    
  3. Install dependencies:
    pip install -r requirements.txt
    
  4. Run the APP:
    python app.py
    

Contributing

I welcome contributions from the community to enhance the Scraping Engine App. Here's how you can contribute:

  1. Fork the repository.
  2. Create a new branch for your feature or bug fix.
  3. Make your changes and ensure they're properly tested.
  4. Commit your changes with descriptive commit messages.
  5. Push your changes to your fork.
  6. Submit a pull request to the main branch of the original repository.

About

Dynamic Web scraper built using Beautiful Soup (Python)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published