Skip to content

The goal of this project is to build a web application that scrapes various websites for data related to the fictional 'Mission to Mars' and displays the information in a single HTML page.

Notifications You must be signed in to change notification settings

jwhite1987/Web-Scraper-App

Repository files navigation

Web Scraper App

Project Description

  • The goal of this project is to build a web application that scrapes various websites for data related to the NASA's website for Mars and Mars data and displays the information in a single HTML page.
  • First, begin scraping the NASA Mars News Site using Jupyter Notebook, BeautifulSoup, Pandas, and Requests/Splinter and collect the latest News Title and Paragraph Text and assign the text to variables that can be referenced later.
  • Then, visit this url and using splinter to navigate the site and find the image url for the current Featured Mars Image and assign the url string to a variable.
  • Using the same scraping libraries, visit the Mars Facts webpage here and use Pandas to scrape the table containing facts about the planet including Diameter, Mass, and other relevant data. Then, visit the USGS Astrogeology site here to obtain high resolution images for each of Mar's hemispheres.
  • Finally, using MongoDB and Flask, build an HTML page that displays all of the information that was scraped/gathered from the URLs previously listed.

Languages & Technology Used

  • Python
  • Jupyter Notebook
  • BeautifulSoup
  • Pandas
  • Requests/Splinter
  • MongoDB
  • Flask
  • HTML

Screenshots

image

image

image

image

image

Links

About

The goal of this project is to build a web application that scrapes various websites for data related to the fictional 'Mission to Mars' and displays the information in a single HTML page.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published