You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This repository contains Python code for web crawling. It is built using the BeautifulSoup library and allows you to extract text from web pages and store it in text files. The crawler can also extract hyperlinks from web pages and crawl them recursively.This code will be a great starting point for your own web scraping projects
A webscraping application that brings search results from multiple web-stores onto one page. Also allows the user to add items to a shopping list to save for later.
This project was created using Jupyter Notebook and used to web scraping data from Badan Nasional Penanggulangan Bencana (National Agency for Disaster Management) using Python BeatifulSoup library
Full Scale portfolio project used to aggregate sales data from the GSMLS (quarterly), clean and transform the data and store in a SQL database for future machine learning analysis
A script which scrapes the human-readable text from a web page and calls OpenAI's GPT-3 API to generate three descriptions of differing lengths, using the scraped text in the prompts. Has the option to abide by OpenAI's free account rate limiting when used on a CSV file of multiple URLs.