# Clone the repo
git clone git@github.com:dujm/ds_smart_job_search.git
rm .git
# Modify scraping conditions
cd app
vim scrape_de.py
# Modify "url_de", "My_City", "max_results_my_city", and "page"
# Web scrape from indeed.de
python scrape_de.py
# Run the app
python app.py
# Visit http://127.0.0.1:5000
pip freeze > requirements.txt
Follow the Dash deployment guide or have a look at the dash-heroku-template
- Users may be subject to legal ramifications depending on where and how they attempt to scrape information.
- Respect the Indeed Terms of Service
- Respect the rules of robots.txt.
- Use a reasonable crawl rate