Scraper for Candidate Information
The main interface for running the scraper is through
python scrape_websites.py
which reads candidate websites from a file name websites.csv with no header and a line per website like
# websites.csv
www.candidate1.com
www.candidate2.com
...
The script crawls through each site and exports files like
twitter-www.candidate1.com.csv
email-www.candidate1.com.csv
...
that contain the original domain and social handles. I've been combining them via python and manually confirming the output.