This repo contains scripts to automatically harvest information about current New Mexico legislators, output CSVs and Excel files. Harvesting voting records of legislators are of particular interest, since the data are stored in PDF tables, making programmatic access more challenging.
Data about individual legislators is scraped from https://nmlegis.gov/. Photographs of each legislator are automatically downloaded.
Links to congressional district maps are scrapted from https://www.sos.state.nm.us/voting-and-elections/data-and-maps/.
PDFs of votes are downloaded programmatically from https://nmlegis.gov/Sessions/{session}/votes, where session indicates the legislative session of interest.
The list of ZCTAs (zip code tabulation areas) are derived from a spatial join of congressional districts and ZCTA boundaries, taken from http://rgis.unm.edu/rgis6/.
Some post-processing of the output files is required. The two CSVs should be "imported" into a single Excel with UTF-8 encoding to properly render accented characters, and the map links need to be manually linked with =HYPERLINK().
Photographs for each legislator can be automatically inserted to each sheet of an Excel workbook by running the macro in code/add-photos-to-excel.vb. Run once for each of House and Senate, and be sure to change the sheet names, paths, and row numbers to accomodate each case. It may be required to insert all photos manually (once, anywhere, then delete) before running the macros to match photos with their legislators.