Releases: Police-Data-Accessibility-Project/scrapers
CSV Exports and Dataset creation (Experimental Linux support)
Dataset creation within the GUI is now possible!
Once you have finished setting the information for the dataset, upload the csv files created by the GUI to their respected table on our dolthub
I'm not 100% sure the Linux files will work yet, create an issue if you have a problem with it please!
Checksums
File: scrapersetup_windows.zip
SHA256: 4FB6281376DF8C8BA6264A42715013021411B204573D27403148DA14F63C2C68
File: scrapersetup_linux.zip
SHA256: 7AD857BD5930456EEF107325D80CA8BB8B5DEAC1CA70F37A763F8F5839AC0102
What's Changed
- Update schema by @CaptainStabs in #166
- Add dataset creation and CSV exporting to GUI by @CaptainStabs in #168
Full Changelog: v0.0.5...v0.0.6
Better schema creation
- Parse homepage_url using urllib's urlparse to make the select statement more lenient by using netloc
- Fixed bug where results weren't displayed if only one result was returned
- Added alternative way of searching for agencies (city + state_iso)
- Replaced prints with logging module to make it a little more readable
What's Changed
- Update common utils by @CaptainStabs in #160
- Updating stuff by @CaptainStabs in #161
- 0.0.5 by @CaptainStabs in #162
- Update README.md by @CaptainStabs in #163
Full Changelog: v0.0.4...v0.0.5
Checksum
File: scrapersetup_windows.zip
SHA256: 2eabb457f51020a06e36900587338b416e33355be7e21b9342fc7127be7cbb9f
Fixed GUI Issues
~ Fixed issue with sections of GUI going off the window on certain monitors.
What's Changed
- Scraper setup script by @CaptainStabs in #146
- Update starter template by @CaptainStabs in #147
- remove dolt as requirement by @josh-chamberlain in #151
- scraper schema doc by @josh-chamberlain in #155
- Bump scrapy from 2.5.0 to 2.5.1 by @dependabot in #157
- Bump scrapy from 2.5.0 to 2.5.1 in /USA/FL/Bay/Court/scraper by @dependabot in #156
- Update GUI by @CaptainStabs in #158
Full Changelog: 0.0.3...v0.0.4
Schema creation support
- The GUI will now autofill the first portion of the schema, and sections of the
data
portion - Fixed an issue with scaling on high DPI screens
- Moved the readme to
setup_gui
Bugfixes
Initial GUI Release
First release of the scraper creation gui