Releases: scrapinghub/exporters
Releases · scrapinghub/exporters
0.6.3
0.6.2
0.6.1
0.6.0
0.5.0
New features:
- Introduced StreamBasedReader that adds support for custom decompressors and deserializers #316
- Added support for uncompressed input via NoDecompressor #316
- Added support for CSV formatted input through CSVDeserializer #316
- FSReader now ignores directories whose name start with a dot #314
- Added DupeFilter, a filter that ignores subsequent duplicates based on a key field #321
- Allow using integer as project id #309
Bug fixes:
- Support long values in int fields #320
0.4.15
0.4.14
- Bugfix on S3Reader: it was skipping every other key
- Updates to documentation, added examples dir
- Mark item as finished in HS reduce writer
v0.1.19
New Features:
- Azure blob writer
- Azure file writer
- Date rages support for filebases
- Improved logging
- Added metadata object to modules
- Optional consistency checks for all file based writers
- Exported file name is now the same as compressed file name
- Moved from nose to py test environment
- Adds integration tests
- Adds flake8 checks
- S3 to azure blobs bypass
- S3 to azure files bypass
- Possibility of disabling retries
Bug fixes:
- Fix retries for mail notifications module
- Fix tests leaving dirty tmp folder
- Tons and tons of small fixes
0.1.8
- Fix MailWriter to support loading keys from environment