Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update parquet requirement from 52.0.0 to 53.0.0 #136

Merged
merged 1 commit into from
Sep 13, 2024

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Sep 3, 2024

Updates the requirements on parquet to permit the latest version.

Changelog

Sourced from parquet's changelog.

53.0.0 (2024-08-31)

Full Changelog

Breaking changes:

Implemented enhancements:

  • Derive PartialEq and Eq for parquet::arrow::ProjectionMask #6329 [parquet]
  • Allow converting empty pyarrow.RecordBatch to arrow::RecordBatch #6318 [arrow]
  • Parquet writer should not write any min/max data to ColumnIndex when all values are null #6315 [parquet]
  • Parquet: Add union method to RowSelection #6307 [parquet]
  • Support writing UTC adjusted time arrow array to parquet #6277 [parquet]
  • A better way to resize the buffer for the snappy encode/decode #6276 [parquet]
  • parquet_derive: support reading selected columns from parquet file #6268
  • Tests for invalid parquet files #6261 [parquet]
  • Implement date_part for Duration #6245 [arrow]
  • Avoid unnecessary null buffer construction when converting arrays to a different type #6243 [parquet] [arrow]
  • Add parquet_opendal in related projects #6235
  • Look into optimizing reading FixedSizeBinary arrays from parquet #6219 [parquet] [arrow]
  • Add benchmarks for BYTE_STREAM_SPLIT encoded Parquet FIXED_LEN_BYTE_ARRAY data #6203 [parquet]
  • Make it easy to write parquet to object_store -- Implement AsyncFileWriter for a type that implements obj_store::MultipartUpload for AsyncArrowWriter #6200 [parquet]
  • Remove test duplication in parquet statistics tets #6185 [parquet]
  • Support BinaryView Types in C Schema FFI #6170 [arrow]
  • speedup take_byte_view kernel #6167 [arrow]
  • Add support for StringView and BinaryView statistics in StatisticsConverter #6164 [parquet]
  • Support casting BinaryView --> Utf8 and LargeUtf8 #6162 [arrow]
  • Implement filter kernel specially for FixedSizeByteArray #6153 [arrow]
  • Use LevelHistogram throughout Parquet metadata #6134 [parquet]
  • Support DoPutStatementIngest from Arrow Flight SQL 17.0 #6124 [arrow] [arrow-flight]
  • ColumnMetaData should no longer be written inline with data #6115 [parquet]
  • Implement date_part for Interval #6113 [arrow]
  • Implement Into<Arc<dyn Array>> for ArrayData #6104
  • Allow flushing or non-buffered writes from arrow::ipc::writer::StreamWriter #6099 [arrow]
  • Default block_size for StringViewArray #6094 [arrow]
  • Remove Statistics::has_min_max_set and ValueStatistics::has_min_max_set and use Option instead #6093 [parquet]
  • Upgrade arrow-flight to tonic 0.12 #6072
  • Improve speed of row converter by skipping utf8 checks #6058 [arrow]
  • Extend support for BYTE_STREAM_SPLIT to FIXED_LEN_BYTE_ARRAY, INT32, and INT64 primitive types #6048 [parquet]
  • Release arrow-rs / parquet minor version 52.2.0 (August 2024) #5998 [parquet] [arrow]

Fixed bugs:

... (truncated)

Commits
  • ffd216d Workaround new bug in parquet (#6344)
  • 774b721 Prepare arrow/parquet 53.0.0 release (#6338)
  • 831a080 Specialize filter for structs and sparse unions (#6304)
  • 3a1f67f parquet_derive: Match fields by name, support reading selected fields rather ...
  • 0c15191 Support zero column RecordBatches in pyarrow integration (use RecordBatchOp...
  • 6e50503 Derive PartialEq and Eq for parquet::arrow::ProjectionMask (#6330)
  • acdd27a Fix writing of invalid Parquet ColumnIndex when row group contains null page...
  • 69e5e5f Minor: improve filter documentation (#6317)
  • 1336973 Pass empty vectors as min/max for all null pages when building ColumnIndex (#...
  • 6785170 docs[object_store]: clarify the backoff strategy that is actually implemented...
  • Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [parquet](https://github.com/apache/arrow-rs) to permit the latest version.
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG.md)
- [Commits](apache/arrow-rs@52.0.0...53.0.0)

---
updated-dependencies:
- dependency-name: parquet
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file rust Pull requests that update Rust code labels Sep 3, 2024
Copy link
Member

@marvin-hansen marvin-hansen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@marvin-hansen marvin-hansen merged commit 5cef748 into main Sep 13, 2024
7 of 8 checks passed
@dependabot dependabot bot deleted the dependabot/cargo/parquet-53.0.0 branch September 13, 2024 12:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file rust Pull requests that update Rust code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant