Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added support for Array of Structs [databricks] #3619

Merged
merged 2 commits into from
Sep 23, 2021

Conversation

razajafri
Copy link
Collaborator

Added support for Array of Struct to ParquetCachedBatchSerializer

  • Made changes to ParquetCachedBatchSerializer.scala to allow Arrays
  • Added unit tests to test Array[Integer] and Array[Struct([String, Struct(Integer)])]

closes #3573

Signed-off-by: Raza Jafri rjafri@nvidia.com

Signed-off-by: Raza Jafri <rjafri@nvidia.com>
@razajafri razajafri force-pushed the SP-3573-pcbs-struct-array branch from 6b64965 to 14081c7 Compare September 23, 2021 04:15
@razajafri
Copy link
Collaborator Author

build

…ructs

Signed-off-by: Raza Jafri <rjafri@nvidia.com>
@razajafri
Copy link
Collaborator Author

build

@sameerz sameerz added the feature request New feature or request label Sep 23, 2021
@sameerz sameerz added this to the Sep 13 - Sep 24 milestone Sep 23, 2021
@sameerz sameerz linked an issue Sep 23, 2021 that may be closed by this pull request
@razajafri razajafri merged commit 64039e6 into NVIDIA:branch-21.12 Sep 23, 2021
@sameerz sameerz linked an issue Sep 23, 2021 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] Support Cache(PCBS) Array-of-Struct [FEA] Add support for Arrays to ParquetCachedBatchSerializer
3 participants