Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Add support for Arrays to ParquetCachedBatchSerializer #2054

Closed
razajafri opened this issue Mar 31, 2021 · 1 comment · Fixed by #3619
Closed

[FEA] Add support for Arrays to ParquetCachedBatchSerializer #2054

razajafri opened this issue Mar 31, 2021 · 1 comment · Fixed by #3619
Assignees
@razajafri
Labels
feature request New feature or request
Milestone
Sep 13 - Sep 24

Comments

@razajafri
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
The ParquetWriter in cudf supports Lists while the ParquetCachedBatchSerializer doesn't

Describe the solution you'd like
Whitelist GpuInMemoryTableScanExec and make necessary changes to support Lists

Describe alternatives you've considered
Currently, the serializer will fallback to CPU

Additional context
NA
@razajafri razajafri added feature request New feature or request ? - Needs Triage Need team to review and classify labels Mar 31, 2021
@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Apr 6, 2021
@razajafri razajafri mentioned this issue Sep 22, 2021
Closed
@razajafri razajafri self-assigned this Sep 22, 2021
@razajafri
Copy link
Collaborator Author

closed as part of #3573

@sameerz sameerz added this to the Sep 13 - Sep 24 milestone Sep 23, 2021
@sameerz sameerz linked a pull request Sep 23, 2021 that will close this issue
Added support for Array of Structs [databricks] #3619
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@razajafri razajafri

Labels
feature request New feature or request
Projects
None yet
Milestone
Sep 13 - Sep 24
Development

Successfully merging a pull request may close this issue.

Added support for Array of Structs [databricks] razajafri/spark-rapids
2 participants
@sameerz @razajafri