Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Revisit GpuTextBasedPartitionReader and how returned values are cast to the final result #10539

Open
revans2 opened this issue Mar 4, 2024 · 0 comments

Comments

@revans2
Copy link
Collaborator

revans2 commented Mar 4, 2024

Is your feature request related to a problem? Please describe.
GpuTextBasedPartitionReader was written without any nested types support at all. We are starting to add this in for JSON, but JSON is getting to be a little tricky because we might end up with needing to recursively call parse some columns that are returned. Also the JSON, CSV, and HiveText formats do not really share all that much in terms of parsing once we get into the details of it. Once we have a better understanding of how the final JSON code will work we should come back and revisit this so that the design is cleaner.

@revans2 revans2 added feature request New feature or request ? - Needs Triage Need team to review and classify tech debt labels Mar 4, 2024
@sameerz sameerz removed feature request New feature or request ? - Needs Triage Need team to review and classify labels Mar 5, 2024
@sameerz sameerz mentioned this issue Mar 5, 2024
62 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants