Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate Schema and RecordBatch projection #1638

Merged
merged 1 commit into from
Jan 23, 2022

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Jan 21, 2022

Builds on #1643, so draft until that is merged

Which issue does this PR close?

Closes #1646

Rationale for this change

@hntd187 added RecordBatch::project and Schema::project in apache/arrow-rs#1033, which among other thing correctly handle metadata and they make the code cleaner

What changes are included in this PR?

Use RecordBatch::project and Schema::project rather than duplicating the code (as well as missing metadata)

Are there any user-facing changes?

N/A (maybe fewer bugs related to metadata missing)

@github-actions github-actions bot added ballista datafusion Changes in the datafusion crate labels Jan 21, 2022
@alamb alamb marked this pull request as ready for review January 22, 2022 20:17
Copy link
Member

@yjshen yjshen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice simplification!

@houqp houqp merged commit 6ec18bb into apache:master Jan 23, 2022
@alamb alamb deleted the alamb/cleanups2 branch August 8, 2023 20:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
datafusion Changes in the datafusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Consolidate Schema and RecordBatch projection #1638
3 participants