Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA][Audit] [SPARK-38159][SQL] - Update MetadataAttribute for the Hidden File Metadata #4868

Closed
nartal1 opened this issue Feb 24, 2022 · 0 comments · Fixed by #4934
Closed
Assignees
Labels
audit_3.3.0 Audit related tasks for 3.3.0 P0 Must have for release

Comments

@nartal1
Copy link
Collaborator

nartal1 commented Feb 24, 2022

Is your feature request related to a problem? Please describe.
Spark has added a new FileSourceMetadataAttribute object with an apply method to create a FileSourceMetadataAttribute, and an unapply method to match only file source metadata attribute.
In tagFileSourceScanExec method we currently check for MetadataAttribute which should be changed to FileSourceMetadataAttribute.

Spark PR: apache/spark@7ed51bbbe5

@nartal1 nartal1 added feature request New feature or request ? - Needs Triage Need team to review and classify audit_3.3.0 Audit related tasks for 3.3.0 labels Feb 24, 2022
@sameerz sameerz added P0 Must have for release and removed feature request New feature or request ? - Needs Triage Need team to review and classify labels Mar 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
audit_3.3.0 Audit related tasks for 3.3.0 P0 Must have for release
Projects
None yet
3 participants