Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] [Audit] - [SPARK-33230][SQL] Hadoop committers to get unique job ID in "spark.sql.sources.writeJobUUID" #2996

Closed
nartal1 opened this issue Jul 22, 2021 · 0 comments · Fixed by #3048
Closed

[FEA] [Audit] - [SPARK-33230][SQL] Hadoop committers to get unique job ID in "spark.sql.sources.writeJobUUID" #2996

nartal1 opened this issue Jul 22, 2021 · 0 comments · Fixed by #3048
Assignees
@jlowe
Labels
audit_3.1.0 audit_3.2.0 task Work required that improves the product but is not user facing
Milestone
July 19 - July 30

Comments

@nartal1
Copy link
Collaborator

nartal1 commented Jul 22, 2021

Is your feature request related to a problem? Please describe.
This seems to be small PR and I am not sure if this will impact us. It sets a unique jobId in the jobconf so that hadoop MR committers have a unique ID.
PR: apache/spark@02fa19f102
@nartal1 nartal1 added feature request New feature or request ? - Needs Triage Need team to review and classify audit_3.1.0 audit_3.2.0 labels Jul 22, 2021
@Salonijain27 Salonijain27 removed the ? - Needs Triage Need team to review and classify label Jul 27, 2021
@Salonijain27 Salonijain27 added this to the July 19 - July 30 milestone Jul 27, 2021
@jlowe jlowe mentioned this issue Jul 27, 2021
Merged
@sameerz sameerz added task Work required that improves the product but is not user facing and removed feature request New feature or request labels Jul 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jlowe jlowe

Labels
audit_3.1.0 audit_3.2.0 task Work required that improves the product but is not user facing
Projects
None yet
Milestone
July 19 - July 30
Development

Successfully merging a pull request may close this issue.

Apply unique committer job ID fix from SPARK-33230 jlowe/spark-rapids
4 participants
@jlowe @sameerz @Salonijain27 @nartal1