Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Create Cloudera shim layer #951

Closed
tgravescs opened this issue Oct 15, 2020 · 1 comment · Fixed by #2423
Closed

[FEA] Create Cloudera shim layer #951

tgravescs opened this issue Oct 15, 2020 · 1 comment · Fixed by #2423
Labels
feature request New feature or request P0 Must have for release
Milestone
May 24 - Jun 4

Comments

@tgravescs
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
Cloudera version of Spark has a different version number and potentially pulls back fixes from later versions of Spark, we should create a shim layer and test it.

Reference #905 (comment) for more details
@tgravescs tgravescs added feature request New feature or request ? - Needs Triage Need team to review and classify labels Oct 15, 2020
@tgravescs tgravescs mentioned this issue Oct 15, 2020
Closed
@sameerz sameerz added P0 Must have for release and removed ? - Needs Triage Need team to review and classify labels Oct 20, 2020
@sameerz sameerz added P1 Nice to have for release and removed P0 Must have for release labels Nov 6, 2020
@tgravescs
Copy link
Collaborator Author

tgravescs commented Feb 12, 2021 •
edited
Loading

version numbers seem pretty straight forward where first part is spark version 3.0.1 and then they add in extra .X.X-Y* format (3.0.1.3.0.7110.0-81)
, need to do some testing to see if we want entire shim or if we do something like #409

@jlowe jlowe self-assigned this Mar 3, 2021
@revans2 revans2 mentioned this issue Apr 1, 2021
Open
38 tasks
@sameerz sameerz linked a pull request May 19, 2021 that will close this issue
Add cloudera shim layer #2423
Merged
@sameerz sameerz added P0 Must have for release and removed P1 Nice to have for release labels Jun 1, 2021
@sameerz sameerz added this to the May 24 - Jun 4 milestone Jun 1, 2021
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@revans2
Fix memory leaks and test logging (NVIDIA#951)
5107ead 
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request New feature or request P0 Must have for release
Projects
None yet
Milestone
May 24 - Jun 4
Development

Successfully merging a pull request may close this issue.

Add cloudera shim layer sririshindra/spark-rapids
3 participants
@jlowe @tgravescs @sameerz