Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update spark 312 shim, and Add spark 313-SNAPSHOT shim #2540

Merged
merged 5 commits into from
May 31, 2021

Conversation

pxLi
Copy link
Collaborator

@pxLi pxLi commented May 31, 2021

spark 3.1.2-SNAPSHOT has been replaced by 3.1.3-SNAPSHOT, in sonatype snapshot repo,

To bring our build back to work, update 3.1.2 shim dependencies and add spark 3.1.3 shim layer

@pxLi pxLi added the build Related to CI / CD or cleanly building label May 31, 2021
@pxLi
Copy link
Collaborator Author

pxLi commented May 31, 2021

build

@pxLi
Copy link
Collaborator Author

pxLi commented May 31, 2021

build

NvTimLiu
NvTimLiu previously approved these changes May 31, 2021
@pxLi
Copy link
Collaborator Author

pxLi commented May 31, 2021

Now move spark312 shim back to snapshot-shim profile

will confirm if we want to release it within 21.06 later

@pxLi
Copy link
Collaborator Author

pxLi commented May 31, 2021

confirmed we would support spark 312 in 21.06, revert commit 49464b6

@pxLi
Copy link
Collaborator Author

pxLi commented May 31, 2021

build

@pxLi pxLi added the documentation Improvements or additions to documentation label May 31, 2021
@pxLi pxLi merged commit d3321f8 into NVIDIA:branch-21.06 May 31, 2021
@pxLi pxLi linked an issue May 31, 2021 that may be closed by this pull request
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* update spark shims to 3.1.2 and 3.1.3-SNAPSHOT

Signed-off-by: Peixin Li <pxli@nyu.edu>

* dep update

* add premerge 313 test

* move spark312 to snapshot-shim

* Revert "move spark312 to snapshot-shim"

This reverts commit 49464b6.
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* update spark shims to 3.1.2 and 3.1.3-SNAPSHOT

Signed-off-by: Peixin Li <pxli@nyu.edu>

* dep update

* add premerge 313 test

* move spark312 to snapshot-shim

* Revert "move spark312 to snapshot-shim"

This reverts commit 49464b6.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] Support Spark 3.1.2
3 participants