-
Notifications
You must be signed in to change notification settings - Fork 237
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Apache Spark 3.1.4-SNAPSHOT Shims #4861
Conversation
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
@tgravescs Could you please let me know the priority of this over #4857. I can wait until that PR is merged and upmerge my changes to reflect the new design. If we want to enable 3.1.4-SNAPSHOT nightly builds sooner then I think this should be merged earlier. |
either way, I think 3.1.4 can wait if the other PR is large |
Thanks for the confirmation. Have marked this PR as draft. Will upmerge once other PR is merged. |
Thanks @nartal1 |
@nartal1 please update, the other pr has been merged |
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
build |
sql-plugin/src/test/314/scala/com/nvidia/spark/rapids/shims/spark314/Spark314ShimsSuite.scala
Outdated
Show resolved
Hide resolved
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
Signed-off-by: Niranjan Artal <nartal@nvidia.com>
build |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We need to get integration test pipeline going for this.
This fixes #4789.
This PR adds Spark-3.1.4-SNAPSHOT shims. Added test to verify that it works as expected.