Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark2 module upmerge, deploy script, and updates for Jenkins #4585

Merged
merged 6 commits into from
Jan 21, 2022

Conversation

tgravescs
Copy link
Collaborator

Upmerge spark2 module to latest, pulls changes from:
0d236d8

Update the deploy script to deploy the new spark2 jar. Unfortunately I haven't tested them because the test deploy build is failing for something different, working with @NvTimLiu

Added some docs to the script for developers to give them an idea on how to deal with it.

Update the diff script to error out properly only when actual diff in diff files.
Changed the aggregate diff to not use git so we could more easily run from jenkins build.

fixes #4360

@tgravescs tgravescs added the build Related to CI / CD or cleanly building label Jan 20, 2022
@tgravescs tgravescs added this to the Jan 10 - Jan 28 milestone Jan 20, 2022
@tgravescs tgravescs self-assigned this Jan 20, 2022
@tgravescs
Copy link
Collaborator Author

build

scripts/rundiffspark2.sh Outdated Show resolved Hide resolved
Co-authored-by: Jason Lowe <jlowe@nvidia.com>
@tgravescs
Copy link
Collaborator Author

build

@tgravescs tgravescs merged commit 93d73e2 into NVIDIA:branch-22.02 Jan 21, 2022
@tgravescs tgravescs deleted the spark2upmerge branch January 21, 2022 01:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] Add explain api for Spark 2.X
2 participants