Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert shared class list modifications in PR#3545 #3587

Merged

Conversation

gerashegalov
Copy link
Collaborator

@gerashegalov gerashegalov commented Sep 21, 2021

Fixes #3580

Classes in unshimmed-common-from-spark301.txt should be bitwise
identical to the same named class files in other shim jars such as spark320. However, this is assumption is violated by the fact that
ProxyRapidsShuffleInternalManagerBase inhertis from Spark's
ShuffleManager affecting the bytecode generated by the compiler.

The root cause of the bug will be addressed in follow up PRs.

Signed-off-by: Gera Shegalov gera@apache.org

Fixes NVIDIA#3580

Classes in unshimmed-common-from-spark301.txt should be bitwise
identical but this is assumption is violated by the fact that
ProxyRapidsShuffleInternalManagerBase inhertis from Spark's
ShuffleManager affecting the bytecode generated by the compiler.

The root cause of the bug will be addressed in follow up PRs.

Signed-off-by: Gera Shegalov <gera@apache.org>
@gerashegalov gerashegalov self-assigned this Sep 21, 2021
@gerashegalov gerashegalov added the build Related to CI / CD or cleanly building label Sep 21, 2021
@gerashegalov gerashegalov added this to the Sep 13 - Sep 24 milestone Sep 21, 2021
@gerashegalov
Copy link
Collaborator Author

build

@gerashegalov gerashegalov merged commit 4b082cf into NVIDIA:branch-21.10 Sep 21, 2021
@gerashegalov gerashegalov deleted the revertUnshimmedListChanges branch September 21, 2021 23:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Class deduplication pulls wrong class for ProxyRapidsShuffleInternalManagerBase
2 participants