Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Build failing for Spark 3.3.0 due to deprecated method warnings #4632

Closed
jlowe opened this issue Jan 26, 2022 · 0 comments · Fixed by #4633
Closed

[BUG] Build failing for Spark 3.3.0 due to deprecated method warnings #4632

jlowe opened this issue Jan 26, 2022 · 0 comments · Fixed by #4633
Assignees
@jlowe
Labels
bug Something isn't working build Related to CI / CD or cleanly building P0 Must have for release
Milestone
Jan 10 - Jan 28

Comments

@jlowe
Copy link
Member

jlowe commented Jan 26, 2022

Build is failing with this error:

[2022-01-26T17:01:13.488Z] [INFO] Compiling 247 Scala sources and 28 Java sources to /home/jenkins/agent/workspace/jenkins-rapids_nightly-pre_release-github-335/sql-plugin/target/spark330/classes ...
[2022-01-26T17:01:35.380Z] [ERROR] [Error] /home/jenkins/agent/workspace/jenkins-rapids_nightly-pre_release-github-335/sql-plugin/src/main/scala/org/apache/spark/sql/rapids/GpuFileFormatDataWriter.scala:128: method newTaskTempFile in class FileCommitProtocol is deprecated (since 3.3.0): use newTaskTempFile(..., spec: FileNameSpec) instead
[2022-01-26T17:01:35.380Z] [ERROR] [Error] /home/jenkins/agent/workspace/jenkins-rapids_nightly-pre_release-github-335/sql-plugin/src/main/scala/org/apache/spark/sql/rapids/GpuFileFormatDataWriter.scala:262: method newTaskTempFileAbsPath in class FileCommitProtocol is deprecated (since 3.3.0): use newTaskTempFileAbsPath(..., spec: FileNameSpec) instead
[2022-01-26T17:01:35.380Z] [ERROR] [Error] /home/jenkins/agent/workspace/jenkins-rapids_nightly-pre_release-github-335/sql-plugin/src/main/scala/org/apache/spark/sql/rapids/GpuFileFormatDataWriter.scala:264: method newTaskTempFile in class FileCommitProtocol is deprecated (since 3.3.0): use newTaskTempFile(..., spec: FileNameSpec) instead
[2022-01-26T17:01:35.380Z] [ERROR] three errors found

This was triggered by a recent change in Spark 3.3, see SPARK-38015
@jlowe jlowe added bug Something isn't working ? - Needs Triage Need team to review and classify labels Jan 26, 2022
@jlowe jlowe self-assigned this Jan 26, 2022
@jlowe jlowe added build Related to CI / CD or cleanly building P0 Must have for release and removed ? - Needs Triage Need team to review and classify labels Jan 26, 2022
@jlowe jlowe mentioned this issue Jan 26, 2022
Merged
@sameerz sameerz added this to the Jan 10 - Jan 28 milestone Jan 26, 2022
@jlowe jlowe closed this as completed Jan 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jlowe jlowe

Labels
bug Something isn't working build Related to CI / CD or cleanly building P0 Must have for release
Projects
None yet
Milestone
Jan 10 - Jan 28
Development

Successfully merging a pull request may close this issue.

Suppress newTaskTempFile method warnings for Spark 3.3.0 build jlowe/spark-rapids
2 participants
@jlowe @sameerz