Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add getOrcSchemaString for OrcShims [databricks] #5066

Merged
merged 2 commits into from
Mar 28, 2022

Conversation

wbo4958
Copy link
Collaborator

@wbo4958 wbo4958 commented Mar 28, 2022

To fix #5065. The newest spark 3.3.0 snapshot has changed the orcTypeDescriptionString to getOrcSchemaString. This PR adds shims for it

Signed-off-by: Bobby Wang wbo4958@gmail.com

Signed-off-by: Bobby Wang <wbo4958@gmail.com>
@wbo4958 wbo4958 requested a review from res-life March 28, 2022 02:45
@wbo4958
Copy link
Collaborator Author

wbo4958 commented Mar 28, 2022

build

@pxLi pxLi added the bug Something isn't working label Mar 28, 2022
@wbo4958
Copy link
Collaborator Author

wbo4958 commented Mar 28, 2022

build

Copy link
Collaborator

@firestarman firestarman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM except one nit.

* See the License for the specific language governing permissions and
* limitations under the License.
*/
package com.nvidia.spark.rapids.shims
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NIT:
I saw you intentionally add a space line between the header comment and the package declaration in file OrcShims320untilAllBase.scala.
However the space line is missing here.

@wbo4958 wbo4958 merged commit 0063053 into NVIDIA:branch-22.04 Mar 28, 2022
@wbo4958 wbo4958 deleted the orc-issue branch March 28, 2022 08:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] spark330+ build error due to SPARK-37463
3 participants