-
Notifications
You must be signed in to change notification settings - Fork 237
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support running GetArrayStructFields
on GPU[databricks]
#4875
Conversation
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
GetArrayStructFields
on GPUGetArrayStructFields
on GPU[databricks]
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
build |
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The code looks great I just had one small nit I can live without.
structView.getChildColumnView(ordinal) | ||
} | ||
val listView = withResource(fieldView) { _ => | ||
new ColumnView(DType.LIST, base.getRowCount, Optional.of[java.lang.Long](base.getNullCount), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: Could you use GpuListUtils.replaceListDataColumnAsView
instead? It does the same thing, but adds a few more checks, and would make more of this kind of scary code common.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good to know this.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
build |
1 similar comment
build |
#4881 is to fix the build error in premerge. |
build |
This PR is adding the support of running
GetArrayStructFields
on GPU, along with the relevant tests.closes #4816
Signed-off-by: Firestarman firestarmanllc@gmail.com