-
Notifications
You must be signed in to change notification settings - Fork 237
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
support collect_set in rolling window #2548
support collect_set in rolling window #2548
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a few nits, but I don't think this is going to get in to 21.06 because it depends on things in cudf that are still pending, and cudf 21.06 is frozen. If we are going to keep this targeted here we are going to need @sameerz to work with the cudf team to get the remaining dependencies in.
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/AggregateFunctions.scala
Show resolved
Hide resolved
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/AggregateFunctions.scala
Show resolved
Hide resolved
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/AggregateFunctions.scala
Show resolved
Hide resolved
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/AggregateFunctions.scala
Show resolved
Hide resolved
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/AggregateFunctions.scala
Show resolved
Hide resolved
LGTM |
build |
build |
2 similar comments
build |
build |
build |
Signed-off-by: sperlingxx <lovedreamf@gmail.com>
Signed-off-by: sperlingxx <lovedreamf@gmail.com>
cacd764
to
bb09f6b
Compare
Signed-off-by: sperlingxx <lovedreamf@gmail.com>
build |
build |
This PR is to support
GpuCollectSet
as a rolling window aggregation function. It is marked as WIP because it relied on a cuDF fix.Signed-off-by: sperlingxx lovedreamf@gmail.com