-
Notifications
You must be signed in to change notification settings - Fork 912
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FEA] Return null for the row where null exists in starts
, or sizes
, or steps
#10012
Comments
We specifically chose not to emulate this behavior. This behavior can be emulated in the plugin by stripping nulls in the inputs and then ANDing the output with the original input null mask. |
Firstly, you do pre-processing in the plugin, computing the AND bitmask to find the null rows, and setting |
Thanks for the info. |
This issue has been labeled |
This issue has been labeled |
Closing based on discussion in #9839 |
#9839 has implemented the per-list sequence, but it will blow up when null exists in
starts
, orsizes
, orsteps
.Asking to return nulls silently instead (or can choose to return null) for this case is to align with the behavior of Spark. Spark will return nulls for rows that contain at least one
null
. For example,The text was updated successfully, but these errors were encountered: