Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Validity compute functions #134

Closed
zeroshade opened this issue Sep 22, 2024 · 1 comment
Closed

Add Validity compute functions #134

zeroshade opened this issue Sep 22, 2024 · 1 comment
Milestone

Comments

@zeroshade
Copy link
Member

We should add the validity compute methods such as IsNull, IsNotNull and IsNaN to our implemented functions, along with the corresponding mappings for substrait expressions.

zeroshade added a commit to zeroshade/arrow-go that referenced this issue Sep 22, 2024
zeroshade added a commit that referenced this issue Sep 25, 2024
Adding `is_null`, `is_not_null`, and `is_nan` functions and tests to the
Compute implementations for Go.

This also removes the `-ffast-math` option from the SIMD optimized
compiler Makefile so that our comparisons properly handle `NaN` values
(`-ffast-math` assumes that no values are `NaN` and removes the checks).
`is_nan` can be easily implemented for float and double values by
dispatching to `A != A`.

Tests are also added for the new functions.

Ultimately the driving force behind this is as these are necessary for
implementing scanning reads in iceberg-go

---------

Co-authored-by: Sutou Kouhei <kou@clear-code.com>
@zeroshade
Copy link
Member Author

Closed by #135

@zeroshade zeroshade added this to the 18.0.0 milestone Oct 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant