You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
arrow-rs is supporting new StringViewArray type (apache/arrow-rs#5374), which is likely to achieve better performance by reducing large memcpys.
Describe the solution you'd like
supports StringView basics like hashing, serialization.
supports StringView in methods inside datafusion-ext-functions.
test/benchmark.
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered:
FWIW I think the main usecases where StringView will Significantly help are:
Low selectivity filters (where most values are not filtered) on string columns
String manipulation functions (like substr) where the output can be calculated by changing the views rather than the underlying string values.
If you are interested and willing to help, getting StringViewArray support into the DataFusion expression evaluator (especially for filtering) would be a huge help
Is your feature request related to a problem? Please describe.
arrow-rs is supporting new
StringViewArray
type (apache/arrow-rs#5374), which is likely to achieve better performance by reducing large memcpys.Describe the solution you'd like
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: