You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I want to test out the parquet filter pushdown on real datasets using datafusion-cli so we can enable it by default -- #3463
To do so I want to both understand what the current setting of the pushdown flags are as well as change them statement by statement.
Describe the solution you'd like
Use the ConfigOptions to control parquet scanning options rather than anothr structure
Among other things that will allow the parquet settings to appear here as well as be controlled by environment variable in datafusion-cli.
It will also allow this feature to be turned off if we find an issue
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I want to test out the parquet filter pushdown on real datasets using datafusion-cli so we can enable it by default -- #3463
To do so I want to both understand what the current setting of the pushdown flags are as well as change them statement by statement.
Describe the solution you'd like
Use the
ConfigOptions
to control parquet scanning options rather than anothr structureAmong other things that will allow the parquet settings to appear here as well as be controlled by environment variable in datafusion-cli.
It will also allow this feature to be turned off if we find an issue
Describe alternatives you've considered
Can just do it programmatically
Additional context
See #3463
The text was updated successfully, but these errors were encountered: