You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
This is a long-term goal and not possible to do today but I think it would be good to improve the separation between planning and execution over time.
Users who just want to use DataFusion for query planning would be able to add a dependency on datafusion-sql.
Describe the solution you'd like
I would like the ability to have projects just depend on datafusion-sql if they are using DataFusion as a SQL parser + query planner and are not using it for execution.
Possible steps towards doing this:
Move ExpressionVisitor and exprlist_to_columns from optimizer module to datafusion-expr crate
Move expand_wildcard and expand_qualified_wildcard from builder to expr
Move/copy TableReference from catalog to `sql or a common crate
SQL planner needs to stop using LogicalPlanBuilder (which depends on datasource and physical plan and also is not CTE-aware) - or we need to move LogicalPlanBuilder to expr, but it depends on datasource + physical plan
Describe alternatives you've considered
None
Additional context
None
The text was updated successfully, but these errors were encountered:
andygrove
changed the title
Move logical query planning and optimization to new crate
Move logical query planning and optimization to new crate(s)
May 15, 2022
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
This is a long-term goal and not possible to do today but I think it would be good to improve the separation between planning and execution over time.
Users who just want to use DataFusion for query planning would be able to add a dependency on
datafusion-sql
.Describe the solution you'd like
I would like the ability to have projects just depend on
datafusion-sql
if they are using DataFusion as a SQL parser + query planner and are not using it for execution.Possible steps towards doing this:
ExpressionVisitor
andexprlist_to_columns
from optimizer module todatafusion-expr
crateexpand_wildcard
andexpand_qualified_wildcard
from builder to exprTableReference
fromcatalog
to `sql or a common crateLogicalPlanBuilder
(which depends ondatasource
and physical plan and also is not CTE-aware) - or we need to moveLogicalPlanBuilder
toexpr
, but it depends on datasource + physical planDescribe alternatives you've considered
None
Additional context
None
The text was updated successfully, but these errors were encountered: