Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write architecture overview guide: #4990

Closed
alamb opened this issue Jan 19, 2023 · 2 comments
Closed

Write architecture overview guide: #4990

alamb opened this issue Jan 19, 2023 · 2 comments
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@alamb
Copy link
Contributor

alamb commented Jan 19, 2023

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

I would like to continue to grow / scale the community of users and contributors to DataFusion and part doing so is to help them both:

  1. Get up to speed contributing quickly
  2. Quickly determine if DataFusion has the appropriate architecture for their needs

I do not think the current architecture docs https://github.com/apache/arrow-datafusion#architecture-overview are sufficient for this case

Describe the solution you'd like
I would like a high level writeup of the architecture . It will be a balancing act to describe the architecture in enough detail to be helpful but not so detailed that it get out of date quickly.

Describe alternatives you've considered

Additional context
@xudong963 mentioned this in #980 as well

@alamb alamb added the enhancement New feature or request label Jan 19, 2023
@alamb
Copy link
Contributor Author

alamb commented Jan 19, 2023

THe kind of outline I was thinking was:

Expr

LogicalPlan

PhysicalPlan

PhysicalExpr

Execution Model (aka document the ExecutionPlan API)

Testing

@xudong963 xudong963 added the documentation Improvements or additions to documentation label Jan 20, 2023
@alamb
Copy link
Contributor Author

alamb commented Apr 8, 2023

This is covered by #5501 I think , closing this as a dupe

@alamb alamb closed this as completed Apr 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants