-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Reduce compile time of DataFusion? #348
Comments
FWIW, a full release build after |
|
Being spoiled by Golang, I have to say it's relatively slow to the extend where i had to switch to do something else to wait for the build whenever I needed to test a change, even if it's just a single line. |
I have a coworker reports that they can't work on datafusion with a mac mini with 8GB of RAM due to It would be great to make this better somehow. |
I ran the following to see where the time was going in my normal development loop:
And the output was instructive. Specifically it seems to take 28.6 seconds to compile the actual datafusion crate, but a whopping 65.6s to compile the tests (aka
|
We bave broken the main datafusion crates up substantially since this ticket was filed. I think it is no longer specifically actionable, so closing it Not that we can't improve compile time more, of course, just let's file tickets for more specific new symptoms |
During development of DataFusion I am getting a compile time that is hurting development. I am not sure if other feel the same, and I would like to gauge this here.
I admit I do not have a great machine, but I wonder if other also feel some pain in this front.
Note that this is unrelated with the dependencies; it is e.g. when changing a single physical node.
The text was updated successfully, but these errors were encountered: