Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable crossplatform speculation of requests and their inputs. #8353

Open
Tracked by #17355
hrfuller opened this issue Sep 27, 2019 · 2 comments
Open
Tracked by #17355

Enable crossplatform speculation of requests and their inputs. #8353

hrfuller opened this issue Sep 27, 2019 · 2 comments

Comments

@hrfuller
Copy link
Member

As follow up work to #8090 we want to improve concurrency of multi-platform request speculation. Requests configured for different platforms may well have dependencies on different inputs, platform specific compiler binaries for instance. In situation like this the time needed to build the input binaries could vary greatly, say if one was cached while the other needed to be generated. In our current model of speculation all inputs to a rule would have to complete before speculation could begin. We would like to create a new syntax for declaring process requests and their input_files so that request speculation time can include the time needed to generate inputs. This probably relates to being able to push multiple params into the build graph with one Get (#7490)

@stuhood
Copy link
Member

stuhood commented Oct 4, 2022

This was designed in https://docs.google.com/document/d/1hS0n6vp-hBxy4Xo-q9QA_elofzQtOubjfN4nSeIgp90/edit: #11148 covers cross-platform remote execution without speculation, and will be closed soon via the environments work from #7735 and #13682.

@stuhood
Copy link
Member

stuhood commented Oct 27, 2022

Also relates to #16873, which is about platform-agnostic process outputs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants