Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RemoteExecutionService: fix outputs not being uploaded #15823

Closed

Conversation

sluongng
Copy link
Contributor

@sluongng sluongng commented Jul 6, 2022

In 4d900ce we introduced validation in
DiskAndRemoteCacheClient.uploadActionResult() where context's step must
be UPLOAD_OUTPUTS to trigger the upload.

However, this value was never set in RemoteExecutionService before hand
thus led to outputs not being uploaded and cause remote cache misses.

Fix #15682

Thanks @adam-singer for doing the investigation 🙏

@sluongng sluongng requested a review from a team as a code owner July 6, 2022 15:22
@coeuvre
Copy link
Member

coeuvre commented Jul 6, 2022

Good catch! Can you please also add an integration test for this case so we won't break combined cache again in the future?

@fmeum
Copy link
Collaborator

fmeum commented Jul 6, 2022

@bazel-io flag

@bazel-io bazel-io added the potential release blocker Flagged by community members using "@bazel-io flag". Should be added to a release blocker milestone label Jul 6, 2022
@sluongng
Copy link
Contributor Author

sluongng commented Jul 7, 2022

CI passed

@coeuvre PTAL

Copy link
Member

@coeuvre coeuvre left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! I will import it after the comment is addressed.

src/test/shell/bazel/remote/remote_execution_test.sh Outdated Show resolved Hide resolved
In 4d900ce we introduced validation in
DiskAndRemoteCacheClient.uploadActionResult() where context's step must
be UPLOAD_OUTPUTS to trigger the upload.

However, this value was never set in RemoteExecutionService before hand
thus led to outputs not being uploaded and cause remote cache misses.

Fix bazelbuild#15682
@ckolli5
Copy link

ckolli5 commented Jul 7, 2022

@bazel-io fork 5.3.0

@bazel-io bazel-io removed the potential release blocker Flagged by community members using "@bazel-io flag". Should be added to a release blocker milestone label Jul 7, 2022
@copybara-service copybara-service bot closed this in d35f923 Jul 7, 2022
@sluongng sluongng deleted the sluongng/remote-cache-fix branch July 7, 2022 17:03
aranguyen pushed a commit to aranguyen/bazel that referenced this pull request Jul 20, 2022
In 4d900ce we introduced validation in
DiskAndRemoteCacheClient.uploadActionResult() where context's step must
be UPLOAD_OUTPUTS to trigger the upload.

However, this value was never set in RemoteExecutionService before hand
thus led to outputs not being uploaded and cause remote cache misses.

Fix bazelbuild#15682

Thanks @adam-singer for doing the investigation 🙏

Closes bazelbuild#15823.

PiperOrigin-RevId: 459519852
Change-Id: Ib004403d7893fe135adcc4b181b607d8cb33f3af
aranguyen pushed a commit to aranguyen/bazel that referenced this pull request Jul 20, 2022
In 4d900ce we introduced validation in
DiskAndRemoteCacheClient.uploadActionResult() where context's step must
be UPLOAD_OUTPUTS to trigger the upload.

However, this value was never set in RemoteExecutionService before hand
thus led to outputs not being uploaded and cause remote cache misses.

Fix bazelbuild#15682

Thanks @adam-singer for doing the investigation 🙏

Closes bazelbuild#15823.

PiperOrigin-RevId: 459519852
Change-Id: Ib004403d7893fe135adcc4b181b607d8cb33f3af
@ShreeM01 ShreeM01 removed the awaiting-review PR is awaiting review from an assigned reviewer label Sep 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
team-Remote-Exec Issues and PRs for the Execution (Remote) team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remote-cache not work in 5.2.0
6 participants