Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[llvm] Fix the number of runtime observations in reward reset. #761

Closed

Conversation

ChrisCummins
Copy link
Contributor

@ChrisCummins ChrisCummins commented Aug 22, 2022

This adds a resend_on_reset flag to the send_params() method that
enables parameters to be resent immediately after a service is
reset. This is required by the LLVM environment to ensure that the
runtime observation parameters are sent before the reward space is
reset.

Fixes #756.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 22, 2022
@codecov-commenter
Copy link

codecov-commenter commented Aug 22, 2022

Codecov Report

Merging #761 (a364852) into development (1c40e5b) will decrease coverage by 33.55%.
The diff coverage is 50.00%.

Impacted file tree graph

@@               Coverage Diff                @@
##           development     #761       +/-   ##
================================================
- Coverage        89.28%   55.72%   -33.56%     
================================================
  Files              130      130               
  Lines             7912     7917        +5     
================================================
- Hits              7064     4412     -2652     
- Misses             848     3505     +2657     
Impacted Files Coverage Δ
compiler_gym/envs/llvm/llvm_env.py 46.10% <22.22%> (-45.56%) ⬇️
...ompiler_gym/service/client_service_compiler_env.py 74.42% <77.77%> (-16.45%) ⬇️
compiler_gym/util/permutation.py 0.00% <0.00%> (-100.00%) ⬇️
compiler_gym/leaderboard/__init__.py 0.00% <0.00%> (-100.00%) ⬇️
compiler_gym/service/runtime/__init__.py 0.00% <0.00%> (-100.00%) ⬇️
compiler_gym/service/runtime/benchmark_cache.py 0.00% <0.00%> (-100.00%) ⬇️
...mpiler_gym/service/runtime/compiler_gym_service.py 0.00% <0.00%> (-100.00%) ⬇️
...ice/runtime/create_and_run_compiler_gym_service.py 0.00% <0.00%> (-100.00%) ⬇️
compiler_gym/envs/gcc/service/gcc_service.py 0.00% <0.00%> (-95.98%) ⬇️
compiler_gym/leaderboard/llvm_instcount.py 0.00% <0.00%> (-92.79%) ⬇️
... and 81 more

This adds a `resend_on_reset` flag to the `send_params()` method that
enables parameters to be resent immediately after a service is
reset. This is required by the LLVM environment to ensure that the
runtime observation parameters are sent before the reward space is
reset.

Fixes facebookresearch#756.
@ChrisCummins ChrisCummins changed the title [tests] Add a unit test to repro #756. [llvm] Fix the number of runtime observations in reward reset. Aug 22, 2022
@ChrisCummins
Copy link
Contributor Author

cc @lqwk, patch posted. I'll merge once tests pass.

Cheers,
Chris

@lqwk
Copy link
Contributor

lqwk commented Aug 23, 2022

@ChrisCummins thanks for the fix!

@ChrisCummins
Copy link
Contributor Author

Merged via #767.

@ChrisCummins ChrisCummins mentioned this pull request Nov 1, 2022
@ChrisCummins ChrisCummins mentioned this pull request Nov 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Issue with runtime_observation_count
4 participants