Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(runtime): update weights #4245

Merged
merged 5 commits into from
Sep 23, 2024
Merged

chore(runtime): update weights #4245

merged 5 commits into from
Sep 23, 2024

Conversation

github-actions[bot]
Copy link
Contributor

run_all_benchmarks.sh script is applied to update weights (branch: master, commit 5536e04)
Note: If CI fails, try manually updating the heuristic tests: runtime/vara/src/tests.rs

@github-actions github-actions bot added A0-pleasereview PR is ready to be reviewed by the team A4-insubstantial Not too important PR labels Sep 20, 2024
@breathx breathx added A2-mergeoncegreen PR is ready to merge after CI passes and removed A0-pleasereview PR is ready to be reviewed by the team labels Sep 20, 2024
@breathx
Copy link
Member

breathx commented Sep 23, 2024

Comparison table for Vara runtime for Instruction

name master weights/patch-5536e04 diff
i64const 186 ps 159 ps -16.98%
i64load 5.8 ns 6.9 ns +14.80%
i32load 5.8 ns 6.7 ns +13.62%
i64store 10.1 ns 9.9 ns -1.65%
i32store 11.0 ns 11.0 ns -0.03%
select 6.1 ns 6.1 ns +0.26%
if 4.9 ns 4.7 ns -4.25%
br 3.3 ns 3.3 ns -0.33%
br_if 5.4 ns 5.3 ns -1.11%
br_table 10.3 ns 10.3 ns -0.56%
br_table_per_entry 162 ps 136 ps -19.12%
call 4.7 ns 4.7 ns +0.34%
call_indirect 21.4 ns 21.9 ns +1.93%
call_indirect_per_param 1.3 ns 1.3 ns +0.00%
call_per_local 0 ps 0 ps N/A
local_get 682 ps 637 ps -7.06%
local_set 1.3 ns 1.3 ns -1.23%
local_tee 1.3 ns 1.3 ns -0.39%
global_get 642 ps 596 ps -7.72%
global_set 1.2 ns 1.1 ns -13.41%
memory_current 12.4 ns 12.5 ns +0.46%
i64clz 386 ps 382 ps -1.05%
i32clz 258 ps 250 ps -3.20%
i64ctz 404 ps 422 ps +4.27%
i32ctz 210 ps 219 ps +4.11%
i64popcnt 406 ps 377 ps -7.69%
i32popcnt 244 ps 241 ps -1.24%
i64eqz 1.8 ns 1.7 ns -5.14%
i32eqz 907 ps 1.0 ns +12.11%
i32extend8s 191 ps 196 ps +2.55%
i32extend16s 188 ps 210 ps +10.48%
i64extend8s 352 ps 344 ps -2.33%
i64extend16s 377 ps 362 ps -4.14%
i64extend32s 368 ps 339 ps -8.55%
i64extendsi32 154 ps 162 ps +4.94%
i64extendui32 205 ps 181 ps -13.26%
i32wrapi64 192 ps 183 ps -4.92%
i64eq 1.8 ns 1.6 ns -14.15%
i32eq 1.0 ns 1.0 ns +0.20%
i64ne 2.2 ns 1.6 ns -38.40%
i32ne 1.1 ns 891 ps -20.65%
i64lts 1.6 ns 1.6 ns -1.86%
i32lts 941 ps 917 ps -2.62%
i64ltu 1.6 ns 1.8 ns +9.04%
i32ltu 960 ps 869 ps -10.47%
i64gts 1.7 ns 1.6 ns -8.12%
i32gts 975 ps 965 ps -1.04%
i64gtu 1.6 ns 2.0 ns +19.07%
i32gtu 916 ps 986 ps +7.10%
i64les 1.6 ns 1.9 ns +15.57%
i32les 960 ps 1.2 ns +20.66%
i64leu 1.7 ns 1.8 ns +2.61%
i32leu 887 ps 964 ps +7.99%
i64ges 1.9 ns 1.7 ns -9.89%
i32ges 917 ps 973 ps +5.76%
i64geu 1.8 ns 1.6 ns -17.40%
i32geu 913 ps 899 ps -1.56%
i64add 924 ps 916 ps -0.87%
i32add 526 ps 447 ps -17.67%
i64sub 904 ps 856 ps -5.61%
i32sub 416 ps 435 ps +4.37%
i64mul 1.7 ns 1.4 ns -17.69%
i32mul 839 ps 807 ps -3.97%
i64divs 3.9 ns 3.4 ns -15.94%
i32divs 2.8 ns 2.5 ns -14.70%
i64divu 3.5 ns 3.6 ns +1.31%
i32divu 2.6 ns 2.5 ns -4.39%
i64rems 18.9 ns 19.0 ns +0.61%
i32rems 15.3 ns 15.5 ns +1.65%
i64remu 3.5 ns 3.8 ns +7.64%
i32remu 2.5 ns 2.3 ns -9.64%
i64and 1000 ps 954 ps -4.82%
i32and 483 ps 531 ps +9.04%
i64or 924 ps 851 ps -8.58%
i32or 480 ps 447 ps -7.38%
i64xor 969 ps 874 ps -10.87%
i32xor 531 ps 494 ps -7.49%
i64shl 741 ps 778 ps +4.76%
i32shl 231 ps 215 ps -7.44%
i64shrs 692 ps 659 ps -5.01%
i32shrs 233 ps 218 ps -6.88%
i64shru 766 ps 709 ps -8.04%
i32shru 312 ps 280 ps -11.43%
i64rotl 749 ps 735 ps -1.90%
i32rotl 338 ps 222 ps -52.25%
i64rotr 724 ps 719 ps -0.70%
i32rotr 306 ps 248 ps -23.39%

Comparison table for Vara runtime for HostFn

name master weights/patch-5536e04 diff
alloc 1.6 µs 1.5 µs -3.72%
free 868.5 ns 898.5 ns +3.34%
free_range 919.8 ns 950.6 ns +3.24%
free_range_per_page 37.9 ns 37.7 ns -0.50%
gr_reserve_gas 2.2 µs 2.3 µs +5.59%
gr_unreserve_gas 2.2 µs 2.4 µs +6.43%
gr_system_reserve_gas 1.0 µs 1.2 µs +15.46%
gr_gas_available 902.4 ns 1.1 µs +14.59%
gr_message_id 902.7 ns 1.1 µs +15.13%
gr_program_id 900.4 ns 1.1 µs +16.83%
gr_source 908.1 ns 1.1 µs +15.52%
gr_value 904.2 ns 1.1 µs +17.44%
gr_value_available 902.5 ns 1.1 µs +15.98%
gr_size 897.6 ns 1.1 µs +16.66%
gr_read 1.7 µs 1.9 µs +12.71%
gr_read_per_byte 197 ps 199 ps +1.01%
gr_env_vars 1.0 µs 1.2 µs +14.79%
gr_block_height 979.7 ns 1.1 µs +8.49%
gr_block_timestamp 893.8 ns 1.1 µs +16.65%
gr_random 1.9 µs 2.1 µs +9.83%
gr_reply_deposit 4.9 µs 5.3 µs +7.04%
gr_send 3.0 µs 3.0 µs +1.27%
gr_send_per_byte 492 ps 526 ps +6.46%
gr_send_wgas 3.0 µs 3.1 µs +1.80%
gr_send_wgas_per_byte 492 ps 523 ps +5.93%
gr_send_init 1.1 µs 1.2 µs +7.93%
gr_send_push 1.9 µs 2.2 µs +11.13%
gr_send_push_per_byte 492 ps 523 ps +5.93%
gr_send_commit 2.5 µs 2.5 µs +1.32%
gr_send_commit_wgas 2.5 µs 2.6 µs +3.19%
gr_reservation_send 3.4 µs 3.5 µs +3.60%
gr_reservation_send_per_byte 493 ps 523 ps +5.74%
gr_reservation_send_commit 2.9 µs 3.1 µs +5.02%
gr_reply_commit 12.0 µs 11.1 µs -8.39%
gr_reply_commit_wgas 11.7 µs 11.5 µs -2.14%
gr_reservation_reply 8.5 µs 8.5 µs +0.31%
gr_reservation_reply_per_byte 720.4 ns 691.3 ns -4.21%
gr_reservation_reply_commit 8.3 µs 7.5 µs -10.49%
gr_reply_push 1.7 µs 1.8 µs +7.74%
gr_reply 12.5 µs 12.4 µs -0.91%
gr_reply_per_byte 711 ps 680 ps -4.56%
gr_reply_wgas 12.4 µs 12.1 µs -1.98%
gr_reply_wgas_per_byte 711 ps 681 ps -4.41%
gr_reply_push_per_byte 652 ps 681 ps +4.26%
gr_reply_to 947.6 ns 1.1 µs +12.94%
gr_signal_code 993.0 ns 1.1 µs +7.54%
gr_signal_from 951.0 ns 1.1 µs +12.64%
gr_reply_input 13.5 µs 20.8 µs +35.09%
gr_reply_input_wgas 8.1 µs 30.0 µs +72.86%
gr_reply_push_input 1.1 µs 1.3 µs +11.46%
gr_reply_push_input_per_byte 144 ps 109 ps -32.11%
gr_send_input 2.8 µs 2.9 µs +2.53%
gr_send_input_wgas 2.9 µs 3.0 µs +2.39%
gr_send_push_input 1.4 µs 1.6 µs +10.36%
gr_send_push_input_per_byte 161 ps 144 ps -11.81%
gr_debug 1.3 µs 1.3 µs +3.13%
gr_debug_per_byte 438 ps 496 ps +11.69%
gr_reply_code 901.0 ns 1.1 µs +15.75%
gr_exit 18.1 µs 17.8 µs -1.97%
gr_leave 13.8 µs 13.6 µs -1.87%
gr_wait 13.8 µs 12.8 µs -7.65%
gr_wait_for 13.6 µs 14.7 µs +7.38%
gr_wait_up_to 14.4 µs 14.4 µs -0.07%
gr_wake 3.0 µs 3.3 µs +8.78%
gr_create_program 3.7 µs 3.7 µs +0.64%
gr_create_program_payload_per_byte 116 ps 131 ps +11.45%
gr_create_program_salt_per_byte 1.4 ns 1.4 ns +1.54%
gr_create_program_wgas 3.8 µs 3.8 µs +0.18%
gr_create_program_wgas_payload_per_byte 114 ps 129 ps +11.63%
gr_create_program_wgas_salt_per_byte 1.4 ns 1.4 ns +2.44%

Comparison table for Vara runtime for Memory

name master weights/patch-5536e04 diff
lazy_pages_signal_read 28.4 µs 28.4 µs +0.14%
lazy_pages_signal_write 34.1 µs 35.1 µs +2.72%
lazy_pages_signal_write_after_read 9.1 µs 10.0 µs +8.80%
lazy_pages_host_func_read 29.9 µs 29.8 µs -0.50%
lazy_pages_host_func_write 36.7 µs 37.3 µs +1.77%
lazy_pages_host_func_write_after_read 11.8 µs 12.4 µs +4.86%
load_page_data 9.2 µs 9.0 µs -1.94%
upload_page_data 103.8 µs 103.3 µs -0.50%
mem_grow 858.9 ns 836.4 ns -2.69%
mem_grow_per_page 0 ps 0 ps N/A
parachain_read_heuristic 0 ps 0 ps N/A

@breathx breathx merged commit 75362b0 into master Sep 23, 2024
10 checks passed
@breathx breathx deleted the weights/patch-5536e04 branch September 23, 2024 13:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A2-mergeoncegreen PR is ready to merge after CI passes A4-insubstantial Not too important PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant