Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

merge main to randomnet #12078

Merged
merged 29 commits into from
Feb 16, 2024
Merged

merge main to randomnet #12078

merged 29 commits into from
Feb 16, 2024

Conversation

zjma
Copy link
Contributor

@zjma zjma commented Feb 16, 2024

Description

Test Plan

igor-aptos and others added 26 commits February 14, 2024 23:47
…esign the db read (#11793)

* separate indexer async v2 db from aptosdb

* address comments

* add utils for table info backup and restore and redesign the db read

* address comments to spawn block sync file ops

* address comments
* [move-vm] Cache verified modules

* fixup! [move-vm] Cache verified modules
* [passkey] Add MAX_BYTES limit for signatures

* [passkey] Add tracing for AssertionSignature type and fix README

* [passkey] Rebased on latest main, rerun authenticator_regenerate.sh
* rename RG split in VmChangeSet flag

old name was stale, when charging was different
* [fuzzing] fixes oss-fuzz FP and fuzz.sh
Co-authored-by: sionescu <sionescu@users.noreply.github.com>
* Update release.yaml

* enable REFUNDABLE_BYTES

* enable FairnessShuffler

* enable WEBAUTHN_SIGNATURE

* AIP-54 Object Code Deployment release addition

* enable vtxn and jwk consensus

* Update release.yaml

adding aggregators v2 flags, and updating execution onchain config

* add feature flag for zkID (ZK-only mode)

* fix jwk/zkid entries in release yaml 1.10 (#12024)

* update

* update

* Update release.yaml

fix flag name

* Update release.yaml

rename feature

---------

Co-authored-by: aldenhu <msmouse@gmail.com>
Co-authored-by: hariria <hariria@usc.edu>
Co-authored-by: John Chang <johnchang9094@gmail.com>
Co-authored-by: danielxiangzl <xiangzhuolun@gmail.com>
Co-authored-by: igor-aptos <110557261+igor-aptos@users.noreply.github.com>
Co-authored-by: Alin Tomescu <tomescu.alin@gmail.com>
Co-authored-by: zhoujunma <zjma@users.noreply.github.com>
* [gas] add gas charges for type creation

* [gas-calibration] Add calibration sample

* [move-vm] Implement a per-frame cache for paranoid mode

* fixup! [move-vm] Implement a per-frame cache for paranoid mode

* fixup! fixup! [move-vm] Implement a per-frame cache for paranoid mode

* fixup! fixup! fixup! [move-vm] Implement a per-frame cache for paranoid mode

* fixup! fixup! fixup! fixup! [move-vm] Implement a per-frame cache for paranoid mode

* [gas] add gas charges for dependencies

---------

Co-authored-by: Runtian Zhou <runtian@aptoslabs.com>
* fix the e2e localnet.

* fix the e2e localnet.
Also be conservative and leave legacy parameters in >14 versions for
now. Need to clean up after REFUNDABLE_BYTES feature is actually enabled
on all networks.
actions/checkout@v4 doesn't behave well if both a workflow and an
invoked action checkout the source code on top of each other.
* [consensus] check rpc epoch in epoch_manager
…y that code a bit, and improve diagnostics. (#11948)

* rust changes to move all visibility checking to AST and clean it up a bit
* change `Known attribute ... position` warning to a neater `Attribute .. position` warning
* add FunctionData id_loc to allow pointing at function name in declaration for more concise error messages. abstract messages a bit in function_checker
* add 'inlined from' labels to diagnostics with labels, fix bug in function_checker to enable post-inlining visibility checking
Copy link

trunk-io bot commented Feb 16, 2024

⏱️ 16h 49m total CI duration on this PR
Job Cumulative Duration Recent Runs
rust-smoke-coverage 3h 42m 🟩
rust-move-unit-coverage 1h 49m 🟩🟩
rust-smoke-tests 1h 48m 🟩🟩
rust-unit-tests 1h 29m 🟥🟥🟩
execution-performance / single-node-performance 1h 18m 🟩🟩🟩🟩
windows-build 1h 15m 🟥🟩🟩🟩🟩
rust-move-tests 1h 8m 🟩🟩🟩
rust-images / rust-all 45m 🟩🟩🟩
forge-e2e-test / forge 41m 🟩🟩🟩
forge-compat-test / forge 37m 🟩🟩🟩
cli-e2e-tests / run-cli-tests 27m 🟥🟥🟥
rust-lints 26m 🟥🟩🟩🟩
run-tests-main-branch 25m 🟥🟥🟥🟥
rust-unit-coverage 13m 🟥
check 13m 🟥🟩🟩🟩
check-dynamic-deps 11m 🟩🟩🟩🟩🟩
general-lints 9m 🟩🟩🟩🟩
indexer-grpc-e2e-tests / test-indexer-grpc-docker-compose 5m 🟥🟩🟥
node-api-compatibility-tests / node-api-compatibility-tests 3m 🟩🟩🟩
semgrep/ci 2m 🟩🟩🟩🟩🟩
file_change_determinator 45s 🟩🟩🟩🟩
file_change_determinator 45s 🟩🟩🟩🟩
file_change_determinator 44s 🟩🟩🟩🟩
execution-performance / file_change_determinator 41s 🟩🟩🟩🟩
permission-check 20s 🟩🟩🟩🟩🟩
permission-check 19s 🟩🟩🟩🟩🟩
permission-check 13s 🟩🟩🟩🟩🟩
permission-check 12s 🟩🟩🟩🟩
determine-docker-build-metadata 10s 🟩🟩🟩🟩
permission-check 10s 🟩🟩🟩🟩

🚨 1 job on the last run was significantly faster/slower than expected

Job Duration vs 7d avg Delta
cli-e2e-tests / run-cli-tests 10m 6m +47%

settingsfeedbackdocs ⋅ learn more about trunk.io

@zjma zjma marked this pull request as ready for review February 16, 2024 19:31

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link

codecov bot commented Feb 16, 2024

Codecov Report

Attention: 94 lines in your changes are missing coverage. Please review.

Comparison is base (b701c7d) 71.3% compared to head (fa66e2b) 69.9%.
Report is 157 commits behind head on randomnet.

Files Patch % Lines
types/src/dkg/real_dkg/rounding/mod.rs 0.0% 49 Missing ⚠️
...cached-packages/src/aptos_framework_sdk_builder.rs 57.1% 15 Missing ⚠️
...aptos-gas-schedule/src/gas_schedule/transaction.rs 0.0% 8 Missing ⚠️
...ove/move-vm/types/src/loaded_data/runtime_types.rs 94.7% 6 Missing ⚠️
aptos-move/framework/src/extended_checks.rs 42.8% 4 Missing ⚠️
aptos-move/block-executor/src/executor.rs 75.0% 3 Missing ⚠️
...arty/move/move-compiler/src/expansion/translate.rs 33.3% 2 Missing ⚠️
types/src/dkg/real_dkg/mod.rs 0.0% 2 Missing ⚠️
aptos-move/aptos-gas-meter/src/meter.rs 88.8% 1 Missing ⚠️
aptos-move/aptos-vm-types/src/resolver.rs 0.0% 1 Missing ⚠️
... and 3 more
Additional details and impacted files
@@             Coverage Diff              @@
##           randomnet   #12078     +/-   ##
============================================
- Coverage       71.3%    69.9%   -1.5%     
============================================
  Files            800      842     +42     
  Lines         183535   188575   +5040     
============================================
+ Hits          131043   131992    +949     
- Misses         52492    56583   +4091     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@sherry-x
Copy link
Contributor

should aim to redeploy randomnet once this merge?

@zjma
Copy link
Contributor Author

zjma commented Feb 16, 2024

should aim to redeploy randomnet once this merge?

we don't have to take the risk... but can try

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

✅ Forge suite compat success on aptos-node-v1.8.3 ==> fa66e2bec67679a43f93ebf8b5165a4c9c8d794c

Compatibility test results for aptos-node-v1.8.3 ==> fa66e2bec67679a43f93ebf8b5165a4c9c8d794c (PR)
1. Check liveness of validators at old version: aptos-node-v1.8.3
compatibility::simple-validator-upgrade::liveness-check : committed: 4960 txn/s, latency: 6637 ms, (p50: 6900 ms, p90: 9900 ms, p99: 11100 ms), latency samples: 183540
2. Upgrading first Validator to new version: fa66e2bec67679a43f93ebf8b5165a4c9c8d794c
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1766 txn/s, latency: 15796 ms, (p50: 19200 ms, p90: 22000 ms, p99: 22500 ms), latency samples: 91880
3. Upgrading rest of first batch to new version: fa66e2bec67679a43f93ebf8b5165a4c9c8d794c
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1768 txn/s, latency: 16480 ms, (p50: 19100 ms, p90: 22000 ms, p99: 22300 ms), latency samples: 88400
4. upgrading second batch to new version: fa66e2bec67679a43f93ebf8b5165a4c9c8d794c
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3651 txn/s, latency: 8771 ms, (p50: 9900 ms, p90: 12300 ms, p99: 12600 ms), latency samples: 142420
5. check swarm health
Compatibility test for aptos-node-v1.8.3 ==> fa66e2bec67679a43f93ebf8b5165a4c9c8d794c passed
Test Ok

Copy link
Contributor

✅ Forge suite realistic_env_max_load success on fa66e2bec67679a43f93ebf8b5165a4c9c8d794c

two traffics test: inner traffic : committed: 7380 txn/s, latency: 5189 ms, (p50: 4800 ms, p90: 6500 ms, p99: 12900 ms), latency samples: 3188320
two traffics test : committed: 100 txn/s, latency: 2388 ms, (p50: 2100 ms, p90: 2600 ms, p99: 9400 ms), latency samples: 1700
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.238, avg: 0.204", "QsPosToProposal: max: 0.299, avg: 0.173", "ConsensusProposalToOrdered: max: 0.625, avg: 0.561", "ConsensusOrderedToCommit: max: 0.528, avg: 0.497", "ConsensusProposalToCommit: max: 1.097, avg: 1.058"]
Max round gap was 1 [limit 4] at version 1505682. Max no progress secs was 4.618017 [limit 15] at version 1505682.
Test Ok

@danielxiangzl danielxiangzl merged commit 1d73b64 into randomnet Feb 16, 2024
45 of 47 checks passed
@danielxiangzl danielxiangzl deleted the zjma/merge_main_to_randomnet branch February 16, 2024 22:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.