Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

randomness #1: types update from randomnet #12106

Merged
merged 5 commits into from
Feb 21, 2024
Merged

Conversation

zjma
Copy link
Contributor

@zjma zjma commented Feb 19, 2024

Description

Test Plan

Copy link

trunk-io bot commented Feb 19, 2024

⏱️ 20h 9m total CI duration on this PR
Job Cumulative Duration Recent Runs
rust-unit-coverage 4h 30m 🟩
rust-smoke-coverage 3h 12m 🟩
rust-unit-tests 2h 10m 🟩🟩🟩
rust-smoke-tests 2h 7m 🟩🟩🟩
windows-build 1h 45m 🟩🟩🟩🟩🟩
execution-performance / single-node-performance 1h 22m 🟩🟩🟩🟩
rust-images / rust-all 1h 18m 🟩🟩🟩
forge-compat-test / forge 42m 🟩🟩🟩
forge-e2e-test / forge 41m 🟩🟩🟩
rust-lints 33m 🟩🟩🟥🟩
run-tests-main-branch 32m 🟥🟥🟥🟥🟥
cli-e2e-tests / run-cli-tests 27m 🟥🟥🟥
check 16m 🟩🟩🟩🟩
check-dynamic-deps 9m 🟩🟩🟩🟩🟩
general-lints 9m 🟩🟩🟩🟩
indexer-grpc-e2e-tests / test-indexer-grpc-docker-compose 6m 🟩🟩🟩
node-api-compatibility-tests / node-api-compatibility-tests 2m 🟩🟩🟩
semgrep/ci 2m 🟩🟩🟩🟩🟩
file_change_determinator 54s 🟩🟩🟩🟩🟩
file_change_determinator 49s 🟩🟩🟩🟩🟩
file_change_determinator 46s 🟩🟩🟩🟩
execution-performance / file_change_determinator 40s 🟩🟩🟩🟩
permission-check 34s 🟩🟩🟩🟩🟩 (+1 more)
permission-check 16s 🟩🟩🟩🟩🟩
permission-check 16s 🟩🟩🟩🟩🟩 (+1 more)
permission-check 15s 🟩🟩🟩🟩🟩 (+1 more)
permission-check 13s 🟩🟩🟩🟩🟩 (+1 more)
determine-docker-build-metadata 12s 🟩🟩🟩🟩🟩
upload-to-codecov 12s 🟩

🚨 3 jobs on the last run were significantly faster/slower than expected

Job Duration vs 7d avg Delta
rust-unit-tests 50m 31m +60%
rust-smoke-tests 49m 31m +59%
rust-images / rust-all 19m 13m +47%

settingsfeedbackdocs ⋅ learn more about trunk.io

@zjma zjma added the CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR label Feb 19, 2024
@zjma zjma marked this pull request as ready for review February 19, 2024 22:58

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

✅ Forge suite compat success on aptos-node-v1.9.5 ==> e63f53a674d6d309f3c6da91ab22b1bb43856f09

Compatibility test results for aptos-node-v1.9.5 ==> e63f53a674d6d309f3c6da91ab22b1bb43856f09 (PR)
1. Check liveness of validators at old version: aptos-node-v1.9.5
compatibility::simple-validator-upgrade::liveness-check : committed: 6754 txn/s, latency: 4947 ms, (p50: 4800 ms, p90: 8700 ms, p99: 9800 ms), latency samples: 236400
2. Upgrading first Validator to new version: e63f53a674d6d309f3c6da91ab22b1bb43856f09
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 615 txn/s, submitted: 650 txn/s, expired: 35 txn/s, latency: 36713 ms, (p50: 40400 ms, p90: 58800 ms, p99: 60300 ms), latency samples: 54177
3. Upgrading rest of first batch to new version: e63f53a674d6d309f3c6da91ab22b1bb43856f09
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 186 txn/s, submitted: 483 txn/s, expired: 297 txn/s, latency: 45305 ms, (p50: 39200 ms, p90: 53600 ms, p99: 67700 ms), latency samples: 15451
4. upgrading second batch to new version: e63f53a674d6d309f3c6da91ab22b1bb43856f09
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 2420 txn/s, latency: 12454 ms, (p50: 14600 ms, p90: 16000 ms, p99: 17100 ms), latency samples: 108900
5. check swarm health
Compatibility test for aptos-node-v1.9.5 ==> e63f53a674d6d309f3c6da91ab22b1bb43856f09 passed
Test Ok

Copy link
Contributor

✅ Forge suite realistic_env_max_load success on e63f53a674d6d309f3c6da91ab22b1bb43856f09

two traffics test: inner traffic : committed: 7278 txn/s, latency: 5390 ms, (p50: 5100 ms, p90: 6800 ms, p99: 11100 ms), latency samples: 3144200
two traffics test : committed: 100 txn/s, latency: 2264 ms, (p50: 2100 ms, p90: 2500 ms, p99: 7400 ms), latency samples: 1720
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.245, avg: 0.204", "QsPosToProposal: max: 0.418, avg: 0.378", "ConsensusProposalToOrdered: max: 0.596, avg: 0.566", "ConsensusOrderedToCommit: max: 0.479, avg: 0.452", "ConsensusProposalToCommit: max: 1.051, avg: 1.018"]
Max round gap was 1 [limit 4] at version 1287447. Max no progress secs was 5.019662 [limit 15] at version 1287447.
Test Ok

@zjma zjma changed the title types update from randomnet randomness #1: types update from randomnet Feb 21, 2024
@@ -1700,13 +1702,47 @@ impl AptosVM {
let mut session =
self.new_session(resolver, SessionId::block_meta_ext(&block_metadata_ext));

let args = serialize_values(&block_metadata_ext.get_prologue_ext_move_args());
let block_metadata_with_randomness = match block_metadata_ext {
BlockMetadataExt::V0(_) => unreachable!(),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why V0 exist but unreachable here?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 how to ensure this is unreachable?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i'm moving by crate by cate and this is ensured in a dependent crate.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm just want to make sure it is not an attack vector. But since blockmetadata is something locally added, I think it is fine.

@@ -115,6 +115,17 @@ impl Features {
self.features[byte_index] &= !bit_mask;
}

pub fn into_flag_vec(self) -> Vec<FeatureFlag> {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do we need this? didn't see it's used

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i'm moving by crate by cate and this is used in another crates.

@zjma zjma merged commit 6c7e9d4 into main Feb 21, 2024
41 of 42 checks passed
@zjma zjma deleted the zjma/types_update_from_randomnet branch February 21, 2024 20:41
zjma added a commit that referenced this pull request Feb 22, 2024
* Fix `iss`-related bug in Groth16 path & refactor (#12017)

Co-authored-by: Oliver <[email protected]>

* [aptosvm] Simplify VM flows (#11888)

* Duplicated logic for creating the gas meter for view functions has been removed.
* Duplicated logic for calculating gas used for view functions has been removed.
* There was unreachable code in failure transaction cleanup, where the discarded
status has been returned immediately, but then re-checked again. The first check
is shifted inside.
* No more default transaction metadata.
* Scripts are now validated consistently.
* Simplifies transaction execution function signature to avoid `Option<String>`.
* Removes duplicated features from `AptosVM` and keeps them in `MoveVMExt`.
* Fixes a bug when script hash was not computed for `RunOnAbort`.

Related tests are moved  to `move-e2e-tests`.

* [Compiler V2] Critical edge elimination (#11894)

Implement a pass to eliminate critical edges by splitting them with empty blocks

* [consensus configs] reduce sending block size from 2500 to 1900 (#12091)

### Description

The block output limit is no longer hit with p2p txns.

### Test Plan

Forge `realistic_env_max_load` TPS improves.

* [Indexer-grpc] Add profiling support. (#12034)

* Minor aggregator cleanup (#12013)

* Minor aggregator cleanup

* Addressing PR comments

* [move] rotate_authentication_key_call should not modify OriginatingAddress (#12108)

Co-authored-by: Alin Tomescu <[email protected]>

* [Data Streaming Service] Add dynamic prefetching support

* [Data Streaming Service] Add dynamic prefetching unit tests.

* [Data Streaming Service] Update existing integration tests.

* [State Sync] Add backpressure to fast sync receiver.

* Update perf baseline for gas charging coverage improvements (reducing throughput) (#12124)

* Reduce latency of cloning network sender using Arc pointers (#12103)

* Avoid cloning network sender using Arc pointers

* Removing a clone

* 100 node sweep test

* Removing a few clone operations

* reset forge test

* Removing some clones

* Removing clones

* adopt AIP-61 terminology for consistency (#12123)

adopt AIP-61 terminology for consistency

* [Consensus] Remove non-decoupled execution and refactor for cleaner interfaces (#12104)

* fix jwk key logging (#12090)

* remove spurious error lines (#12137)

* randomness #1: types update from randomnet (#12106)

* types update from randomnet

* update

* lint

* lint

* All validators broadcast commit vote messages (#12059)

* All validators broadcast commit messages

* Forge testing

* Increase timeout for forge

* test forge realistic_env_workload_sweep_test

* run realistic_env_workload_sweep_test

* run realistic_env_workload_sweep_test

* run sweep test

* increase forge runner duration

* forge testing

* Letting the proposer also broadcast commit decision for backward compatibility

* removing forge changes

* Added a TODO

* [vm] Resource access control: runtime engine (#10544)

* [vm] Resource access control: runtime engine

Implements the runtime engine for resource access control:

- a representation of access control specifiers in `loaded_data::runtime_access_specifiers`.
- a loader for access specifiers in `runtime::loader::access_specifier_loader`.
- a new stateful object representing the access control logic in `runtime::access_control`.
- finally the use of the `AccessControlState` in `runtime::interpreter`.

* Addressing reviewer comments.

* Addressing reviewer comments.

* typo: PTLA -> PTAL

* Rebasing: adjusting to upstream changes

* Rebasing

* ObjectCodeDeployment API cleanup update (#12133)

* ObjectCodeDeployment API cleanup update (#12141)

* [Compiler-v2] porting more V1 unit tests to V2 (#12085)

* update tests

* fix bug

* fix-12116

* fix missing space

* add expected got

* remove live-var tests

* fix had_erros

* fix

* Enable the max object nesting check (#12129)

* Resolved the warning for unused variable (#12157)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Squashed commit of the following:

commit a50ffec
Author: Zhoujun Ma <[email protected]>
Date:   Thu Feb 22 21:10:12 2024 +0000

    lint

commit 388350f
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 13:04:28 2024 -0800

    update

commit 76f7eca
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:56:04 2024 -0800

    update

commit a663542
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:54:18 2024 -0800

    update

commit b439449
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:34:14 2024 -0800

    update

commit 3378ceb
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:17:06 2024 -0800

    update

commit 6cd6685
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:15:05 2024 -0800

    update

commit 6d89f37
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:13:51 2024 -0800

    update

commit 980f257
Author: zhoujun.ma <[email protected]>
Date:   Thu Feb 22 12:12:04 2024 -0800

    update

commit 16e9349
Author: Zhoujun Ma <[email protected]>
Date:   Thu Feb 22 18:25:08 2024 +0000

    lint

---------

Co-authored-by: Alin Tomescu <[email protected]>
Co-authored-by: Oliver <[email protected]>
Co-authored-by: George Mitenkov <[email protected]>
Co-authored-by: Zekun Wang <[email protected]>
Co-authored-by: Brian (Sunghoon) Cho <[email protected]>
Co-authored-by: Guoteng Rao <[email protected]>
Co-authored-by: Satya Vusirikala <[email protected]>
Co-authored-by: David Wolinsky <[email protected]>
Co-authored-by: Josh Lind <[email protected]>
Co-authored-by: igor-aptos <[email protected]>
Co-authored-by: Sital Kedia <[email protected]>
Co-authored-by: Wolfgang Grieskamp <[email protected]>
Co-authored-by: Teng Zhang <[email protected]>
Co-authored-by: Junkil Park <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants