Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[1.0.2] Split long running tests into multiple parts so that they can finish within CICD time limits #794

Merged
merged 3 commits into from
Sep 18, 2024

Conversation

linh2931
Copy link
Member

wasm_config_part1, wasm_config_part2, wasm_part3, and snapshot_unit_test failed in a recent CICD https://github.com/AntelopeIO/spring/actions/runs/10833286823/job/30060475412#step:5:4182 due to exceeding time limits.

The PR splits the tests evenly into smaller multiple parts such that they can finish within time limits.

Before the PR, wasm_config tests had 3 uneven parts:

1/1 Test #196: wasm_config_part1_unit_test_eos-vm-oc ...   Passed  148.56 sec
1/1 Test #199: wasm_config_part2_unit_test_eos-vm-oc ...   Passed  112.35 sec
1/1 Test #202: wasm_config_part3_unit_test_eos-vm-oc ...   Passed   91.71 sec

After the PR:

1/1 Test #199: wasm_config_part1_unit_test_eos-vm-oc ...   Passed   73.46 sec
1/1 Test #202: wasm_config_part2_unit_test_eos-vm-oc ...   Passed   61.38 sec
1/1 Test #205: wasm_config_part3_unit_test_eos-vm-oc ...   Passed   75.26 sec
1/1 Test #208: wasm_config_part4_unit_test_eos-vm-oc ...   Passed   75.75 sec
1/1 Test #211: wasm_config_part5_unit_test_eos-vm-oc ...   Passed   67.79 sec

Before the PR, snapshot test took:
1/1 Test #175: snapshot_unit_test_eos-vm-oc ....... Passed 198.62 sec
After the PR, it is split into 2 parts:

1/1 Test  #175: snapshot_part1_unit_test_eos-vm-oc ....   Passed   96.90 sec
1/1 Test #178: snapshot_part2_unit_test_eos-vm-oc ...   Passed  101.51 sec

Before the PR, memory_mapping_test in wasm_tests deployed 5,000 contracts and run in 250 seconds. It is not necessary. The PR reduces it to 2,000 contracts; the running time is now 100 seconds.

@linh2931 linh2931 merged commit 07023bd into release/1.0 Sep 18, 2024
36 checks passed
@linh2931 linh2931 deleted the split_tests branch September 18, 2024 13:43
@arhag arhag linked an issue Sep 18, 2024 that may be closed by this pull request
@ericpassmore
Copy link
Contributor

Note:start
category: Tests
component: Internal
summary: Spilt up long running tests so CICD can finish faster.
Note:end

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Test Failure: split long running tests
4 participants