-
Notifications
You must be signed in to change notification settings - Fork 219
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: improve cucumber tags and run time speed #3439
chore: improve cucumber tags and run time speed #3439
Conversation
ee18d93
to
301d806
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The CI run of the integration tests looks pretty broken?
14bdb2f
to
30e9dee
Compare
Not sure what’s gone wrong with the grpc client now |
c67ac04
to
e9f90be
Compare
Add flaky and broken tags update readme shorten tests and move more to long-running
e9f90be
to
d5e6279
Compare
@@ -1,13 +1,14 @@ | |||
@wallet | |||
@wallet-query |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@wallet-query | |
@wallet-query @wallet |
@@ -51,7 +48,7 @@ Feature: Wallet Monitoring | |||
Then all COINBASE transactions for wallet WALLET_A1 and wallet WALLET_B1 have consistent but opposing validity | |||
|
|||
# 18+ mins on circle ci | |||
@long-running | |||
@long-running @wallet |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You can just put this tag at the top of the file
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Moved all '@wallet' and all '@base-node' tags where I could to the top
81b8304
to
4e78ef1
Compare
4e78ef1
to
9972884
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
* development: chore: improve cucumber tags and run time speed (tari-project#3439)
* development: fix: add display_currency_decimal method (tari-project#3445) fix: add sanity checks to prepare_new_block (tari-project#3448) test: profile wallet sqlite database operations (tari-project#3451) test: create cucumber test directory if necessary (tari-project#3452) chore: improve cucumber tags and run time speed (tari-project#3439)
Description
This PR improves the run time of certain tests to remove
waits
and make sure they have async functions to retest waitable events.It adds a
@base-node
tag to all base node tests.It adds a
@wallet
tag to all wallet tests.It adds
@
tags to all feature files.Its adds and remove
@critical
tags to all required tests, adding where critical functionality is not tested and removing where it is double tested and or not critical to core functionality.Motivation and Context
Made sure we can run all tests as short as possible. Tests are grouped with the following tags:
@base-node
which can be used to run tests if verification of code base node functionality is desired@wallet
which can be used to run tests if verification of code wallet functionality is desired@critical
if a short test of all core functionality is desired.@long-running
if really detailed long-running tests are desired. Can take hours.Tests without a
@critical
and@long-running
are tests that are required for passing CI, but will take longer to run.Running test with
--tags @base-node AND @critical
or--tags @wallet AND @critical
completes it run time below 10 minutes.