Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: improve cucumber tags and run time speed #3439

Merged

Conversation

SWvheerden
Copy link
Collaborator

Description

This PR improves the run time of certain tests to remove waits and make sure they have async functions to retest waitable events.
It adds a @base-node tag to all base node tests.
It adds a @wallet tag to all wallet tests.
It adds @ tags to all feature files.
Its adds and remove @critical tags to all required tests, adding where critical functionality is not tested and removing where it is double tested and or not critical to core functionality.

Motivation and Context

Made sure we can run all tests as short as possible. Tests are grouped with the following tags:
@base-node which can be used to run tests if verification of code base node functionality is desired
@wallet which can be used to run tests if verification of code wallet functionality is desired
@critical if a short test of all core functionality is desired.
@long-running if really detailed long-running tests are desired. Can take hours.

Tests without a @critical and @long-running are tests that are required for passing CI, but will take longer to run.
Running test with --tags @base-node AND @critical or --tags @wallet AND @critical completes it run time below 10 minutes.

@SWvheerden SWvheerden changed the title chore: Improve cucumber tags and run time speed chore: improve cucumber tags and run time speed Oct 8, 2021
@SWvheerden SWvheerden force-pushed the sw_improve_cucumber_tags branch from ee18d93 to 301d806 Compare October 8, 2021 22:11
Copy link
Contributor

@philipr-za philipr-za left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The CI run of the integration tests looks pretty broken?

@SWvheerden SWvheerden force-pushed the sw_improve_cucumber_tags branch 2 times, most recently from 14bdb2f to 30e9dee Compare October 11, 2021 21:54
@delta1
Copy link
Contributor

delta1 commented Oct 12, 2021

Not sure what’s gone wrong with the grpc client now

@SWvheerden SWvheerden force-pushed the sw_improve_cucumber_tags branch 3 times, most recently from c67ac04 to e9f90be Compare October 12, 2021 12:19
Add flaky and broken tags
update readme
shorten tests and move more to long-running
@SWvheerden SWvheerden force-pushed the sw_improve_cucumber_tags branch from e9f90be to d5e6279 Compare October 12, 2021 15:19
@@ -1,13 +1,14 @@
@wallet
@wallet-query
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
@wallet-query
@wallet-query @wallet

@@ -51,7 +48,7 @@ Feature: Wallet Monitoring
Then all COINBASE transactions for wallet WALLET_A1 and wallet WALLET_B1 have consistent but opposing validity

# 18+ mins on circle ci
@long-running
@long-running @wallet
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can just put this tag at the top of the file

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved all '@wallet' and all '@base-node' tags where I could to the top

@SWvheerden SWvheerden force-pushed the sw_improve_cucumber_tags branch from 81b8304 to 4e78ef1 Compare October 12, 2021 15:35
@SWvheerden SWvheerden force-pushed the sw_improve_cucumber_tags branch from 4e78ef1 to 9972884 Compare October 12, 2021 15:38
Copy link
Contributor

@philipr-za philipr-za left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@aviator-app aviator-app bot merged commit 278ac93 into tari-project:development Oct 13, 2021
@SWvheerden SWvheerden deleted the sw_improve_cucumber_tags branch October 13, 2021 07:17
sdbondi added a commit to sdbondi/tari that referenced this pull request Oct 13, 2021
* development:
  chore: improve cucumber tags and run time speed (tari-project#3439)
sdbondi added a commit to sdbondi/tari that referenced this pull request Oct 15, 2021
* development:
  fix: add display_currency_decimal method (tari-project#3445)
  fix: add sanity checks to prepare_new_block (tari-project#3448)
  test: profile wallet sqlite database operations (tari-project#3451)
  test: create cucumber test directory if necessary (tari-project#3452)
  chore: improve cucumber tags and run time speed (tari-project#3439)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants