-
Notifications
You must be signed in to change notification settings - Fork 1.7k
ignore key_server_cluster randomly failing tests #9639
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm, would be nice to have an explanation comment though
@@ -1432,6 +1432,7 @@ pub mod tests { | |||
} | |||
|
|||
#[test] | |||
#[ignore] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like to see a comment explaining why a test ignored, this helps later on checking on this case and also understanding the reasoning behind this.
I think the link to #9635 would be good here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM as a temporary solution. Two comments:
- Those failings are likely just caused by slow CI. One way to re-enable those tests in the short term is just to change
TIMEOUT
to be a higher value (rather than 300ms). - For the long term, we should consider changing the
TIMEOUT
to use exponential back-off (same strategy used by many other async tests, such as in gnu toolchain).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Similar to what @sorpaas suggested when writing tests that rely on timeouts we could have a dillation factor, all timeouts would be multiplied by this factor. This way we could have a global parameter to tune the tests to run properly on slower machines (it's still flaky though).
…mon-deps * origin/master: ethereum libfuzzer integration small change (#9547) cli: remove reference to --no-ui in --unlock flag help (#9616) remove master from releasable branches (#9655) ethcore/VerificationQueue don't spawn up extra `worker-threads` when explictly specified not to (#9620) RPC: parity_getBlockReceipts (#9527) Remove unused dependencies (#9589) ignore key_server_cluster randomly failing tests (#9639) ethcore: handle vm exception when estimating gas (#9615) fix bad-block reporting no reason (#9638) Use static call and apparent value transfer for block reward contract code (#9603) HF in POA Sokol (2018-09-19) (#9607) bump smallvec to 0.6 in ethcore-light, ethstore and whisper (#9588) Add constantinople conf to EvmTestClient. (#9570)
related to #9635