Skip to content
This repository has been archived by the owner on Aug 8, 2023. It is now read-only.

Adjust coverage tracking threshold #13364

Merged
merged 1 commit into from
Dec 1, 2018
Merged

Adjust coverage tracking threshold #13364

merged 1 commit into from
Dec 1, 2018

Conversation

springmeyer
Copy link
Contributor

@springmeyer springmeyer commented Nov 14, 2018

This changes the default threshold to 1% (from 0%) for when to fail a build due to negative coverage changes.

The reasoning here is that some tests are unreliable (more on this at #13324) and are causing %0.1 fluctuations in coverage for PRs which should not impact coverage (like #13357 and #13360). This change is a stopgap measure to avoid developer pain, until the cause of the unreliability can be understood and mitigated.

/cc @jmkiley

Docs for adjusting thresholds at https://docs.codecov.io/docs/commit-status

Copy link
Contributor

@jmkiley jmkiley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 LGTM

@springmeyer
Copy link
Contributor Author

I think this should merge now, but my jobs are hitting:

Since these are unrelated, can this still be merged?

Copy link
Contributor

@friedbunny friedbunny left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apologies for the flappy tests. 🙇

@springmeyer springmeyer merged commit 35880c2 into master Dec 1, 2018
@springmeyer springmeyer deleted the coverage-tolerance branch December 1, 2018 01:44
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants