Fix some flaky test failures #17224

Job	Run time
Lint	1m 13s
ci (bundler, bundler1, bundler)	5s
ci (bundler, bundler2, bundler)	6s
Updater	3m 46s
ci (cargo, cargo, cargo)	8s
ci (common, common, common)	2m 5s
ci (composer, composer, composer)	8s
ci (docker, docker, docker)	5s
ci (elm, elm, elm)	8s
ci (git_submodules, git_submodules, gitsubmodule)	5s
ci (github_actions, github_actions, github-actions)	8s
ci (go_modules, go_module, gomod)	7s
ci (gradle, gradle, gradle)	6s
ci (hex, hex, mix)	8s
ci (maven, maven, maven)	4s
ci (npm_and_yarn, npm_and_yarn, npm)	4s
ci (nuget, nuget, nuget)	7s
ci (pub, pub, pub)	6s
ci (python, python, pip)	9s
ci (python, python_slow, pip)	11s
ci (swift, swift, swift)	5s
ci (terraform, terraform, terraform)	5s
	9m 9s

Provide feedback