Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(e2e): return exit codes on failure of e2e tests #1025

Closed
wants to merge 32 commits into from
Closed

fix(e2e): return exit codes on failure of e2e tests #1025

wants to merge 32 commits into from

Conversation

marc-sensenich
Copy link
Contributor

If there is an error, returns the exit code associated with the error in the promise, else returns 0.

Fixes #1017

@googlebot
Copy link

Thanks for your pull request. It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

📝 Please visit https://cla.developers.google.com/ to sign.

Once you've signed, please reply here (e.g. I signed it!) and we'll verify. Thanks.


  • If you've already signed a CLA, it's possible we don't have your GitHub username or you're using a different email address. Check your existing CLA data and verify that your email is set on your git commits.
  • If you signed the CLA as a corporation, please let us know the company's name.

@googlebot
Copy link

CLAs look good, thanks!

Cleaning up the spec test in an attempt to resolve Travis OSX build issues
…`init`

This features adds a `--material` flag to the `new` and `init` options. This
streamlines the process of the adding of Angular Material to a new project
@filipesilva
Copy link
Contributor

Thanks for the contribution! Overall it looks good, but seems to be failing on OSX. I restarted it but it's still failing. Can you have a look?

This reverts commit c16c552.
This reverts commit 16a8d6a.
…`init`

This features adds a `--material` flag to the `new` and `init` options. This
streamlines the process of the adding of Angular Material to a new project
@marc-sensenich
Copy link
Contributor Author

I'll look into that issue and try to replicate it locally. I haven't been able to replicate on my MacBook.

On a failing e2e test, reject the promise so that the exit code is not 0.
@filipesilva
Copy link
Contributor

It seems to fail not on your new tests, but rather on our e2e suite.

That might be because since you fixed the ng e2e error codes, that is uncovering an existing error. It might also be because there is some issue in running it in sequence.

It might be helpful to print stdout and stderr in https://github.com/angular/angular-cli/blob/master/tests/e2e/e2e_workflow.spec.js#L130 to see what's wrong when running on the CI.

filipesilva pushed a commit that referenced this pull request Jun 9, 2016
@marc-sensenich
Copy link
Contributor Author

I matched the change you made on .travis.yml and it ran successfully on my Travis instance https://travis-ci.org/marc-sensenich/angular-cli/builds/136321458. It seems to be failing on the projects instance

filipesilva pushed a commit that referenced this pull request Jun 9, 2016
filipesilva pushed a commit that referenced this pull request Jun 9, 2016
@filipesilva
Copy link
Contributor

@marc-sensenich the new failures were due to a recent change in master. The old failures where because it turns out that ng e2e never worked on travis OSX, because of the chrome versions. I merged your code in, but moved the acceptance test into the e2e workflow.

I did this because I ran into a situation where the acceptance test was accepting failures in the ng e2e command while debugging. This has happened before and it's the reason why most tests that deal with the generated project are ran in e2e_workflow.spec.js.

Thanks for picking this issue up by the way, it was leading to some hard to detect silent fails!

@marc-sensenich marc-sensenich deleted the e2e-exit-code branch June 16, 2016 19:31
@angular-automatic-lock-bot
Copy link

This issue has been automatically locked due to inactivity.
Please file a new issue if you are encountering a similar or related problem.

Read more about our automatic conversation locking policy.

This action has been performed automatically by a bot.

@angular-automatic-lock-bot angular-automatic-lock-bot bot locked and limited conversation to collaborators Sep 10, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ng e2e
3 participants