-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cypress randomly return CDP_COULD_NOT_RECONNECT error for spec being run in CI #26765
Comments
Hi @bilarallen , Can you provide more context? What troubleshooting steps have you tried? Does this test run locally fine? I understand you can't share this private repo, but can you make a reproducible example in https://github.com/cypress-io/cypress-test-tiny? Without a reproducible example it is unlikely we will be able to help with your problem. |
Hi @nagash77 yes this works fine on my local but when running in the CI using Jenkins it randomly occurs in some spec. Apologies but this issue seems to be just on our project and can't reproduce it outside of our test. Would it be okay if I'll just put the whole Cypress debug logs in a file including the environment info, these would be huge logs but I guess this will suffice for your investigation. |
@bilarallen I see in your description you are using 5 VMs to run these in parallel. What happens when you run the suite on a single VM in jenkins? I have a feeling whatever mechanisms you are using to try and run in parallel might be adding noise to the possible problems. |
@nagash77 Yes we're using AWS ec2 fleet with 5 instances running in our Jenkins where our automation run in parallel. I haven't tried to run our test only in one VM as our test count is really huge and this occurs randomly in a single different VM, perhaps I can share it here the full logs. The error occurs in lines 18325 to 18373 Here's the envi info:
|
Since 2 days after last upgrade (12.11 -> 12.12) I have been experiencing the same issue on CircleCI. It fails randomly, but always exactly the same test. Running Cypress tests in 5 environments simultaneously with 2 additional environments for other tests. It's a private repo too. It's rather hard to try running tests in a single environment and check the behaviour, as the test fails randomly. Not sure what other info I can provide to help, cannot create an example, but maybe can add something? |
We face the same issue, running tests on our Jenkins. The problem occurs randomly and even on random tests... |
Hi @bilarallen , I see you are using cypress-cloud. This package in spite of its name is not a Cypress library and has known issue with Cypress. I would suggest you explore alternatives or try removing that dependency and seeeing if that solves your problem. |
Hi @nagash77 I understand that we're not using the official reporting tool of cypress but the issue itself based on my provided logs is obviously from the |
Same issue for us on CircleCI after upgrading to 12.12.0 |
Hi, @JeremieDoctrine @headfox23 @wawer77 you guys can create a new issue for this problem that we are experiencing as cypress peeps keeps closing this issue since in the logs that I have provided we used an "unofficial" cypress library even though the problem based on my logs was obviously on cypress side which I firmly believe you are also encountering. Thanks! |
Hey @bilarallen , I can see it was reopened and moved to new issue today. I don't think it's useful to litter them with identical issues. We'll see :) |
@wawer77 this issue status is |
We have this same issue as well, both when running Cypress locally as well as in a GitHub Action. It is also a flaky error for us (occurs maybe one out of every 3-4 times?). We only started experiencing this after upgrading from 12.11 to 12.12, and after updating to 12.13 we still get the same error occasionally. We have reverted to 12.11 for the time being, since this recurring error prevents us from effectively using the newer versions. It also always seems to happen when one particular spec file is reached. It seems #26573 may have introduced this issue in the upgrade to 12.12? |
@spagnon7 please open a new issue with a reproducible example and the Cypress team will be happy to investigate. |
Hi @DukeVoldemar please comment on this ticket #26900 regarding this issue and include reproducible example if you can so they can investigate this properly, else we will stick to 12.11 and can't upgrade to future versions which are not ideal for us cypress users. |
@Pipul-Pant In order to give our engineers the best chance at recreating your problem, please create a reproducible example using a fork of Cypress Test Tiny. This gives us the best chance of seeing exactly what you are seeing and being able to investigate effectively. Are you able to provide such an example that replicates this behavior? |
We have the same problem with Cypress 12.12. The test execution randomly stops with the above error. It cannot be reproduced since it only happens every now and then. It also doesn't happen always at the same test ... it's just random after a new test suite is started. We run our tests inside a Windows VM manually and automatically. We switch back to 12.11 to see if it solves this issue in the meantime. |
I've just updated from latest Cypress 11 to Cypress 12.13 and got this error as well ): |
@alfaproject This issue has been closed for a while - since we didn't receive a reproducible example we weren't able to troubleshoot or diagnose the issue. If you are encountering the same problem and are able to provide an example project that demonstrates the failure I would invite you to open a new issue so we can take another look |
@mike-plummer I'm seeing it fairly regularly in one of my tests, using Cypress 12.14.0. It's too infrequent to demonstrate the failure consistently, only once in 20 or so runs, but I'll see if I can pin it down more.
|
@Pipul-Pant @awallat @alfaproject @colin0117 please take a look at this #26900 issue related to this one, they provided a test binary you can use to see if the possible fix is working. |
## Linked issues - Le downgarde à la version `12.11.0` corrige l'erreur (voir cypress-io/cypress#26765 (comment)): ``` There was an error reconnecting to the Chrome DevTools protocol. Please restart the browser. TypeError: Cannot read properties of undefined (reading 'webSocketDebuggerUrl') at _._fetchDebuggerURL (<embedded>:2404:524567) at process.processTicksAndRejections (node:internal/process/task_queues:96:5) at async _._start (<embedded>:2404:523866) ``` - Upgrade de Firefox pour être à jour - Mise sous silence de l'erreur : `AbortError: The operation was aborted` qui apparait seulement avec un `reload()` sous Cypress - Ajout d'un script pour tester le comportement d'un flaky test à répétition ---- - [x] Tests E2E (Cypress)
Current behavior
When running the tests in Jenkins CI, using 5 VM machines in parallel there are instances that it cannot report the run result because of the
CDP_COULD_NOT_RECONNECT
error and it cannot report the result of the spec that is affected by this error.Desired behavior
Should be able to report the result of the spec that is affected by the error
CDP_COULD_NOT_RECONNECT
Test code to reproduce
This only occurs in our private project repo but I have provided cypress debug logs and masked sensitive information.
Cypress Version
12.12.0
Node version
14.6.0
Operating System
linux Debian - 10.8
Debug Logs
The text was updated successfully, but these errors were encountered: