Tests looking for data-testid fail on Cypress Cloud

[luixxiul]

Steps to reproduce

1. Check Cypress test results of matrix-react-sdk here.

Outcome

What did you expect?

The tests should pass.

What happened instead?

Some tests in which data-testid attributes are searched failed. For example, see:

• https://cloud.cypress.io/projects/ppvnzg/runs/12638/errors
• https://cloud.cypress.io/projects/ppvnzg/runs/12645/errors

Please note that this issue is reproduced only on Cypress Cloud, not local Cypress. Also data-testid attributes which are not found seem to be different among test results.

Operating system

No response

Browser information

No response

URL for webapp

No response

Application version

No response

Homeserver

No response

Will you send logs?

No

[luixxiul]

Checking this result for matrix-org/matrix-react-sdk#10658, I suspect this regressed due to a0791ff (#25152). Unless the policy for tests was changed to discourage using data-testid, the attribute should not be stripped on Cypress.

See:

  <div
    class="mx_SettingsTab_heading"
  >
    General
  </div>

The div is expected to include data-testid='general' (See: here).

Please check this result too for another example: https://cloud.cypress.io/projects/ppvnzg/runs/12638/overview/d584bf52-de5b-4c40-9677-2a5423e85523?roarHideRunsWithDiffGroupsAndTags=1