Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Summarize Rocket-E2E results from Remote Desktop #165

Closed
MathieuLamiot opened this issue Nov 3, 2024 · 5 comments
Closed

Summarize Rocket-E2E results from Remote Desktop #165

MathieuLamiot opened this issue Nov 3, 2024 · 5 comments
Assignees

Comments

@MathieuLamiot
Copy link
Contributor

MathieuLamiot commented Nov 3, 2024

Context
We now have many test results from Rocket-E2E from Remote Destkop: https://wp-media.slack.com/archives/C05NH7JU4S2/p1729513024781269

Expected outcome

Create an excel (or google sheet) file with:

  • One column per test in the test plan
  • One line per test report
    For each report/test, mark it as OK/KO.

From there, identify:

  • Tests that are always passing
  • Tests that are always failing
  • Flaky tests

For failing/flaky tests, check if there is already a GH issue or create it. Then reference it in the Excel file.

Warning: Note that some fixes were applied between the first and last reports, so let's take that into account. For instance, tests failing in the first reports because of WP Rocket not being properly uninstalled should not be considerd flaky because they have been fixed in the meantime, etc.

@MathieuLamiot
Copy link
Contributor Author

I created first obvious issues: #166 #167 #168

@Mai-Saad
Copy link
Contributor

WIP: gathering data here https://docs.google.com/spreadsheets/d/1L9ZsL0kCaYg3ytqcnKikKsQDAfLNCiV6iC9_hgvYryE/edit?usp=sharing

@Mai-Saad
Copy link
Contributor

I created first obvious issues: #166 #167 #168

This too can be added to the list #172

@Mai-Saad
Copy link
Contributor

We can add this too #173

@Mai-Saad
Copy link
Contributor

Mai-Saad commented Nov 22, 2024

Using the latest commit on dev 80bde4e, the remaining failures are due to:
#166
#167

llimages for single colon and Scenario:C16388 - Should clear performance hints of the URL when edited => probably related to this #173 as when active theme is 2020, all is green

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants