-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
QA Team - Keeping organized reports of relevant Rocket-E2E runs #143
Comments
I created a draft PR here. We can also explore using a central directory in the remote environment. [Edit] |
As shared here https://wp-media.slack.com/archives/C05NH7JU4S2/p1732266051553669. Wondering if I should move this to block
|
@Khadreal I can provide a Personal Access Token with write access to the repo if needed. You'd need to check if it can be configured globally for the git commands on the remote environment. Maybe the folder is best to begin with, and then it'd be up to the @wp-media/qa-team to keep the reports they believe are necessary and upload them to git? Or we could just go with a public repo? But we would still need a login on Github I think 🤔 Maybe the PAT is the easiest. |
@Khadreal I create a PAT that gives write access to the E2E report repo. You can find it on BitWarden: "GitHub PAT - Remote Desktop E2E Report Upload" If you are not sure how to set it up globally on the remote desktop env, you might want to ask @Honemo. I think he did something similar with Rocketlabs a few days ago. |
[update] Some of the issues with git approach,
Lastly, the command don't have to be a standalone, we can chain it to some of the existing commands so we don't have to run two commands every now and then. |
Context
https://wp-media.slack.com/archives/CUKB44GNN/p1726589916414399
We often have failing tests when running Rocket-E2E. While one axis of improvement is to solve those errors, an other one is to keep track of previous Rocket-E2E run reports so that we can check if the errors we face now already occured before (and hence can be discarded).
Currently, we have to re-run the tests in old configurations (old plugin versions, old Rocket-E2E versions) to validate or not if an error is accepted, which cost a lot of time.
Also, having records will help identify if we make progress or not when it comes to reducing the number of errors we face with Rocket-E2E, and will allow us to identify areas of improvements.
Expected outcome
We would need a shared folder or repository to store and access test reports from Rocket-E2E runs. I don't have specific requirements about the setup, but here are some inputs:
The text was updated successfully, but these errors were encountered: