Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add performance testing scripts and job for release workflow #796

Closed
3 tasks
denis-tingaikin opened this issue Mar 24, 2023 · 2 comments
Closed
3 tasks
Assignees

Comments

@denis-tingaikin
Copy link
Member

denis-tingaikin commented Mar 24, 2023

Motivation

It'd be very useful to monitor our perfomance metrics on releasing candidates. It could help to catch performance issues.

TODO

  • check scrits (AWS2AWS)
  • prepare scripts for githunb workflow
  • add perormance testing step on releasing (kind2kind)
@denis-tingaikin denis-tingaikin changed the title Add performance testing scripts and job Add performance testing scripts and job for releases Mar 24, 2023
@denis-tingaikin denis-tingaikin changed the title Add performance testing scripts and job for releases Add performance testing scripts and job for release workflow Mar 24, 2023
@glazychev-art glazychev-art moved this to In Progress in Release v1.9.0 Mar 27, 2023
@d-uzlov
Copy link
Contributor

d-uzlov commented Mar 28, 2023

The action plan:

  • Run MSM perf test scripts manually with AWS2AWS scenario
  • Add vl3 test
    • Adopt deployment configs from MSM testing ~4h
    • Run the test manually to ensure that it works ~4h
  • Add interdomain kernel2wireguard2kernel test
    • Adopt deployment configs from MSM testing ~4h
    • Run the test manually to ensure that it works ~4h
  • Add test scripts and deployments to this repo ~2h
  • Add CI configs to run test scripts ~2h
  • Trigger CI testing to ensure that everything works ~1h

Currently our scripts from the MSM performance testing reimplement NSM deploy commands from the deployments-k8s repo.
If we change anything in that repo, we would also need to manually update the scripts.
We can probably avoid it if we reuse generated test deploy golang code that we generate for CI testing. For this we would need to update gotestmd tool to include deployment code decoupled from test code.
At first we will merge current scripts, and later we can start working on improving this.

Performance tests will trigger automatically, along with our current release pipeline, which is triggered by pushes to release/... branches.

At first we will add this into integration-k8s-kind repo.
Later we will evaluate if it would be worth it to enable these tests in other integration repositories.

@denis-tingaikin denis-tingaikin moved this from In Progress to Done in Release v1.9.0 Apr 24, 2023
@denis-tingaikin denis-tingaikin moved this from Done to In Progress in Release v1.9.0 Apr 24, 2023
@denis-tingaikin denis-tingaikin moved this from In Progress to Done in Release v1.9.0 May 4, 2023
@denis-tingaikin
Copy link
Member Author

Seems like done

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

No branches or pull requests

2 participants