Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci(tests): add container structure tests #6581

Merged
merged 17 commits into from
Apr 25, 2023

Conversation

bartsmykla
Copy link
Contributor

@bartsmykla bartsmykla commented Apr 21, 2023

This is the initial version of this feature as the configurations for structure tests can be improved, to for example test if versions of the binaries are expected (this involve introducing dynamic [containing exact versions] configuration files)

I would prefer to make testing entrypoints declarative, so instead of explicitly checking if its value is equal X, to check if i.e. running docker run kumahq/kuma-cp:2.2.0 version works. We can't use container-structure-tests to achieve it, as it overrides entrypoints, so I decided to accept this compromise. Maybe in the future if there will be need, we can just run commands like docker run kumahq/kuma-cp:2.2.0 version in tests directly.

  • Link to relevant issue as well as docs and UI issues --
  • This will not break child repos: it doesn't hardcode values (.e.g "kumahq" as a image registry) and it will work on Windows, system specific functions like syscall.Mkfifo have equivalent implementation on the other OS --
  • Tests (Unit test, E2E tests, manual test on universal and k8s) --
  • Do you need to update UPGRADE.md? -- you don't
  • Does it need to be backported according to the backporting policy? --
  • Do you need to explicitly set a > Changelog: entry here or add a ci/ label to run fewer/more tests?

Signed-off-by: Bart Smykla <bartek@smykla.com>
Signed-off-by: Bart Smykla <bartek@smykla.com>
@bartsmykla bartsmykla force-pushed the ci/add-container-stucture-tests branch from 8135843 to fc5b054 Compare April 21, 2023 03:56
Signed-off-by: Bart Smykla <bartek@smykla.com>
Signed-off-by: Bart Smykla <bartek@smykla.com>
Signed-off-by: Bart Smykla <bartek@smykla.com>
@bartsmykla bartsmykla added the ci/run-full-matrix PR: Runs all possible e2e test combination (expensive use carefully) label Apr 21, 2023
Signed-off-by: Bart Smykla <bartek@smykla.com>
Signed-off-by: Bart Smykla <bartek@smykla.com>
Signed-off-by: Bart Smykla <bartek@smykla.com>
…e-tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
Signed-off-by: Bart Smykla <bartek@smykla.com>
@bartsmykla bartsmykla changed the title ci: add container structure tests [WIP] ci(tests): add container structure tests [WIP] Apr 24, 2023
…e-tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
Copy link
Contributor

@lahabana lahabana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this just be part of make test ?

@bartsmykla
Copy link
Contributor Author

I'm not sure. Having it separately is cleaner for me, and I think it's easier to potentially debug. Especially as make test is starting to take a very long time to finish. We could theoretically run it with -j, but it makes reading logs in debugging even harder. I'm not very attached to it though.

@bartsmykla bartsmykla changed the title ci(tests): add container structure tests [WIP] ci(tests): add container structure tests Apr 24, 2023
@bartsmykla bartsmykla marked this pull request as ready for review April 24, 2023 10:25
@bartsmykla bartsmykla requested review from a team, Automaat, lobkovilya and lahabana and removed request for a team April 24, 2023 10:25
@bartsmykla bartsmykla merged commit 42e4980 into kumahq:master Apr 25, 2023
@bartsmykla bartsmykla deleted the ci/add-container-stucture-tests branch April 25, 2023 09:04
@bartsmykla
Copy link
Contributor Author

bartsmykla commented Apr 25, 2023

@Mergifyio backport release-2.2 release-2.1 release-2.0 release-1.8 release-1.7

@kumahq kumahq deleted a comment from mergify bot Apr 25, 2023
@mergify
Copy link
Contributor

mergify bot commented Apr 25, 2023

backport release-2.2 release-2.1 release-2.0 release-1.8 release-1.7

✅ Backports have been created

mergify bot pushed a commit that referenced this pull request Apr 25, 2023
* skip arm64 on kuma-commit by default
* add entrypoints to structure tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
(cherry picked from commit 42e4980)
mergify bot pushed a commit that referenced this pull request Apr 25, 2023
* skip arm64 on kuma-commit by default
* add entrypoints to structure tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
(cherry picked from commit 42e4980)

# Conflicts:
#	.circleci/config.yml
#	Makefile
#	mk/dependencies/deps.lock
mergify bot pushed a commit that referenced this pull request Apr 25, 2023
* skip arm64 on kuma-commit by default
* add entrypoints to structure tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
(cherry picked from commit 42e4980)

# Conflicts:
#	.circleci/config.yml
#	Makefile
#	mk/dependencies/deps.lock
mergify bot pushed a commit that referenced this pull request Apr 25, 2023
* skip arm64 on kuma-commit by default
* add entrypoints to structure tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
(cherry picked from commit 42e4980)

# Conflicts:
#	.circleci/config.yml
#	Makefile
#	mk/dependencies/deps.lock
#	mk/dev.mk
mergify bot pushed a commit that referenced this pull request Apr 25, 2023
* skip arm64 on kuma-commit by default
* add entrypoints to structure tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
(cherry picked from commit 42e4980)

# Conflicts:
#	.circleci/config.yml
#	Makefile
#	mk/dependencies/deps.lock
#	mk/dev.mk
bartsmykla pushed a commit that referenced this pull request Apr 25, 2023
* ci(tests): add container structure tests (#6581)

* skip arm64 on kuma-commit by default
* add entrypoints to structure tests

Signed-off-by: Bart Smykla <bartek@smykla.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci/run-full-matrix PR: Runs all possible e2e test combination (expensive use carefully)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants