Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[6.14.z][Combined Jenkins Ask] Capsule testing for sanity (#15948) #16421

Open
wants to merge 2 commits into
base: 6.14.z
Choose a base branch
from

Conversation

jyejare
Copy link
Member

@jyejare jyejare commented Sep 19, 2024

Problem Statement

Caspule Test isnt a part of sanity testing due to several reasons:

  1. Most test cases were dependent on Satellite and not on capsule
  2. The running time for sanity for separate capsule checkout and installation, configuration exceeds our target sanity runtime

Solution

Adding capsule installer test as part of sanity since Sanity is replacing bats tests in jenkins migration in delivery.

Related Issues

@jyejare jyejare added the No-CherryPick PR doesnt need CherryPick to previous branches label Sep 19, 2024
@jyejare jyejare added Failed_AutoCherryPick Issue for failed/conflicted auto cherry pick of PRs 6.14.z Introduced in or relating directly to Satellite 6.14 labels Sep 19, 2024
@jyejare jyejare changed the title [Combined Jenkins Ask] Capsule testing for sanity (#15948) [6.14.z][Combined Jenkins Ask] Capsule testing for sanity (#15948) Sep 19, 2024
@jyejare
Copy link
Member Author

jyejare commented Sep 19, 2024

trigger: test-robottelo
pytest: tests/foreman -m build_sanity

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 8731
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman -m build_sanity --external-logging
Test Result : = 1 failed, 10 passed, 5356 deselected, 5499 warnings, 1 error in 2203.96s (0:36:43) =

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Sep 19, 2024
@jyejare
Copy link
Member Author

jyejare commented Sep 20, 2024

The failures are not related to the change introduced in this PR.

Tests:

  1. tests.foreman.installer.test_installer.test_satellite_installation - Is failing with version match assertion error which is unrelated
  2. tests.foreman.installer.test_installer.test_capsule_installation - Is failing with broker checkout for capsule RHEL template for which the new commit 76fb2c1 is pushed with fix .

@jyejare jyejare added PRT-Passed Indicates that latest PRT run is passed for the PR and removed PRT-Failed Indicates that latest PRT run is failed for the PR labels Sep 20, 2024
@Satellite-QE Satellite-QE removed the PRT-Passed Indicates that latest PRT run is passed for the PR label Sep 20, 2024
* Capsule Sanity Test from installer

* Design Change: only count change

* Satellite Maintain fapolicyd package installation
@jyejare
Copy link
Member Author

jyejare commented Sep 20, 2024

trigger: test-robottelo
pytest: tests/foreman -m build_sanity

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 8749
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman -m build_sanity --external-logging
Test Result : == 1 failed, 11 passed, 5356 deselected, 5681 warnings in 3428.19s (0:57:08) ===

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Sep 20, 2024
@jyejare
Copy link
Member Author

jyejare commented Sep 20, 2024

Now, the only test failing is for AssertionError and is not related and is same as per the last comment.

@jyejare jyejare added PRT-Passed Indicates that latest PRT run is passed for the PR and removed PRT-Failed Indicates that latest PRT run is failed for the PR labels Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.14.z Introduced in or relating directly to Satellite 6.14 Failed_AutoCherryPick Issue for failed/conflicted auto cherry pick of PRs No-CherryPick PR doesnt need CherryPick to previous branches PRT-Passed Indicates that latest PRT run is passed for the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Failed-AutoCherryPick] - [Combined Jenkins Ask] Capsule testing for sanity
3 participants