8 fail, 6 skipped, 89 pass in 3h 39m 10s
Annotations
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
4 out of 8 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 14s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 14s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 13s]
Raw output
Failed
=== RUN TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2023-10-30T01:43:14Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
W1030 01:43:15.007121 20435 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1030 01:43:15.013743 20435 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-10-30T01:43:15Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-10-30T01:43:16Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-10-30T01:43:16Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-10-30T01:43:16Z" level=info msg="ingress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2023-10-30T01:43:17Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-10-30T01:43:17Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-10-30T01:43:18Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=alb-rollout
time="2023-10-30T01:43:18Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-10-30T01:43:18Z" level=info msg="Updated rollout pod spec: 2023-10-30T01:43:18.232040345Z" rollout=alb-rollout
time="2023-10-30T01:43:18Z" level=info msg="Sleeping 10s" rollout=alb-rollout
require.go:72:
Error Trace: /home/runner/go/pkg/mod/github.com/tj/assert@v0.0.3/require.go:72
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:264
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:254
Error: Not equal:
expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
actual : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
Diff:
--- Expected
+++ Actual
@@ -1 +1 @@
-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
Test: TestAWSSuite/TestALBExperimentStepNoSetWeight
Name: alb-rollout
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/1
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 0
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ alb-rollout Rollout �[94m◌�[0m Progressing 11s
├──# revision:2
│ ├──⧉ �[33malb-rollout-cc77998c9�[0m ReplicaSet �[0m•�[0m ScaledDown 10s �[33mcanary�[0m
│ └──Σ �[94malb-rollout-cc77998c9-2-0�[0m Experiment �[94m◌�[0m Running 10s
│ ├──⧉ alb-rollout-cc77998c9-2-0-experiment-alb-canary ReplicaSet �[32m✔�[0m Healthy 10s
│ │ └──□ alb-rollout-cc77998c9-2-0-experiment-alb-canary-xd68j Pod �[32m✔�[0m Running 10s ready:1/1
│ └──⧉ alb-rollout-cc77998c9-2-0-experiment-alb-stable ReplicaSet �[32m✔�[0m Healthy 10s
│ └──□ alb-rollout-cc77998c9-2-0-experiment-alb-stable-6ttqm Pod �[32m✔�[0m Running 10s ready:1/1
└──# revision:1
└──⧉ �[32malb-rollout-d6f4fdcdc�[0m ReplicaSet �[32m✔�[0m Healthy 11s �[32mstable�[0m
└──□ alb-rollout-d6f4fdcdc-wzh9c Pod �[32m✔�[0m Running 11s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-10-30T01:43:17Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestALBExperimentStepNoSetWeight
name: alb-rollout
namespace: default
resourceVersion: "4033"
uid: f1001a17-ffc6-44c7-b20a-489c29ea787f
spec:
replicas: 1
selector:
matchLabels:
app: alb-rollout
strategy:
canary:
canaryService: alb-rollout-canary
stableService: alb-rollout-stable
steps:
- experiment:
duration: 15s
templates:
- metadata: {}
name: experiment-alb-canary
specRef: canary
weight: 20
- metadata: {}
name: experiment-alb-stable
specRef: stable
weight: 20
trafficRouting:
alb:
ingress: alb-rollout-ingress
rootService: alb-rollout-root
servicePort: 80
template:
metadata:
annotations:
update: "2023-10-30T01:43:18.232040345Z"
creationTimestamp: null
labels:
app: alb-rollout
spec:
containers:
- image: nginx:1.19-alpine
name: alb-rollout
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen: {}
canary:
currentExperiment: alb-rollout-cc77998c9-2-0
weights:
additional:
- weight: 20
- weight: 20
canary:
podTemplateHash: cc77998c9
serviceName: alb-rollout-canary
weight: 0
stable:
podTemplateHash: d6f4fdcdc
serviceName: alb-rollout-stable
weight: 60
conditions:
- lastTransitionTime: "2023-10-30T01:43:18Z"
lastUpdateTime: "2023-10-30T01:43:18Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-10-30T01:43:18Z"
lastUpdateTime: "2023-10-30T01:43:18Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-10-30T01:43:18Z"
lastUpdateTime: "2023-10-30T01:43:18Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-10-30T01:43:17Z"
lastUpdateTime: "2023-10-30T01:43:18Z"
message: Created new replica set "alb-rollout-cc77998c9"
reason: NewReplicaSetCreated
status: "True"
type: Progressing
currentPodHash: cc77998c9
currentStepHash: 558cc8bf4d
currentStepIndex: 0
message: more replicas need to be updated
observedGeneration: "3"
phase: Progressing
readyReplicas: 1
replicas: 1
selector: app=alb-rollout
stableRS: d6f4fdcdc
2023-10-30T01:43:17Z Normal RolloutAddedToInformer Rollout resource added to informer: default/alb-rollout
2023-10-30T01:43:17Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-10-30T01:43:17Z Normal RolloutUpdated Rollout updated to revision 1
2023-10-30T01:43:17Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-10-30T01:43:17Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-10-30T01:43:17Z Normal ScalingReplicaSet Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-10-30T01:43:17Z Normal RolloutCompleted Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-10-30T01:43:18Z Normal SwitchService Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-10-30T01:43:18Z Normal SwitchService Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-10-30T01:43:18Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (cc77998c9)
2023-10-30T01:43:18Z Normal RolloutUpdated Rollout updated to revision 2
2023-10-30T01:43:18Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-cc77998c9 (revision 2)
2023-10-30T01:43:18Z (x2) Normal TrafficWeightUpdated Traffic weight updated
2023-10-30T01:43:18Z Normal ExperimentCreated Created Experiment 'alb-rollout-cc77998c9-2-0'
2023-10-30T01:43:20Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2023-10-30T01:43:20Z Normal TrafficWeightUpdated Traffic weight updated additional: [{20 } {20 }]
time="2023-10-30T01:43:28Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
W1030 01:43:28.979744 20435 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1030 01:43:28.986220 20435 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
--- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (14.12s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
4 out of 8 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 2m 15s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 14s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 2m 1s]
Raw output
Failed
=== RUN TestAWSSuite
--- FAIL: TestAWSSuite (135.32s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 4s]
Raw output
Failed
=== RUN TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
time="2023-10-30T01:45:47Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScaleRollbackToStable"
time="2023-10-30T01:45:47Z" level=info msg="service/dynamic-stable-scale-root created\n" rollout=dynamic-stable-scale
time="2023-10-30T01:45:48Z" level=info msg="service/dynamic-stable-scale-canary created\n" rollout=dynamic-stable-scale
time="2023-10-30T01:45:48Z" level=info msg="service/dynamic-stable-scale-stable created\n" rollout=dynamic-stable-scale
time="2023-10-30T01:45:48Z" level=info msg="ingress.networking.k8s.io/dynamic-stable-scale-ingress created\n" rollout=dynamic-stable-scale
time="2023-10-30T01:45:49Z" level=info msg="rollout.argoproj.io/dynamic-stable-scale created\n" rollout=dynamic-stable-scale
common.go:165: Could not find ReplicaSet with revision: 1
Name: dynamic-stable-scale
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/4
SetWeight: 25
ActualWeight: 0
Replicas:
Desired: 4
Current: 0
Updated: 0
Ready: 0
Available: 0
NAME KIND STATUS AGE INFO
⟳ dynamic-stable-scale Rollout �[94m◌�[0m Progressing 2s
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
creationTimestamp: "2023-10-30T01:45:49Z"
generation: 1
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestCanaryDynamicStableScaleRollbackToStable
name: dynamic-stable-scale
namespace: default
resourceVersion: "6463"
uid: ab5f811f-8207-4514-a073-40c680a2c7be
spec:
replicas: 4
selector:
matchLabels:
app: dynamic-stable-scale
strategy:
canary:
canaryService: dynamic-stable-scale-canary
dynamicStableScale: true
stableService: dynamic-stable-scale-stable
steps:
- setWeight: 25
- pause: {}
- setWeight: 75
- pause: {}
trafficRouting:
alb:
ingress: dynamic-stable-scale-ingress
rootService: dynamic-stable-scale-root
servicePort: 80
template:
metadata:
creationTimestamp: null
labels:
app: dynamic-stable-scale
spec:
containers:
- image: nginx:1.19-alpine
name: dynamic-stable-scale
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
readinessGates:
- conditionType: argoproj.io/e2e-readiness
status:
blueGreen: {}
canary: {}
conditions:
- lastTransitionTime: "2023-10-30T01:45:49Z"
lastUpdateTime: "2023-10-30T01:45:49Z"
message: Rollout "dynamic-stable-scale" is progressing.
reason: ReplicaSetUpdated
status: "True"
type: Progressing
- lastTransitionTime: "2023-10-30T01:45:49Z"
lastUpdateTime: "2023-10-30T01:45:49Z"
message: Rollout does not have minimum availability
reason: AvailableReason
status: "False"
type: Available
- lastTransitionTime: "2023-10-30T01:45:49Z"
lastUpdateTime: "2023-10-30T01:45:49Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
currentPodHash: 868d98995b
currentStepHash: 7c5b668566
currentStepIndex: 0
message: more replicas need to be updated
observedGeneration: "1"
phase: Progressing
selector: app=dynamic-stable-scale
2023-10-30T01:45:49Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (868d98995b)
time="2023-10-30T01:45:51Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScaleRollbackToStable"
--- FAIL: TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable (4.08s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestCanarySuite/TestCanaryScaleDownDelay (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 10s]
Raw output
Failed
=== RUN TestCanarySuite/TestCanaryScaleDownDelay
time="2023-10-30T01:46:57Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownDelay"
W1030 01:46:57.275603 20471 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1030 01:46:57.280258 20471 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-10-30T01:46:57Z" level=info msg="service/canary-scaledowndelay-root created\n" rollout=canary-scaledowndelay
time="2023-10-30T01:46:58Z" level=info msg="service/canary-scaledowndelay-canary created\n" rollout=canary-scaledowndelay
time="2023-10-30T01:46:58Z" level=info msg="service/canary-scaledowndelay-stable created\n" rollout=canary-scaledowndelay
time="2023-10-30T01:46:58Z" level=info msg="ingress.networking.k8s.io/canary-scaledowndelay-ingress created\n" rollout=canary-scaledowndelay
time="2023-10-30T01:46:59Z" level=info msg="rollout.argoproj.io/canary-scaledowndelay created\n" rollout=canary-scaledowndelay
time="2023-10-30T01:46:59Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-10-30T01:47:01Z" level=info msg="Condition 'status=Healthy' met after 2s" rollout=canary-scaledowndelay
time="2023-10-30T01:47:01Z" level=info msg="Updated rollout spec: {\"spec\":{\"template\":{\"metadata\":{\"annotations\":{\"rev\":\"two\"}}}}}" rollout=canary-scaledowndelay
time="2023-10-30T01:47:01Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-10-30T01:47:02Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledowndelay
time="2023-10-30T01:47:02Z" level=info msg="Sleeping 2s" rollout=canary-scaledowndelay
time="2023-10-30T01:47:04Z" level=info msg="Updated rollout spec: {\"spec\":{\"template\":{\"metadata\":{\"annotations\":{\"rev\":\"three\"}}}}}" rollout=canary-scaledowndelay
time="2023-10-30T01:47:04Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-10-30T01:47:05Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledowndelay
time="2023-10-30T01:47:06Z" level=info msg="Updated rollout spec: {\"spec\":{\"template\":{\"metadata\":{\"annotations\":{\"rev\":\"two\"}}}}}" rollout=canary-scaledowndelay
time="2023-10-30T01:47:06Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-10-30T01:47:06Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledowndelay
canary_test.go:529:
Error Trace: /home/runner/work/argo-rollouts/argo-rollouts/test/e2e/canary_test.go:529
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/canary_test.go:517
Error: Should NOT be empty, but was
Test: TestCanarySuite/TestCanaryScaleDownDelay
Name: canary-scaledowndelay
Namespace: default
Status: �[32m✔�[0m Healthy
Strategy: Canary
Step:
SetWeight: 100
ActualWeight: 100
Images: nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
Desired: 1
Current: 2
Updated: 1
Ready: 2
Available: 2
NAME KIND STATUS AGE INFO
⟳ canary-scaledowndelay Rollout �[32m✔�[0m Healthy 8s
├──# revision:4
│ └──⧉ �[32mcanary-scaledowndelay-7c74c66d54�[0m ReplicaSet �[32m✔�[0m Healthy 6s �[32mstable�[0m
│ └──□ canary-scaledowndelay-7c74c66d54-xkcml Pod �[32m✔�[0m Running 6s ready:1/1
├──# revision:3
│ └──⧉ canary-scaledowndelay-9586cf7d4 ReplicaSet �[32m✔�[0m Healthy 3s
│ └──□ canary-scaledowndelay-9586cf7d4-nnpb6 Pod �[32m✔�[0m Running 3s ready:1/1
└──# revision:1
└──⧉ canary-scaledowndelay-66597877b7 ReplicaSet �[0m•�[0m ScaledDown 8s
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "4"
creationTimestamp: "2023-10-30T01:46:59Z"
generation: 5
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestCanaryScaleDownDelay
name: canary-scaledowndelay
namespace: default
resourceVersion: "7372"
uid: c9bc15a6-9e7d-4ecb-af59-bcad4d26b4ee
spec:
replicas: 1
selector:
matchLabels:
app: canary-scaledowndelay
strategy:
canary:
canaryService: canary-scaledowndelay-canary
scaleDownDelayRevisionLimit: 1
stableService: canary-scaledowndelay-stable
trafficRouting:
alb:
ingress: canary-scaledowndelay-ingress
rootService: canary-scaledowndelay-root
servicePort: 80
template:
metadata:
annotations:
rev: two
creationTimestamp: null
labels:
app: canary-scaledowndelay
spec:
containers:
- image: nginx:1.19-alpine
name: canary-scaledowndelay
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 2
availableReplicas: 2
blueGreen: {}
canary:
weights:
canary:
podTemplateHash: 7c74c66d54
serviceName: canary-scaledowndelay-canary
weight: 0
stable:
podTemplateHash: 9586cf7d4
serviceName: canary-scaledowndelay-stable
weight: 100
conditions:
- lastTransitionTime: "2023-10-30T01:47:01Z"
lastUpdateTime: "2023-10-30T01:47:01Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-10-30T01:47:01Z"
lastUpdateTime: "2023-10-30T01:47:01Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-10-30T01:46:59Z"
lastUpdateTime: "2023-10-30T01:47:06Z"
message: ReplicaSet "canary-scaledowndelay-7c74c66d54" is progressing.
reason: ReplicaSetUpdated
status: "True"
type: Progressing
- lastTransitionTime: "2023-10-30T01:47:06Z"
lastUpdateTime: "2023-10-30T01:47:06Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
currentPodHash: 7c74c66d54
currentStepHash: 5ffbfbbd64
observedGeneration: "5"
phase: Healthy
readyReplicas: 2
replicas: 2
selector: app=canary-scaledowndelay
stableRS: 7c74c66d54
updatedReplicas: 1
2023-10-30T01:46:59Z Normal RolloutAddedToInformer Rollout resource added to informer: default/canary-scaledowndelay
2023-10-30T01:46:59Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (66597877b7)
2023-10-30T01:46:59Z Normal RolloutUpdated Rollout updated to revision 1
2023-10-30T01:46:59Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledowndelay-66597877b7 (revision 1)
2023-10-30T01:46:59Z Normal PatchingALBIngress Updating Ingress `canary-scaledowndelay-ingress` to desiredWeight '0'
2023-10-30T01:46:59Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-10-30T01:46:59Z Normal ScalingReplicaSet Scaled up ReplicaSet canary-scaledowndelay-66597877b7 (revision 1) from 0 to 1
2023-10-30T01:46:59Z Normal RolloutCompleted Rollout completed update to revision 1 (66597877b7): Initial deploy
2023-10-30T01:47:01Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-stable' from '' to '66597877b7'
2023-10-30T01:47:01Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-canary' from '' to '66597877b7'
2023-10-30T01:47:01Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (7c74c66d54)
2023-10-30T01:47:01Z Normal RolloutUpdated Rollout updated to revision 2
2023-10-30T01:47:01Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledowndelay-7c74c66d54 (revision 2)
2023-10-30T01:47:01Z Normal ScalingReplicaSet Scaled up ReplicaSet canary-scaledowndelay-7c74c66d54 (revision 2) from 0 to 1
2023-10-30T01:47:02Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-canary' from '66597877b7' to '7c74c66d54'
2023-10-30T01:47:02Z Normal RolloutCompleted Rollout completed update to revision 2 (7c74c66d54): Completed all 0 canary steps
2023-10-30T01:47:02Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-stable' from '66597877b7' to '7c74c66d54'
2023-10-30T01:47:02Z (x4) Normal TrafficWeightUpdated Traffic weight updated
2023-10-30T01:47:04Z Normal RolloutNotCompleted Rollout not completed, started update to revision 3 (9586cf7d4)
2023-10-30T01:47:04Z Normal RolloutUpdated Rollout updated to revision 3
2023-10-30T01:47:04Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledowndelay-9586cf7d4 (revision 3)
time="2023-10-30T01:47:07Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownDelay"
W1030 01:47:07.965858 20471 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1030 01:47:07.970421 20471 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
--- FAIL: TestCanarySuite/TestCanaryScaleDownDelay (10.87s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestCanarySuite/TestCanaryScaleDownOnAbort (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 4s]
Raw output
Failed
=== RUN TestCanarySuite/TestCanaryScaleDownOnAbort
time="2023-10-30T01:48:04Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
time="2023-10-30T01:48:05Z" level=info msg="service/canary-scaledowndelay-root created\n" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:05Z" level=info msg="service/canary-scaledowndelay-canary created\n" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:06Z" level=info msg="service/canary-scaledowndelay-stable created\n" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:06Z" level=info msg="ingress.networking.k8s.io/canary-scaledowndelay-ingress created\n" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:06Z" level=info msg="rollout.argoproj.io/canary-scaledownd-on-abort created\n" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:06Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:07Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:07Z" level=info msg="Updated rollout pod spec: 2023-10-30T01:48:07.516846716Z" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:07Z" level=info msg="Waiting for condition: status=Paused" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:08Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:08Z" level=info msg="Aborted rollout" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:08Z" level=info msg="Waiting for condition: status=Degraded" rollout=canary-scaledownd-on-abort
time="2023-10-30T01:48:08Z" level=info msg="Condition 'status=Degraded' met after 0s" rollout=canary-scaledownd-on-abort
canary_test.go:544: Expected canary-scaledowndelay-canary selector: map[app:canary-scaledowndelay rollouts-pod-template-hash:66597877b7]. Actual: map[app:canary-scaledowndelay rollouts-pod-template-hash:57b587769c]
Name: canary-scaledownd-on-abort
Namespace: default
Status: �[31m✖�[0m Degraded
Message: RolloutAborted: Rollout aborted update to revision 2
Strategy: Canary
Step: 0/2
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
Desired: 1
Current: 2
Updated: 1
Ready: 2
Available: 2
NAME KIND STATUS AGE INFO
⟳ canary-scaledownd-on-abort Rollout �[31m✖�[0m Degraded 2s
├──# revision:2
│ └──⧉ �[33mcanary-scaledownd-on-abort-57b587769c�[0m ReplicaSet �[32m✔�[0m Healthy 1s �[33mcanary�[0m,delay:0s
│ └──□ canary-scaledownd-on-abort-57b587769c-fgssx Pod �[32m✔�[0m Running 1s ready:1/1
└──# revision:1
└──⧉ �[32mcanary-scaledownd-on-abort-66597877b7�[0m ReplicaSet �[32m✔�[0m Healthy 2s �[32mstable�[0m
└──□ canary-scaledownd-on-abort-66597877b7-jn6fv Pod �[32m✔�[0m Running 2s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-10-30T01:48:06Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestCanaryScaleDownOnAbort
name: canary-scaledownd-on-abort
namespace: default
resourceVersion: "7112"
uid: f41fa50a-29ee-4a82-b365-3fd5ed32bb55
spec:
replicas: 1
selector:
matchLabels:
app: canary-scaledowndelay
strategy:
canary:
abortScaleDownDelaySeconds: 1
canaryService: canary-scaledowndelay-canary
scaleDownDelayRevisionLimit: 1
stableService: canary-scaledowndelay-stable
steps:
- setCanaryScale:
replicas: 1
- pause: {}
trafficRouting:
alb:
ingress: canary-scaledowndelay-ingress
rootService: canary-scaledowndelay-root
servicePort: 80
template:
metadata:
annotations:
update: "2023-10-30T01:48:07.516846716Z"
creationTimestamp: null
labels:
app: canary-scaledowndelay
spec:
containers:
- image: nginx:1.19-alpine
name: canary-scaledowndelay
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 2
abort: true
abortedAt: "2023-10-30T01:48:08Z"
availableReplicas: 2
blueGreen: {}
canary:
weights:
canary:
podTemplateHash: 57b587769c
serviceName: canary-scaledowndelay-canary
weight: 0
stable:
podTemplateHash: 66597877b7
serviceName: canary-scaledowndelay-stable
weight: 100
conditions:
- lastTransitionTime: "2023-10-30T01:48:07Z"
lastUpdateTime: "2023-10-30T01:48:07Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-10-30T01:48:07Z"
lastUpdateTime: "2023-10-30T01:48:07Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-10-30T01:48:07Z"
lastUpdateTime: "2023-10-30T01:48:07Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-10-30T01:48:08Z"
lastUpdateTime: "2023-10-30T01:48:08Z"
message: Rollout is paused
reason: RolloutPaused
status: "True"
type: Paused
- lastTransitionTime: "2023-10-30T01:48:08Z"
lastUpdateTime: "2023-10-30T01:48:08Z"
message: Rollout aborted update to revision 2
reason: RolloutAborted
status: "False"
type: Progressing
currentPodHash: 57b587769c
currentStepHash: 5db8f9b897
currentStepIndex: 0
message: 'RolloutAborted: Rollout aborted update to revision 2'
observedGeneration: "3"
phase: Degraded
readyReplicas: 2
replicas: 2
selector: app=canary-scaledowndelay
stableRS: 66597877b7
updatedReplicas: 1
2023-10-30T01:48:06Z Normal RolloutAddedToInformer Rollout resource added to informer: default/canary-scaledownd-on-abort
2023-10-30T01:48:06Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (66597877b7)
2023-10-30T01:48:06Z Normal RolloutUpdated Rollout updated to revision 1
2023-10-30T01:48:06Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1)
2023-10-30T01:48:06Z Normal PatchingALBIngress Updating Ingress `canary-scaledowndelay-ingress` to desiredWeight '0'
2023-10-30T01:48:06Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-10-30T01:48:06Z Normal ScalingReplicaSet Scaled up ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1) from 0 to 1
2023-10-30T01:48:06Z Normal RolloutCompleted Rollout completed update to revision 1 (66597877b7): Initial deploy
2023-10-30T01:48:07Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-stable' from '' to '66597877b7'
2023-10-30T01:48:07Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-canary' from '' to '66597877b7'
2023-10-30T01:48:07Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (57b587769c)
2023-10-30T01:48:07Z Normal RolloutUpdated Rollout updated to revision 2
2023-10-30T01:48:07Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledownd-on-abort-57b587769c (revision 2)
2023-10-30T01:48:07Z (x3) Normal TrafficWeightUpdated Traffic weight updated
2023-10-30T01:48:07Z Normal ScalingReplicaSet Scaled up ReplicaSet canary-scaledownd-on-abort-57b587769c (revision 2) from 0 to 1
2023-10-30T01:48:08Z Normal RolloutStepCompleted Rollout step 1/2 completed (setCanaryScale{replicas: 1})
2023-10-30T01:48:08Z Normal RolloutPaused Rollout is paused (CanaryPauseStep)
2023-10-30T01:48:08Z Warning RolloutAborted Rollout aborted update to revision 2
2023-10-30T01:48:08Z (x2) Normal SwitchService Switched selector for service 'canary-scaledowndelay-canary' from '66597877b7' to '57b587769c'
2023-10-30T01:48:08Z (x2) Normal SwitchService Switched selector for service 'canary-scaledowndelay-canary' from '57b587769c' to '66597877b7'
time="2023-10-30T01:48:08Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
--- FAIL: TestCanarySuite/TestCanaryScaleDownOnAbort (4.22s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
3 out of 8 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 10s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 4m 12s]
Raw output
Failed
=== RUN TestCanarySuite
time="2023-10-30T01:45:27Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (252.64s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 2m 9s]
Raw output
Failed
=== RUN TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
time="2023-10-30T01:58:55Z" level=info msg="Deleting e2e-test-name=TestIstioAbortUpdateDeleteAllCanaryPods"
time="2023-10-30T01:58:55Z" level=info msg="service/istio-host-split-canary created\n" rollout=istio-host-split
time="2023-10-30T01:58:55Z" level=info msg="service/istio-host-split-stable created\n" rollout=istio-host-split
time="2023-10-30T01:58:56Z" level=info msg="virtualservice.networking.istio.io/istio-host-split-vsvc created\n" rollout=istio-host-split
time="2023-10-30T01:58:56Z" level=info msg="rollout.argoproj.io/istio-host-split created\n" rollout=istio-host-split
time="2023-10-30T01:58:56Z" level=info msg="Waiting for condition: status=Healthy" rollout=istio-host-split
time="2023-10-30T01:59:01Z" level=info msg="Condition 'status=Healthy' met after 4s" rollout=istio-host-split
time="2023-10-30T01:59:01Z" level=info msg="Updated rollout pod spec: 2023-10-30T01:59:01.021731372Z" rollout=istio-host-split
time="2023-10-30T01:59:01Z" level=info msg="Waiting for condition: status=Paused" rollout=istio-host-split
time="2023-10-30T01:59:03Z" level=info msg="Condition 'status=Paused' met after 2s" rollout=istio-host-split
time="2023-10-30T01:59:03Z" level=info msg="Pod expectation 'revision:2 pod count == 2' met" rollout=istio-host-split
time="2023-10-30T01:59:03Z" level=info msg="Promoted rollout" rollout=istio-host-split
time="2023-10-30T01:59:03Z" level=info msg="Waiting for condition: status=Paused" rollout=istio-host-split
time="2023-10-30T01:59:03Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=istio-host-split
time="2023-10-30T01:59:03Z" level=warning msg="unexpected revision:2 (hash 5554cff79c) pod count: expected 4, saw: 2" rollout=istio-host-split
time="2023-10-30T01:59:03Z" level=error msg="Pod expectation 'revision:2 pod count == 4' failed" rollout=istio-host-split
Name: istio-host-split
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 3/6
SetWeight: 20
ActualWeight: 20
Images: nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
Desired: 5
Current: 7
Updated: 2
Ready: 7
Available: 7
NAME KIND STATUS AGE INFO
⟳ istio-host-split Rollout �[94m◌�[0m Progressing 7s
├──# revision:2
│ └──⧉ �[33mistio-host-split-5554cff79c�[0m ReplicaSet �[94m◌�[0m Progressing 2s �[33mcanary�[0m
│ ├──□ istio-host-split-5554cff79c-2xq29 Pod �[32m✔�[0m Running 2s ready:1/1
│ ├──□ istio-host-split-5554cff79c-dt4cn Pod �[32m✔�[0m Running 2s ready:1/1
│ ├──□ istio-host-split-5554cff79c-4vhrj Pod �[94m◌�[0m Pending 0s ready:0/1
│ └──□ istio-host-split-5554cff79c-dzq9c Pod �[94m◌�[0m Pending 0s ready:0/1
└──# revision:1
└──⧉ �[32mistio-host-split-5b6ddfd769�[0m ReplicaSet �[32m✔�[0m Healthy 7s �[32mstable�[0m
├──□ istio-host-split-5b6ddfd769-f8srm Pod �[32m✔�[0m Running 7s ready:1/1
├──□ istio-host-split-5b6ddfd769-f9c8r Pod �[32m✔�[0m Running 7s ready:1/1
├──□ istio-host-split-5b6ddfd769-llctp Pod �[32m✔�[0m Running 7s ready:1/1
├──□ istio-host-split-5b6ddfd769-pjfp7 Pod �[32m✔�[0m Running 7s ready:1/1
└──□ istio-host-split-5b6ddfd769-xgkgq Pod �[32m✔�[0m Running 7s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-10-30T01:58:56Z"
generation: 2
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestIstioAbortUpdateDeleteAllCanaryPods
name: istio-host-split
namespace: default
resourceVersion: "14621"
uid: 6731811e-6029-4431-9508-ceab2a334b0d
spec:
replicas: 5
selector:
matchLabels:
app: istio-host-split
strategy:
canary:
canaryService: istio-host-split-canary
stableService: istio-host-split-stable
steps:
- setCanaryScale:
replicas: 2
- setWeight: 20
- pause: {}
- setCanaryScale:
replicas: 4
- setWeight: 40
- pause: {}
trafficRouting:
istio:
virtualService:
name: istio-host-split-vsvc
routes:
- primary
template:
metadata:
annotations:
update: "2023-10-30T01:59:01.021731372Z"
creationTimestamp: null
labels:
app: istio-host-split
spec:
containers:
- image: nginx:1.19-alpine
name: istio-host-split
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 7
availableReplicas: 7
blueGreen: {}
canary:
weights:
canary:
podTemplateHash: 5554cff79c
serviceName: istio-host-split-canary
weight: 20
stable:
podTemplateHash: 5b6ddfd769
serviceName: istio-host-split-stable
weight: 80
conditions:
- lastTransitionTime: "2023-10-30T01:59:01Z"
lastUpdateTime: "2023-10-30T01:59:01Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-10-30T01:59:01Z"
lastUpdateTime: "2023-10-30T01:59:01Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-10-30T01:59:01Z"
lastUpdateTime: "2023-10-30T01:59:01Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-10-30T01:59:03Z"
lastUpdateTime: "2023-10-30T01:59:03Z"
message: Rollout is paused
reason: RolloutPaused
status: Unknown
type: Progressing
- lastTransitionTime: "2023-10-30T01:59:03Z"
lastUpdateTime: "2023-10-30T01:59:03Z"
message: Rollout is paused
reason: RolloutPaused
status: "True"
type: Paused
controllerPause: true
currentPodHash: 5554cff79c
currentStepHash: 59c7688bb5
currentStepIndex: 2
message: CanaryPauseStep
observedGeneration: "2"
phase: Paused
readyReplicas: 7
replicas: 7
selector: app=istio-host-split
stableRS: 5b6ddfd769
updatedReplicas: 2
2023-10-30T01:58:56Z Normal RolloutAddedToInformer Rollout resource added to informer: default/istio-host-split
2023-10-30T01:58:56Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (5b6ddfd769)
2023-10-30T01:58:56Z Normal RolloutUpdated Rollout updated to revision 1
2023-10-30T01:58:56Z Normal NewReplicaSetCreated Created ReplicaSet istio-host-split-5b6ddfd769 (revision 1)
2023-10-30T01:58:56Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-10-30T01:58:56Z Normal ScalingReplicaSet Scaled up ReplicaSet istio-host-split-5b6ddfd769 (revision 1) from 0 to 5
2023-10-30T01:58:56Z Normal RolloutCompleted Rollout completed update to revision 1 (5b6ddfd769): Initial deploy
2023-10-30T01:59:00Z Normal SwitchService Switched selector for service 'istio-host-split-stable' from '' to '5b6ddfd769'
2023-10-30T01:59:01Z Normal SwitchService Switched selector for service 'istio-host-split-canary' from '' to '5b6ddfd769'
2023-10-30T01:59:01Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (5554cff79c)
2023-10-30T01:59:01Z Normal RolloutUpdated Rollout updated to revision 2
2023-10-30T01:59:01Z Normal NewReplicaSetCreated Created ReplicaSet istio-host-split-5554cff79c (revision 2)
2023-10-30T01:59:01Z (x3) Normal TrafficWeightUpdated Traffic weight updated
2023-10-30T01:59:01Z Normal ScalingReplicaSet Scaled up ReplicaSet istio-host-split-5554cff79c (revision 2) from 0 to 2
2023-10-30T01:59:02Z Normal SwitchService Switched selector for service 'istio-host-split-canary' from '5b6ddfd769' to '5554cff79c'
2023-10-30T01:59:02Z Normal RolloutStepCompleted Rollout step 1/6 completed (setCanaryScale{replicas: 2})
2023-10-30T01:59:03Z Normal Updated VirtualService VirtualService `istio-host-split-vsvc` set to desiredWeight '20'
2023-10-30T01:59:03Z Normal TrafficWeightUpdated Traffic weight updated from 0 to 20
2023-10-30T01:59:03Z Normal RolloutStepCompleted Rollout step 2/6 completed (setWeight: 20)
2023-10-30T01:59:03Z Normal RolloutPaused Rollout is paused (CanaryPauseStep)
2023-10-30T01:59:03Z Normal RolloutStepCompleted Rollout step 3/6 completed (pause)
2023-10-30T01:59:03Z Normal ScalingReplicaSet Scaled up ReplicaSet istio-host-split-5554cff79c (revision 2) from 2 to 4
time="2023-10-30T01:59:03Z" level=info msg="Deleting e2e-test-name=TestIstioAbortUpdateDeleteAllCanaryPods"
--- FAIL: TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods (8.58s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestIstioSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 2m 10s]
Raw output
Failed
=== RUN TestIstioSuite
--- FAIL: TestIstioSuite (90.41s)
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
103 tests found
There are 103 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite