Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PERFSCALE-3598] virt-density #154

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

rsevilla87
Copy link
Member

@rsevilla87 rsevilla87 commented Nov 25, 2024

Type of change

  • New feature

Description

New virt-density workload
cc @jeniferh

Related Tickets & Documents

  • Related Issue #
  • Closes #

Signed-off-by: Raul Sevilla <rsevilla@redhat.com>
@rsevilla87 rsevilla87 requested review from a team as code owners November 25, 2024 15:28
@rsevilla87 rsevilla87 changed the title [WIP] virt-density [PERFSCALE-3598] virt-density Nov 25, 2024
@rsevilla87 rsevilla87 added the WIP label Nov 25, 2024
@rsevilla87 rsevilla87 marked this pull request as draft November 25, 2024 15:36
@rsevilla87 rsevilla87 removed the WIP label Nov 25, 2024
Signed-off-by: Raul Sevilla <rsevilla@redhat.com>
Signed-off-by: Raul Sevilla <rsevilla@redhat.com>
Signed-off-by: Raul Sevilla <rsevilla@redhat.com>
@rsevilla87
Copy link
Member Author

rsevilla87 commented Nov 26, 2024

Some tests with a dev version

$ ./bin/amd64/kube-burner-ocp virt-density  --check-health=false --vms-per-node=50 
time="2024-11-26 12:26:22" level=info msg="🔥 Starting kube-burner (virt-density@66c91a76242e9d4b06f57c8a48ff052871a8901f) with UUID 3e2d1e4d-e4d8-4a17-a483-24f8416a5436" file="job.go:95"
time="2024-11-26 12:26:22" level=info msg="📈 Registered measurement: vmiLatency" file="factory.go:90"
time="2024-11-26 12:26:22" level=info msg="QPS: 20" file="job.go:325"
time="2024-11-26 12:26:22" level=info msg="Burst: 20" file="job.go:326"
time="2024-11-26 12:26:23" level=info msg="Job virt-density: 100 iterations with 1 VirtualMachine replicas" file="create.go:88"
time="2024-11-26 12:26:23" level=info msg="Triggering job: virt-density" file="job.go:121"
time="2024-11-26 12:26:23" level=info msg="Creating VM latency watcher for virt-density" file="vmi_latency.go:295"
time="2024-11-26 12:26:23" level=info msg="Creating VMI latency watcher for virt-density" file="vmi_latency.go:317"
time="2024-11-26 12:26:23" level=info msg="Creating VMI Pod latency watcher for virt-density" file="vmi_latency.go:338"
time="2024-11-26 12:26:24" level=info msg="10/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:24" level=info msg="20/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:24" level=info msg="30/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:25" level=info msg="40/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:25" level=info msg="50/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:26" level=info msg="60/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:26" level=info msg="70/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:27" level=info msg="80/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:27" level=info msg="90/100 iterations completed" file="create.go:127"
time="2024-11-26 12:26:36" level=info msg="Waiting up to 4h0m0s for actions to be completed" file="create.go:176"
time="2024-11-26 12:27:16" level=info msg="Actions in namespace virt-density completed" file="waiters.go:76"
time="2024-11-26 12:27:16" level=info msg="Verifying created objects" file="utils.go:91"
time="2024-11-26 12:27:16" level=info msg="Job virt-density took 54s" file="job.go:186"
time="2024-11-26 12:27:16" level=info msg="Stopping measurement: vmiLatency" file="factory.go:124"
time="2024-11-26 12:27:16" level=info msg="Evaluating latency thresholds" file="metrics.go:47"
time="2024-11-26 12:27:16" level=info msg="virt-density: VMIPending 99th: 118556ms max: 118569ms avg: 114830ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: PodInitialized 99th: 135291ms max: 136165ms avg: 132937ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: PodPodScheduled 99th: 124801ms max: 125033ms avg: 116502ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: PodContainersReady 99th: 143761ms max: 144368ms avg: 139582ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: VMReady 99th: 156992ms max: 157449ms avg: 149026ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: VMIScheduling 99th: 118699ms max: 118759ms avg: 115181ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: VMIScheduled 99th: 143760ms max: 144366ms avg: 138699ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: VMICreated 99th: 9000ms max: 9000ms avg: 7780ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: VMIRunning 99th: 156976ms max: 157375ms avg: 148976ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=info msg="virt-density: PodCreated 99th: 124773ms max: 124930ms avg: 116467ms" file="vmi_latency.go:401"
time="2024-11-26 12:27:16" level=error msg="podLatency: P99 VMIRunning latency (156.98s) higher than configured threshold: 15s" file="job.go:191"
time="2024-11-26 12:27:16" level=info msg="Finished execution with UUID: 3e2d1e4d-e4d8-4a17-a483-24f8416a5436" file="job.go:247"
time="2024-11-26 12:27:16" level=info msg="Garbage collecting jobs" file="job.go:268"
time="2024-11-26 12:27:17" level=info msg="Deleting 1 namespaces with label: kube-burner-job=virt-density" file="namespaces.go:67"
time="2024-11-26 12:27:57" level=error msg="podLatency: P99 VMIRunning latency (156.98s) higher than configured threshold: 15s" file="helpers.go:91"
time="2024-11-26 12:27:57" level=info msg="👋 kube-burner run completed with rc 4 for UUID 3e2d1e4d-e4d8-4a17-a483-24f8416a5436" file="helpers.go:93"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant