Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]: Generating report from multiple databases and test runs failure #921

Closed
vincent1chen opened this issue Jul 29, 2023 · 4 comments
Closed

[BUG]: Generating report from multiple databases and test runs failure #921

vincent1chen opened this issue Jul 29, 2023 · 4 comments
Assignees
@suryagupta4
Labels
area/cert-csi Issues pertaining to Cert CSI type/bug Something isn't working. This is the default label associated with a bug issue.
Milestone
v1.8.0

Comments

@vincent1chen
Copy link

Bug Description

I have multiple db. each db display a storage class. I wan to generate a full report contain different SC test run

/root/cert-csi --debug report --tr powerstore-nfs.db:test-run-5266b8dd --tr powerstore-nfs.db:test-run-3e44b10e --tr powerstore-raw.db:test-run-6bed9547 --tabular --xml

[root@registry ~]# ./cert-csi --db powerstore-raw.db list test-runs |grep test-run [2023-07-29 13:06:31] INFO Starting cert-csi; ver. 0.8.1
[2023-07-29 04:59:14 -0400 EDT] test-run-6bed9547 powerstore-raw 1 ProvisioningSuite SUCCESS

[root@registry ~]# ./cert-csi --db powerstore-nfs.db list test-runs |grep test-run
[2023-07-29 13:06:39] INFO Starting cert-csi; ver. 0.8.1
[2023-07-29 04:54:34 -0400 EDT] test-run-5266b8dd powerstore-nfs 1 VolumeCreationSuite SUCCESS
[2023-07-29 04:59:14 -0400 EDT] test-run-3e44b10e powerstore-nfs 1 ProvisioningSuite SUCCESS

when creating report of second db powerstore-raw, it report fail

[2023-07-29 12:57:06] ERROR Can't generate reports; error=test run with name test-run-6bed9547 not found
[2023-07-29 12:57:06] FATAL test run with name test-run-6bed9547 not found

Logs

[root@registry ~]# /root/cert-csi --debug report --tr powerstore-nfs.db:test-run-5266b8dd --tr powerstore-nfs.db:test-run-3e44b10e --tr powerstore-raw.db:test-run-6bed9547 --tabular --xml
[2023-07-29 12:57:04] INFO Starting cert-csi; ver. 0.8.1
[2023-07-29 12:57:04] INFO powerstore-nfs.db:test-run-5266b8dd
[2023-07-29 12:57:04] INFO powerstore-nfs.db:test-run-3e44b10e
[2023-07-29 12:57:04] INFO powerstore-raw.db:test-run-6bed9547
[2023-07-29 12:57:04] INFO Started generating reports...
Collecting metrics
1 / 1 [-------------------------------------------------------------------------] 100.00% ? p/s
Collecting metrics
1 / 1 [-------------------------------------------------------------------------] 100.00% ? p/s
Collecting metrics
1 / 1 [-------------------------------------------------------------------------] 100.00% ? p/s
[2023-07-29 12:57:04] INFO Started generating reports...
Collecting metrics
1 / 1 [-------------------------------------------------------------------------] 100.00% ? p/s
Generating plots
1 / 1 [-------------------------------------------------------------------------] 100.00% ? p/s
[2023-07-29 12:57:05] WARN No ResourceUsageMetrics provided
[2023-07-29 12:57:05] ERROR no ResourceUsageMetrics provided
report-test-run-5266b8dd:
Name: test-run-5266b8dd
Host: https://192.168.30.2:6443
StorageClass: powerstore-nfs
Minimum and Maximum EntityOverTime charts:

/root/.cert-csi/reports/test-run-5266b8dd/PodsCreatingOverTime.png

/root/.cert-csi/reports/test-run-5266b8dd/PodsReadyOverTime.png

/root/.cert-csi/reports/test-run-5266b8dd/PodsTerminatingOverTime.png

/root/.cert-csi/reports/test-run-5266b8dd/PvcsCreatingOverTime.png

/root/.cert-csi/reports/test-run-5266b8dd/PvcsBoundOverTime.png

Tests:

  1. TestCase: VolumeCreationSuite
    Started: 2023-07-29 04:54:35.028048304 -0400 -0400
    Ended: 2023-07-29 04:55:00.196481938 -0400 -0400
    Result: SUCCESS

         Stage metrics:
             PVCBind:
                 Avg: 6.561228813s
                 Min: 6.437851565s
                 Max: 6.684606062s
                 Histogram:
 /root/.cert-csi/reports/test-run-5266b8dd/VolumeCreationSuite1/PVCBind.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-5266b8dd/VolumeCreationSuite1/PVCBind_boxplot.png
             PVCDeletion:
                 Avg: 28.450599ms
                 Min: 25.42029ms
                 Max: 31.480908ms
                 Histogram:
 /root/.cert-csi/reports/test-run-5266b8dd/VolumeCreationSuite1/PVCDeletion.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-5266b8dd/VolumeCreationSuite1/PVCDeletion_boxplot.png
                 EntityNumberOverTime:
 /root/.cert-csi/reports/test-run-5266b8dd/VolumeCreationSuite1/EntityNumberOverTime.png

Collecting metrics
1 / 1 [-------------------------------------------------------------------------] 100.00% ? p/s
Generating plots
1 / 1 [-------------------------------------------------------------------------] 100.00% 3 p/s
report-test-run-3e44b10e:
Name: test-run-3e44b10e
Host: https://192.168.30.2:6443
StorageClass: powerstore-nfs
Minimum and Maximum EntityOverTime charts:

/root/.cert-csi/reports/test-run-3e44b10e/PodsCreatingOverTime.png

/root/.cert-csi/reports/test-run-3e44b10e/PodsReadyOverTime.png

/root/.cert-csi/reports/test-run-3e44b10e/PodsTerminatingOverTime.png

/root/.cert-csi/reports/test-run-3e44b10e/PvcsCreatingOverTime.png

/root/.cert-csi/reports/test-run-3e44b10e/PvcsBoundOverTime.png

Tests:

  1. TestCase: ProvisioningSuite
    Started: 2023-07-29 04:59:14.354888549 -0400 -0400
    Ended: 2023-07-29 05:01:07.795076269 -0400 -0400
    Result: SUCCESS

         Stage metrics:
             PVCAttachment:
                 Avg: 9.999015496s
                 Min: 6.435718856s
                 Max: 12.854833873s
                 Histogram:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCAttachment.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCAttachment_boxplot.png
             PVCBind:
                 Avg: 12.909082189s
                 Min: 7.363926425s
                 Max: 15.021018029s
                 Histogram:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCBind.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCBind_boxplot.png
             PVCCreation:
                 Avg: 27.683515917s
                 Min: 23.220328022s
                 Max: 32.017275004s
                 Histogram:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCCreation.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCCreation_boxplot.png
             PVCDeletion:
                 Avg: 3.889474822s
                 Min: 843.208014ms
                 Max: 8.173635848s
                 Histogram:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCDeletion.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCDeletion_boxplot.png
             PVCUnattachment:
                 Avg: 1.552756155s
                 Min: 488.741259ms
                 Max: 3.383959266s
                 Histogram:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCUnattachment.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PVCUnattachment_boxplot.png
             PodCreation:
                 Avg: 48.782795762s
                 Min: 38.733058078s
                 Max: 1m13.58172086s
                 Histogram:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PodCreation.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PodCreation_boxplot.png
             PodDeletion:
                 Avg: 4.253154799s
                 Min: 1.253376411s
                 Max: 8.507077853s
                 Histogram:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PodDeletion.png
                 BoxPlot:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/PodDeletion_boxplot.png
                 EntityNumberOverTime:
 /root/.cert-csi/reports/test-run-3e44b10e/ProvisioningSuite2/EntityNumberOverTime.png

[2023-07-29 12:57:06] ERROR Can't generate reports; error=test run with name test-run-6bed9547 not found
[2023-07-29 12:57:06] FATAL test run with name test-run-6bed9547 not found

here is two db file
db.zip

Screenshots

No response

Additional Environment Information

No response

Steps to Reproduce

just execute it
/root/cert-csi --debug report --tr powerstore-nfs.db:test-run-5266b8dd --tr powerstore-nfs.db:test-run-3e44b10e --tr powerstore-raw.db:test-run-6bed9547 --tabular --xml

Expected Behavior

the command run without problem

CSM Driver(s)

CSI driver for powerstore 2.7

Installation Type

helm 3.0

Container Storage Modules Enabled

No response

Container Orchestrator

K8s 1.24.4

Operating System

RHEL 9.1
@vincent1chen vincent1chen added needs-triage Issue requires triage. type/bug Something isn't working. This is the default label associated with a bug issue. labels Jul 29, 2023
@csmbot
Copy link
Collaborator

csmbot commented Jul 29, 2023

@vincent1chen: Thank you for submitting this issue!

The issue is currently awaiting triage. Please make sure you have given us as much context as possible.

If the maintainers determine this is a relevant issue, they will remove the needs-triage label and assign an appropriate priority label.

We want your feedback! If you have any questions or suggestions regarding our contributing process/workflow, please reach out to us at container.storage.modules@dell.com.

@AkshaySainiDell AkshaySainiDell added the area/cert-csi Issues pertaining to Cert CSI label Aug 1, 2023
@suryagupta4
Copy link

@vincent1chen
We have replicated the issue and tried generating report from multiple db's. We figured out from our analysis that while generating the report, it is fetching the test-run for the second db from the first db itself hence unable to find it and giving error as test run with name test-run-xxxxxxx not found.
We are currently working on the fix.

Thanks.

@suryagupta4 suryagupta4 added this to the v1.8.0 milestone Aug 2, 2023
@vincent1chen
Copy link
Author

vincent1chen commented Aug 2, 2023 via email

@AkshaySainiDell AkshaySainiDell added backlog and removed needs-triage Issue requires triage. labels Aug 4, 2023
@vincent1chen vincent1chen changed the title [BUG]: Generating report from multiple databases and test runs failure [BUG][cert-csi] : Generating report from multiple databases and test runs failure Aug 9, 2023
@suryagupta4 suryagupta4 mentioned this issue Aug 9, 2023
Merged
10 tasks
@suryagupta4
Copy link

Fix has been done and will be available in the upcoming release.

@shaynafinocchiaro shaynafinocchiaro changed the title [BUG][cert-csi] : Generating report from multiple databases and test runs failure [BUG]: Generating report from multiple databases and test runs failure Aug 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@suryagupta4 suryagupta4

Labels
area/cert-csi Issues pertaining to Cert CSI type/bug Something isn't working. This is the default label associated with a bug issue.
Projects
None yet
Milestone
v1.8.0
Development

No branches or pull requests
4 participants
@csmbot @AkshaySainiDell @suryagupta4 @vincent1chen