Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Performance Regression or Improvement: apache_beam_testing_benchmarks_inference_pytorch_image_classification_benchmarks_12_mean_load_model_latency_milli_secs:mean_load_model_latency_milli_secs #94

Open
AnandInguva opened this issue Dec 5, 2022 · 4 comments
Open

Performance Regression or Improvement: apache_beam_testing_benchmarks_inference_pytorch_image_classification_benchmarks_12_mean_load_model_latency_milli_secs:mean_load_model_latency_milli_secs #94

AnandInguva opened this issue Dec 5, 2022 · 4 comments
Labels
awaiting triage perf-alert run-inference

Comments

@AnandInguva
Copy link
Owner

Affected metric: mean_load_model_latency_milli_secs

timestamp: Wed Oct 19 17:01:07 2022, metric_value: 124964.62962962964
timestamp: Tue Oct 18 16:57:38 2022, metric_value: 121160.46913580247
timestamp: Mon Oct 17 17:10:41 2022, metric_value: 162701.8260869565
timestamp: Sun Oct 16 16:55:17 2022, metric_value: 104827.4625
timestamp: Sat Oct 15 16:49:05 2022, metric_value: 106417.73267326732
timestamp: Fri Oct 14 20:38:17 2022, metric_value: 123100.77906976744
timestamp: Fri Oct 14 17:00:38 2022, metric_value: 122012.8375
timestamp: Thu Oct 13 16:54:54 2022, metric_value: 126506.87804878049
timestamp: Wed Oct 12 16:57:40 2022, metric_value: 122344.3734939759
timestamp: Tue Oct 11 16:59:35 2022, metric_value: 130584.31818181818
timestamp: Mon Oct 10 17:07:44 2022, metric_value: 113059.78205128205 <---- Anomaly
timestamp: Sun Oct 9 16:54:18 2022, metric_value: 100019.20987654322
timestamp: Sat Oct 8 16:53:27 2022, metric_value: 112142.46153846153
timestamp: Fri Oct 7 16:55:07 2022, metric_value: 86159.09411764707
timestamp: Thu Oct 6 16:58:32 2022, metric_value: 91143.92
timestamp: Wed Oct 5 16:57:12 2022, metric_value: 90483.18478260869
timestamp: Tue Oct 4 17:04:20 2022, metric_value: 103199.88461538461
timestamp: Mon Oct 3 16:53:38 2022, metric_value: 112076.75308641975
timestamp: Sun Oct 2 16:55:40 2022, metric_value: 83415.18666666666
timestamp: Sat Oct 1 16:52:44 2022, metric_value: 111742.79207920792
timestamp: Fri Sep 30 16:53:55 2022, metric_value: 94316.90697674418
@AnandInguva
Copy link
Owner Author

Affected metric: mean_load_model_latency_milli_secs

timestamp: Wed Oct 19 17:01:07 2022, metric_value: 124964.62962962964
timestamp: Tue Oct 18 16:57:38 2022, metric_value: 121160.46913580247
timestamp: Mon Oct 17 17:10:41 2022, metric_value: 162701.8260869565
timestamp: Sun Oct 16 16:55:17 2022, metric_value: 104827.4625
timestamp: Sat Oct 15 16:49:05 2022, metric_value: 106417.73267326732
timestamp: Fri Oct 14 20:38:17 2022, metric_value: 123100.77906976744
timestamp: Fri Oct 14 17:00:38 2022, metric_value: 122012.8375
timestamp: Thu Oct 13 16:54:54 2022, metric_value: 126506.87804878049
timestamp: Wed Oct 12 16:57:40 2022, metric_value: 122344.3734939759
timestamp: Tue Oct 11 16:59:35 2022, metric_value: 130584.31818181818
timestamp: Mon Oct 10 17:07:44 2022, metric_value: 113059.78205128205 <---- Anomaly
timestamp: Sun Oct 9 16:54:18 2022, metric_value: 100019.20987654322
timestamp: Sat Oct 8 16:53:27 2022, metric_value: 112142.46153846153
timestamp: Fri Oct 7 16:55:07 2022, metric_value: 86159.09411764707
timestamp: Thu Oct 6 16:58:32 2022, metric_value: 91143.92
timestamp: Wed Oct 5 16:57:12 2022, metric_value: 90483.18478260869
timestamp: Tue Oct 4 17:04:20 2022, metric_value: 103199.88461538461
timestamp: Mon Oct 3 16:53:38 2022, metric_value: 112076.75308641975
timestamp: Sun Oct 2 16:55:40 2022, metric_value: 83415.18666666666
timestamp: Sat Oct 1 16:52:44 2022, metric_value: 111742.79207920792
timestamp: Fri Sep 30 16:53:55 2022, metric_value: 94316.90697674418

@AnandInguva
Copy link
Owner Author

Affected metric: mean_load_model_latency_milli_secs

timestamp: Wed Oct 19 17:01:07 2022, metric_value: 124964.62962962964
timestamp: Tue Oct 18 16:57:38 2022, metric_value: 121160.46913580247
timestamp: Mon Oct 17 17:10:41 2022, metric_value: 162701.8260869565
timestamp: Sun Oct 16 16:55:17 2022, metric_value: 104827.4625
timestamp: Sat Oct 15 16:49:05 2022, metric_value: 106417.73267326732
timestamp: Fri Oct 14 20:38:17 2022, metric_value: 123100.77906976744
timestamp: Fri Oct 14 17:00:38 2022, metric_value: 122012.8375
timestamp: Thu Oct 13 16:54:54 2022, metric_value: 126506.87804878049
timestamp: Wed Oct 12 16:57:40 2022, metric_value: 122344.3734939759
timestamp: Tue Oct 11 16:59:35 2022, metric_value: 130584.31818181818
timestamp: Mon Oct 10 17:07:44 2022, metric_value: 113059.78205128205 <---- Anomaly
timestamp: Sun Oct 9 16:54:18 2022, metric_value: 100019.20987654322
timestamp: Sat Oct 8 16:53:27 2022, metric_value: 112142.46153846153
timestamp: Fri Oct 7 16:55:07 2022, metric_value: 86159.09411764707
timestamp: Thu Oct 6 16:58:32 2022, metric_value: 91143.92
timestamp: Wed Oct 5 16:57:12 2022, metric_value: 90483.18478260869
timestamp: Tue Oct 4 17:04:20 2022, metric_value: 103199.88461538461
timestamp: Mon Oct 3 16:53:38 2022, metric_value: 112076.75308641975
timestamp: Sun Oct 2 16:55:40 2022, metric_value: 83415.18666666666
timestamp: Sat Oct 1 16:52:44 2022, metric_value: 111742.79207920792
timestamp: Fri Sep 30 16:53:55 2022, metric_value: 94316.90697674418

@AnandInguva
Copy link
Owner Author

Affected metric: mean_load_model_latency_milli_secs

timestamp: Wed Oct 19 17:01:07 2022, metric_value: 124964.62962962964
timestamp: Tue Oct 18 16:57:38 2022, metric_value: 121160.46913580247
timestamp: Mon Oct 17 17:10:41 2022, metric_value: 162701.8260869565
timestamp: Sun Oct 16 16:55:17 2022, metric_value: 104827.4625
timestamp: Sat Oct 15 16:49:05 2022, metric_value: 106417.73267326732
timestamp: Fri Oct 14 20:38:17 2022, metric_value: 123100.77906976744
timestamp: Fri Oct 14 17:00:38 2022, metric_value: 122012.8375
timestamp: Thu Oct 13 16:54:54 2022, metric_value: 126506.87804878049
timestamp: Wed Oct 12 16:57:40 2022, metric_value: 122344.3734939759
timestamp: Tue Oct 11 16:59:35 2022, metric_value: 130584.31818181818
timestamp: Mon Oct 10 17:07:44 2022, metric_value: 113059.78205128205 <---- Anomaly
timestamp: Sun Oct 9 16:54:18 2022, metric_value: 100019.20987654322
timestamp: Sat Oct 8 16:53:27 2022, metric_value: 112142.46153846153
timestamp: Fri Oct 7 16:55:07 2022, metric_value: 86159.09411764707
timestamp: Thu Oct 6 16:58:32 2022, metric_value: 91143.92
timestamp: Wed Oct 5 16:57:12 2022, metric_value: 90483.18478260869
timestamp: Tue Oct 4 17:04:20 2022, metric_value: 103199.88461538461
timestamp: Mon Oct 3 16:53:38 2022, metric_value: 112076.75308641975
timestamp: Sun Oct 2 16:55:40 2022, metric_value: 83415.18666666666
timestamp: Sat Oct 1 16:52:44 2022, metric_value: 111742.79207920792
timestamp: Fri Sep 30 16:53:55 2022, metric_value: 94316.90697674418

1 similar comment
@AnandInguva
Copy link
Owner Author

Affected metric: mean_load_model_latency_milli_secs

timestamp: Wed Oct 19 17:01:07 2022, metric_value: 124964.62962962964
timestamp: Tue Oct 18 16:57:38 2022, metric_value: 121160.46913580247
timestamp: Mon Oct 17 17:10:41 2022, metric_value: 162701.8260869565
timestamp: Sun Oct 16 16:55:17 2022, metric_value: 104827.4625
timestamp: Sat Oct 15 16:49:05 2022, metric_value: 106417.73267326732
timestamp: Fri Oct 14 20:38:17 2022, metric_value: 123100.77906976744
timestamp: Fri Oct 14 17:00:38 2022, metric_value: 122012.8375
timestamp: Thu Oct 13 16:54:54 2022, metric_value: 126506.87804878049
timestamp: Wed Oct 12 16:57:40 2022, metric_value: 122344.3734939759
timestamp: Tue Oct 11 16:59:35 2022, metric_value: 130584.31818181818
timestamp: Mon Oct 10 17:07:44 2022, metric_value: 113059.78205128205 <---- Anomaly
timestamp: Sun Oct 9 16:54:18 2022, metric_value: 100019.20987654322
timestamp: Sat Oct 8 16:53:27 2022, metric_value: 112142.46153846153
timestamp: Fri Oct 7 16:55:07 2022, metric_value: 86159.09411764707
timestamp: Thu Oct 6 16:58:32 2022, metric_value: 91143.92
timestamp: Wed Oct 5 16:57:12 2022, metric_value: 90483.18478260869
timestamp: Tue Oct 4 17:04:20 2022, metric_value: 103199.88461538461
timestamp: Mon Oct 3 16:53:38 2022, metric_value: 112076.75308641975
timestamp: Sun Oct 2 16:55:40 2022, metric_value: 83415.18666666666
timestamp: Sat Oct 1 16:52:44 2022, metric_value: 111742.79207920792
timestamp: Fri Sep 30 16:53:55 2022, metric_value: 94316.90697674418

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
awaiting triage perf-alert run-inference
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AnandInguva