You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/27 22:14:24 UTC
[I] Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs [beam]
github-actions[bot] opened a new issue, #34455:
URL: https://github.com/apache/beam/issues/34455
Performance change found in the
test: `pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs` for the metric: `mean_inference_batch_latency_micro_secs`.
For more information on how to triage the alerts, please look at
`Triage performance alert issues` section of the [README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
`Test description:` Pytorch image classification on 50k images of size 224 x 224 with resnet 101.
Test link - https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L34
Test dashboard - http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=2
```
timestamp: Thu Mar 27 04:32:44 2025, metric_value: 5363166.44
timestamp: Wed Mar 26 04:24:41 2025, metric_value: 5115405.84
timestamp: Tue Mar 25 04:33:28 2025, metric_value: 5296398.45
timestamp: Mon Mar 24 04:22:29 2025, metric_value: 4834688.47
timestamp: Sun Mar 23 04:22:59 2025, metric_value: 5306487.33 <---- Anomaly
timestamp: Sat Mar 22 04:21:05 2025, metric_value: 4700625.48
timestamp: Fri Mar 21 04:27:56 2025, metric_value: 4830325.58
timestamp: Thu Mar 20 13:35:07 2025, metric_value: 5293301.37
timestamp: Thu Mar 20 08:47:19 2025, metric_value: 4719987.77
timestamp: Thu Mar 20 04:25:57 2025, metric_value: 4970607.72
timestamp: Wed Mar 19 16:16:12 2025, metric_value: 4628403.38
timestamp: Wed Mar 19 04:22:38 2025, metric_value: 5224294.28
timestamp: Tue Mar 18 04:24:57 2025, metric_value: 5210045.26
timestamp: Mon Mar 17 04:27:49 2025, metric_value: 4726505.71
timestamp: Sun Mar 16 04:21:38 2025, metric_value: 4759518.45
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34455:
Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs
URL: https://github.com/apache/beam/issues/34455
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org