You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/08/14 22:08:52 UTC
[GitHub] [beam] github-actions[bot] opened a new issue, #28001: Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs
github-actions[bot] opened a new issue, #28001:
URL: https://github.com/apache/beam/issues/28001
Performance change found in the
test: `pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs` for the metric: `mean_inference_batch_latency_micro_secs`.
For more information on how to triage the alerts, please look at
`Triage performance alert issues` section of the [README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
`Test description:` Pytorch image classification on 50k images of size 224 x 224 with resnet 101. Test link - https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L34 Test dashboard - http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=2
```
timestamp: Mon Aug 14 18:19:03 2023, metric_value: 4499253.64
timestamp: Sun Aug 13 18:18:21 2023, metric_value: 4579284.80
timestamp: Sat Aug 12 18:18:01 2023, metric_value: 4540231.68
timestamp: Fri Aug 11 18:22:50 2023, metric_value: 4562882.83
timestamp: Thu Aug 10 18:31:22 2023, metric_value: 4706314.64
timestamp: Wed Aug 9 18:20:39 2023, metric_value: 4499391.44
timestamp: Tue Aug 8 19:33:41 2023, metric_value: 4648045.91
timestamp: Mon Aug 7 18:21:00 2023, metric_value: 4527919.92
timestamp: Sun Aug 6 18:18:21 2023, metric_value: 4593467.59 <---- Anomaly
timestamp: Sat Aug 5 18:18:37 2023, metric_value: 4640704.50
timestamp: Fri Aug 4 18:18:47 2023, metric_value: 4701437.57
timestamp: Thu Aug 3 18:30:50 2023, metric_value: 4478775.48
timestamp: Wed Aug 2 18:22:25 2023, metric_value: 4627538.10
timestamp: Wed Aug 2 13:43:54 2023, metric_value: 4730867.34
timestamp: Tue Aug 1 18:37:26 2023, metric_value: 4756923.80
timestamp: Tue Aug 1 18:20:33 2023, metric_value: 4580034.19
timestamp: Mon Jul 31 18:20:31 2023, metric_value: 4585577.94
timestamp: Mon Jul 31 13:34:56 2023, metric_value: 4613043.67
timestamp: Sun Jul 30 18:18:44 2023, metric_value: 4748424.84
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] riteshghorse commented on issue #28001: Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs
Posted by "riteshghorse (via GitHub)" <gi...@apache.org>.
riteshghorse commented on issue #28001:
URL: https://github.com/apache/beam/issues/28001#issuecomment-1680806903
<img width="967" alt="image" src="https://github.com/apache/beam/assets/25881114/95dfb1fc-1b5e-4668-b0d1-c9c640c26e75">
resnet101 latency hasn't changed much
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] riteshghorse closed issue #28001: Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs
Posted by "riteshghorse (via GitHub)" <gi...@apache.org>.
riteshghorse closed issue #28001:
Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs
URL: https://github.com/apache/beam/issues/28001
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] riteshghorse commented on issue #28001: Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs
Posted by "riteshghorse (via GitHub)" <gi...@apache.org>.
riteshghorse commented on issue #28001:
URL: https://github.com/apache/beam/issues/28001#issuecomment-1680805021
Close as not planned
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org