You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/07 22:40:57 UTC

[I] Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec [beam]

github-actions[bot] opened a new issue, #38412:
URL: https://github.com/apache/beam/issues/38412

   
     Performance change found in the
     test: `test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec` for the metric: `runtime_sec`.
   
     For more information on how to triage the alerts, please look at
     `Triage performance alert issues` section of the [README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
   
   
   `Test description:` TFT Criteo test on 10 GB data with no Reshuffle.
   Test link - [Test link](https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py#L82)
   
   
   ```
   
   timestamp: Thu May  7 22:30:50 2026, metric_value: 2959.05
   timestamp: Wed May  6 22:32:51 2026, metric_value: 2827.72
   timestamp: Tue May  5 22:27:37 2026, metric_value: 2884.74 <---- Anomaly
   timestamp: Mon May  4 22:23:27 2026, metric_value: 2313.99
   timestamp: Sun May  3 22:18:02 2026, metric_value: 2220.72
   timestamp: Sat May  2 22:11:48 2026, metric_value: 2217.29
   timestamp: Fri May  1 22:20:21 2026, metric_value: 2338.62
   timestamp: Thu Apr 30 22:20:19 2026, metric_value: 2219.75
   timestamp: Thu Apr 30 00:58:51 2026, metric_value: 2309.95
   timestamp: Tue Apr 28 22:28:09 2026, metric_value: 2283.32
   timestamp: Mon Apr 27 22:32:10 2026, metric_value: 2391.52
   timestamp: Sun Apr 26 22:17:56 2026, metric_value: 2379.47
   timestamp: Sat Apr 25 22:14:38 2026, metric_value: 2423.89
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #38412: 
  Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec

URL: https://github.com/apache/beam/issues/38412


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #38412:
URL: https://github.com/apache/beam/issues/38412#issuecomment-5198169969

   
     Performance change found in the
     test: `test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec` for the metric: `runtime_sec`.
   
     For more information on how to triage the alerts, please look at
     `Triage performance alert issues` section of the [README](https://github.com/apache/beam/tree/master/sdks/python/apache_beam/testing/analyzers/README.md#triage-performance-alert-issues).
   
   
   `Test description:` TFT Criteo test on 10 GB data with no Reshuffle.
   Test link - [Test link](https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py#L82)
   
   
   ```
   
   timestamp: Wed Aug  5 22:34:27 2026, metric_value: 2951.01
   timestamp: Tue Aug  4 22:35:26 2026, metric_value: 2840.13
   timestamp: Mon Aug  3 22:51:13 2026, metric_value: 4266.28
   timestamp: Sun Aug  2 22:22:11 2026, metric_value: 2788.16
   timestamp: Sat Aug  1 22:24:18 2026, metric_value: 2748.90 <---- Anomaly
   timestamp: Fri Jul 31 22:28:26 2026, metric_value: 2387.70
   timestamp: Thu Jul 30 22:27:28 2026, metric_value: 2461.83
   timestamp: Wed Jul 29 22:15:06 2026, metric_value: 2319.85
   timestamp: Tue Jul 28 22:47:09 2026, metric_value: 3931.32
   timestamp: Mon Jul 27 22:21:04 2026, metric_value: 2322.61
   timestamp: Sun Jul 26 22:16:04 2026, metric_value: 2383.53
   timestamp: Sat Jul 25 22:14:05 2026, metric_value: 2329.38
   timestamp: Fri Jul 24 22:20:56 2026, metric_value: 2321.26
   timestamp: Thu Jul 23 22:34:43 2026, metric_value: 2337.92
   timestamp: Wed Jul 22 22:19:25 2026, metric_value: 2294.34
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #38412:
URL: https://github.com/apache/beam/issues/38412#issuecomment-5483274092

   https://metrics.beam.apache.org/d/C9nj1oxVk/tft-criteo-benchmarks?orgId=1&from=now-90d&to=now&refresh=1d


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org