You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/08/20 21:41:50 UTC
[I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
github-actions[bot] opened a new issue, #39835:
URL: https://github.com/apache/beam/issues/39835
The PostCommit Java ValidatesRunner Dataflow Streaming Engine is failing over 50% of the time.
Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming_Engine.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=4&var-Workflow=PostCommit%20Java%20ValidatesRunner%20Dataflow%20Streaming%20Engine
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-5393881801
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-6382652825
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-5895485799
The timeline is designed such that different variants spans throughout the day
https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming_Engine.yml?query=event%3Aschedule
https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming_TagEncodingV2.yml?query=event%3Aschedule
https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Dataflow_Streaming.yml?query=event%3Aschedule
-----------
There is an ongoing effort to improve Validates runner test, including group different validate runner test into a single Dataflow pipeline, which will mitigate capacity issues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-5676278992
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-5861634889
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-5893124083
I check the recent failures and I found out it’s not a real bug as different runs fail on different tests like ParDo timers one day, combine/flatten another and even the same SHA can pass then fail
and what’s actually happening is the Dataflow jobs get stuck in RUNNING and hit the 15 min test timeout (or sometimes gcp just can’t spin up workers in us central1 because of stockouts)
maybe we can run this job at a quieter time and monitor it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #39835: The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky
URL: https://github.com/apache/beam/issues/39835
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #39835: The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky
URL: https://github.com/apache/beam/issues/39835
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-6059838816
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #39835: The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky
URL: https://github.com/apache/beam/issues/39835
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-5654119428
@damccorm , @Abacn The workflow is failing on different tests like PAssertTest, WindowingTest and always with the same error:
```
java.lang.RuntimeException: Startup of the worker pool in us-central1 failed to bring up any of the desired 1 workers. This is likely a quota issue or a Compute Engine stockout. The service will retry. For troubleshooting steps, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-pool-failure for help troubleshooting. ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS: Instance 'windowingtest0testwindowp-09111349-676d-harness-q6c7' creation failed: The zone 'projects/apache-beam-testing/zones/us-central1-c' does not have enough resources available to fulfill the request. 'NULL:0/NULL:0/NULL:0 (state:STOCKOUT, sub-state:STOCKOUT, resource type:compute)'.
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:149)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:101)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:56)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostCommit Java ValidatesRunner Dataflow Streaming Engine job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #39835:
URL: https://github.com/apache/beam/issues/39835#issuecomment-5627809732
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org