You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/01/09 18:46:51 UTC

[I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

github-actions[bot] opened a new issue, #34990:
URL: https://github.com/apache/beam/issues/34990

   The PostCommit Python Xlang Gcp Dataflow is failing over 50% of the time.
   Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Xlang_Gcp_Dataflow.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
   See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=8&var-Workflow=PostCommit%20Python%20Xlang%20Gcp%20Dataflow


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "akashorabek (via GitHub)" <gi...@apache.org>.
akashorabek closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3617328027

   Timing out since Oct 30, but not get detected by the bot. Likely the bot does not handle timing out and cancelled jobs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3617355116

   Likely due to #36654 by checking commits of the first failing run (https://github.com/apache/beam/commits/6b4dc555a245b4f82250677de21890955867314c) and last succeeded run (https://github.com/apache/beam/commits/fe07fe767098663c032f84df74b4b4f7723bf607).
   
   There is a Spanner write job stuck (e.g. job id `2025-12-04_12_26_17-394437020649606185`)
   
   Elapsed time 4 hr 9 min
   
   ```
   "org.apache.beam.sdk.util.UserCodeException: com.google.cloud.spanner.SpannerException: UNAVAILABLE: com.google.api.gax.rpc.UnavailableException: io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
   	at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
   	at org.apache.beam.sdk.io.gcp.spanner.ReadSpannerSchema$DoFnInvoker.invokeProcessElement(Unknown Source)
   	at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForWindowObservingParDo(FnApiDoFnRunner.java:639)
   ...
   Caused by: com.google.cloud.spanner.SpannerException: UNAVAILABLE: com.google.api.gax.rpc.UnavailableException: io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
   	at com.google.cloud.spanner.SpannerExceptionFactory.newSpannerExceptionPreformatted(SpannerExceptionFactory.java:396)
   	at com.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:223)
   	at com.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:135)
   	at com.google.cloud.spanner.SessionPool$WaiterFuture.pollUninterruptiblyWithTimeout(SessionPool.java:1975)
   	at com.google.cloud.spanner.SessionPool$WaiterFuture.get(SessionPool.java:1920)
   ...
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-4701325646

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3617415050

   checked again timing increase timeout won't work. I see other spannerio jobs spinned up 1 hr before test timeout also failing same error.
   
   e.g. 2025-12-04_23_49_55-7218261213000658994 started at December 5, 2025, 2:49:56 AM GMT-5
   
   https://github.com/apache/beam/actions/runs/19953568834/job/57218262474 timed out at Fri, 05 Dec 2025 09:22:27 GMT


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-5896456553

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-4173157012

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "jrmccluskey (via GitHub)" <gi...@apache.org>.
jrmccluskey closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3960244720

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3730156860

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3402449833

   due to #36393


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3354812744

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3626618660

   Fixed by #37018
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-5550055047

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-4533738571

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3352782065

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3381354305

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-3736657981

   Fixed by #37270


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-4618201103

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "shunping (via GitHub)" <gi...@apache.org>.
shunping closed issue #34990: The PostCommit Python Xlang Gcp Dataflow job is flaky
URL: https://github.com/apache/beam/issues/34990


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Xlang Gcp Dataflow job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34990:
URL: https://github.com/apache/beam/issues/34990#issuecomment-5841803868

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org