You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/26 18:50:29 UTC

[I] The PreCommit Python job is flaky [beam]

github-actions[bot] opened a new issue, #34739:
URL: https://github.com/apache/beam/issues/34739

   The PreCommit Python is failing over 50% of the time.
   Please visit https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
   See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=7&var-Workflow=PreCommit%20Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-4334303009

   cc: @damccorm @Abacn @Amar3tto 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3140252988

   Culprit: https://github.com/apache/beam/pull/35715. (Green run with the revert)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3801904617

   https://github.com/apache/beam/actions/runs/21370864666/job/61514747422
   The job beam_PreCommit_Python (Run Python PreCommit 3.10) has failed and based on the logs and investigation, the root cause is
   The run_tox_cleanup.sh script fails during the commands_post phase when find finds no files to delete and the script uses set -e so when find returns exit code 1 (no matches) the script exits with code 1 causing tox to fail even though all tests passed (101 passed, 16 skipped) so the cleanup script treats no files found as an error but this  expected when theres nothing to clean
   so I suggest to add " || true " to the find command so it doesnt fail when no files are found
   @damccorm 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-4530866519

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3841124155

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3198840299

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3400861080

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-4334301297

   I did an investigation to the last failures and I found out that failing jobs share the same error signature:
   
   - MLTest.test_ml_preprocessing_yaml fails.
   - Failed: Timeout (>600.0s) from pytest-timeout
   - apache_beam.utils.subprocess_server: Error bringing up service
   - repeated Waiting for grpc channel to be ready at localhost:<port>
   
   Passing/failing versions vary by run, but the core failure is the same test behavior (slow/hung service readiness), not different independent failures.
   
   So MLTest.test_ml_preprocessing_yaml is intermittently timing out while waiting for a local expansion/subprocess grpc service to become ready and under workflow load and newer Python versions, startup latency or readiness race conditions are causing the 600s timeout path


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "claudevdm (via GitHub)" <gi...@apache.org>.
claudevdm closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-4355177447

   I'm wondering if some settings in https://github.com/apache/beam/pull/35915 could be causing increased flakiness as the environment evolves. These settings were only applied to PreCommit Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "shunping (via GitHub)" <gi...@apache.org>.
shunping commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-5549022180

   We have 'google-cloud-bigtable<3,>=2.42.0' as the dep constraint.
   
   The failed test happened after google-cloud-bigtable 2.44 is available.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "shunping (via GitHub)" <gi...@apache.org>.
shunping commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-2829184887

   Fixed by #34737.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3399560469

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3567562131

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3551045324

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3408755143

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3138477139

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-4137410547

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3889126994

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-5546719689

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "A1K28 (via GitHub)" <gi...@apache.org>.
A1K28 commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3200120161

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-3765975078

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "shunping (via GitHub)" <gi...@apache.org>.
shunping closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "aIbrahiim (via GitHub)" <gi...@apache.org>.
aIbrahiim commented on issue #34739:
URL: https://github.com/apache/beam/issues/34739#issuecomment-4359504101

   > I'm wondering if some settings in [#35915](https://github.com/apache/beam/pull/35915) could be causing increased flakiness as the environment evolves. These settings were only applied to PreCommit Python
   
   I think it mainly forced more sequential execution / timeout related stability change for the precommit python and some env vars there were noted as not fully wired at the time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PreCommit Python job is flaky [beam]

Posted by "shunping (via GitHub)" <gi...@apache.org>.
shunping closed issue #34739: The PreCommit Python job is flaky
URL: https://github.com/apache/beam/issues/34739


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org