You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/04 21:34:28 UTC

[I] The PostCommit Python Dependency job is flaky [beam]

github-actions[bot] opened a new issue, #30799:
URL: https://github.com/apache/beam/issues/30799

   The PostCommit Python Dependency is failing over 50% of the time 
   Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Dependency.yml?query=is%3Afailure+branch%3Amaster to see the logs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2498724752

   @damondouglas @liferoad each have a Python-related commit in there.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2408603244

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2590263544

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3402346600

   ```
   hotfix==0.7,pyasn1==0.6.1,pyasn1_modules==0.4.2,pycparser==2.23,pydantic==2.12.1,pydantic_core==2.41.3,pydot==1.4.2,Pygments==2.19.2,PyHamcrest==2.1.0,PyJWT==2.10.1,pymilvus==2.5.16,pymongo==4.15.3,PyMySQL==1.1.2,pyparsing==3.3.0a1,pytest==8.4.2,pytest-timeout==2.4.0,pytest-xdist==3.8.0,python-dateutil==2.9.0.post0,python-dotenv==1.1.1,python-tds==1.17.1,pytz==2025.2,PyYAML==6.0.3,redis==5.3.1,referencing==0.36.2,regex==2025.9.18,requests==2.32.5,requests-mock==1.12.1,rpds-py==0.27.1,rsa==4.9.1,safetensors==0.6.2,scikit-learn==1.6.1,scipy==1.13.1,scramp==1.4.6,SecretStorage==3.3.3,sentence-transformers==3.3.1,shapely==2.0.7,six==1.17.0,sniffio==1.3.1,sortedcontainers==2.4.0,SQLAlchemy==2.0.44,sqlalchemy_pytds==1.0.2,sqlparse==0.5.3,sympy==1.14.0,tenacity==8.5.0,testcontainers==4.13.2,threadpoolctl==3.6.0,tokenizers==0.22.1,tomli==2.3.0,torch==2.8.0,tqdm==4.67.1,transformers==4.57.0,triton==3.4.0,typing-inspection==0.4.2,typing_extensions==4.15.0,tzdata==2025.2,ujson==5.11.0,urllib
 3==2.5.0,virtualenv-clone==0.5.7,websockets==15.0.1,wrapt==2.0.0rc4,yarl==1.22.0,zipp==3.23.0,zstandard==0.25.0
   2025-10-14T11:22:53.9397980Z py39-embeddings: commands_pre[0]> python --version
   2025-10-14T11:22:53.9398771Z Python 3.9.22
   2025-10-14T11:22:53.9399426Z py39-embeddings: commands_pre[1]> pip --version
   2025-10-14T11:22:54.3339071Z pip 25.2 from /runner/_work/beam/beam/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/pip (python 3.9)
   2025-10-14T11:22:54.4337444Z py39-embeddings: commands_pre[2]> pip check
   2025-10-14T11:22:57.1338491Z No broken requirements found.
   2025-10-14T11:22:57.2344955Z py39-embeddings: commands_pre[3]> bash /runner/_work/beam/beam/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh
   2025-10-14T11:22:57.3338292Z py39-embeddings: commands[0]> /bin/sh -c 'pip freeze | grep -E sentence-transformers'
   2025-10-14T11:22:58.1341041Z sentence-transformers==3.3.1
   2025-10-14T11:22:58.1342310Z py39-embeddings: commands[1]> /bin/sh -c 'pip freeze | grep -E google-cloud-aiplatform'
   2025-10-14T11:22:59.0338386Z google-cloud-aiplatform==1.120.0
   2025-10-14T11:22:59.0341483Z py39-embeddings: commands[2]> /bin/sh -c 'pytest apache_beam/ml/transforms/embeddings -o junit_suite_name=py39-embeddings --junitxml=pytest_py39-embeddings.xml -n 6 ; ret=$?; [ $ret = 5 ] && exit 0 || exit $ret'
   2025-10-14T11:23:40.1341305Z 
   ```
   
   `sentence-transformers==3.3.1` is used although we have https://github.com/liferoad/beam/blob/master/sdks/python/setup.py#L172.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3402423415

   Trying https://github.com/apache/beam/pull/36506


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2498813105

   I suspect some race conditions when we save the models withe the same name. Will try to do some fixes later. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2496246468

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-5433454073

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2498729614

   Confirmed by random inspection that the Tensorflow 2.12 variant is always the failure.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3255808162

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3164757922

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-4533731214

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2444908180

   ```
   2024-10-29T11:15:12.3297202Z       if not SentenceTransformer:
   2024-10-29T11:15:12.3297585Z >       raise ImportError(
   2024-10-29T11:15:12.3298106Z             "sentence-transformers is required to use "
   2024-10-29T11:15:12.3298603Z             "SentenceTransformerEmbeddings."
   2024-10-29T11:15:12.3299255Z             "Please install it with using `pip install sentence-transformers`.")
   2024-10-29T11:15:12.3300468Z E       ImportError: sentence-transformers is required to use SentenceTransformerEmbeddings.Please install it with using `pip install sentence-transformers`.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-5139329371

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2053718490

   Looks better now: https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Dependency.yml?query=branch%3Amaster . Close this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2498719491

   ```
   $ git log 3f8fabeeb532fa8fca3a50a75ed21905ca44fc11..a06454a22084242b4fe089b570fd090810885885 --oneline
   a06454a2208 Upgrade GCP-BOM to 26.49.0 (#32864)
   10c7eb34af1 fix the flink runner doc (#33182)
   5d3088f7489 Bump zetasql version to 2024.11.1 (#32902)
   d2e9928da49 Revert "Fixed the broken beam python on flink with PortableRunner" (#33178)
   fc9083b35f9 Create Python SDK Distroless variant (#33160)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2498720592

   Succeeded at fc9083b then failed at a06454a


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "jrmccluskey (via GitHub)" <gi...@apache.org>.
jrmccluskey commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2501710301

   That test environment is defined [here](https://github.com/apache/beam/blob/292da721a575732d257077e2220a2e49fb9045da/sdks/python/tox.ini#L407)
   
   Even the 2.18.0 job is wrong, this test environment is supposed to be pinned to TF 2.12 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-4229214918

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2528183281

   Green for the last two weeks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3368553365

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2498712502

   Should this be escalated to a clearer bug about incompatibility with Tensorflow 2.12? Is it new and reproducible?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2613797231

   Fixed after https://github.com/apache/beam/pull/33740


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2447871038

   Seems to be resolved - https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Dependency.yml?query=branch%3Amaster


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3030557238

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3499483814

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3402212599

   ```
   __ ERROR collecting apache_beam/ml/transforms/embeddings/huggingface_test.py ___
   apache_beam/ml/transforms/embeddings/huggingface_test.py:36: in <module>
       from apache_beam.ml.transforms.embeddings.huggingface import SentenceTransformerEmbeddings
   apache_beam/ml/transforms/embeddings/huggingface.py:37: in <module>
       from sentence_transformers import SentenceTransformer
   target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/sentence_transformers/__init__.py:22: in <module>
       from sentence_transformers.trainer import SentenceTransformerTrainer
   target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/sentence_transformers/trainer.py:14: in <module>
       from transformers import EvalPrediction, PreTrainedTokenizerBase, Trainer, TrainerCallback
   <frozen importlib._bootstrap>:1055: in _handle_fromlist
       ???
   target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/transformers/utils/import_utils.py:2317: in __getattr__
       module = self._get_module(self._class_to_module[name])
   target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/transformers/utils/import_utils.py:2347: in _get_module
       raise e
   target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/transformers/utils/import_utils.py:2345: in _get_module
       return importlib.import_module("." + module_name, self.__name__)
   /opt/hostedtoolcache/Python/3.9.22/x64/lib/python3.9/importlib/__init__.py:127: in import_module
       return _bootstrap._gcd_import(name[level:], package, level)
   target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/transformers/trainer.py:311: in <module>
       class Trainer:
   target/.tox-py39-embeddings/py39-embeddings/lib/python3.9/site-packages/transformers/trainer.py:5593: in Trainer
       def _get_num_items_in_batch(self, batch_samples: list, device: torch.device) -> int | None:
   E   TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'
   ```
   
   failing since Oct 3rd, likely due to dependency change in #35056. @jrmccluskey could you please take a look? This currently blocks release
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3402286037

   It still happens on the latest run of the workflow


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3402351220

   I think we should also pin them in https://github.com/liferoad/beam/blob/master/sdks/python/tox.ini


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2496307220

   ```
   =========================== short test summary info ============================
   FAILED apache_beam/ml/inference/tensorflow_inference_test.py::TFRunInferenceTest::test_predict_tensor_with_batch_size
   FAILED apache_beam/ml/inference/tensorflow_inference_test.py::TFRunInferenceTest::test_predict_tensor_with_large_model
   FAILED apache_beam/ml/inference/tensorflow_inference_test.py::TFRunInferenceTest::test_predict_numpy_with_batch_size
   FAILED apache_beam/ml/inference/tensorflow_inference_test.py::TFRunInferenceTest::test_predict_numpy_with_large_model
   ====== 4 failed, 10 passed, 11 skipped, 18 warnings in 1244.76s (0:20:44) ======
   py39-tensorflow-212: exit 1 (1247.30 seconds) /runner/_work/beam/beam/sdks/python/test-suites/tox/py39/build/srcs/sdks/python> /bin/sh -c 'pytest -o junit_suite_name=py39-tensorflow-212 --junitxml=pytest_py39-tensorflow-212.xml -n 6 -m uses_tf ; ret=$?; [ $ret = 5 ] && exit 0 || exit $ret' pid=18090
   py39-tensorflow-212: commands_post[0]> bash /runner/_work/beam/beam/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh
     py39-tensorflow-212: FAIL code 1 (1605.92=setup[356.45]+cmd[0.01,0.24,1.38,0.03,0.44,1247.30,0.07] seconds)
     evaluation failed :( (1606.10 seconds)
   
   > Task :sdks:python:test-suites:tox:py39:testPy39tensorflow-212 FAILED
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2501541505

   [The past successful job](https://productionresultssa1.blob.core.windows.net/actions-results/3fb5b352-8753-45d4-b42a-0932ebfc743e/workflow-job-run-7a640e5b-4e74-5b8f-6dd4-d939396cb305/logs/job/job-logs.txt?rsct=text%2Fplain&se=2024-11-26T16%3A59%3A56Z&sig=UuwyqY3JcWQ2RlBl0ZA%2B5scFJJwBNJqm5vcaJdQoSU4%3D&ske=2024-11-27T04%3A40%3A29Z&skoid=ca7593d4-ee42-46cd-af88-8b886a2f84eb&sks=b&skt=2024-11-26T16%3A40%3A29Z&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skv=2024-11-04&sp=r&spr=https&sr=b&st=2024-11-26T16%3A49%3A51Z&sv=2024-11-04)  has this:
   ```
   2024-11-20T17:48:30.5153308Z py39-tensorflow-212: commands_pre[2]> pip check
   2024-11-20T17:48:32.3144642Z No broken requirements found.
   2024-11-20T17:48:32.4144869Z py39-tensorflow-212: commands_pre[3]> bash /runner/_work/beam/beam/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh
   2024-11-20T17:48:32.5144417Z py39-tensorflow-212: commands[0]> /bin/sh -c 'pip freeze | grep -E tensorflow'
   2024-11-20T17:48:33.0143264Z tensorflow==2.18.0
   2024-11-20T17:48:33.0146899Z tensorflow-estimator==2.12.0
   2024-11-20T17:48:33.0149237Z tensorflow-hub==0.16.1
   2024-11-20T17:48:33.0156149Z tensorflow-io-gcs-filesystem==0.37.1
   ```
   
   The recently failed one has:
   ```
   2024-11-25T20:55:45.8184959Z py39-tensorflow-212: commands[0]> /bin/sh -c 'pip freeze | grep -E tensorflow'
   2024-11-25T20:55:46.2184387Z tensorflow==2.15.1
   2024-11-25T20:55:46.2185214Z tensorflow-estimator==2.15.0
   2024-11-25T20:55:46.2185940Z tensorflow-hub==0.16.1
   2024-11-25T20:55:46.2187825Z tensorflow-io-gcs-filesystem==0.37.1
   2024-11-25T20:55:46.2190040Z tensorflow-metadata==1.15.0
   2024-11-25T20:55:46.2192088Z tensorflow-serving-api==2.15.1
   2024-11-25T20:55:46.2193701Z tensorflow-transform==1.15.0
   ```
   
   Very strange.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2855063178

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3266464026

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-6508881157

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Abacn (via GitHub) via github" <gi...@beam.apache.org>.
Abacn closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2781942563

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "akashorabek (via GitHub)" <gi...@apache.org>.
akashorabek closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "jrmccluskey (via GitHub)" <gi...@apache.org>.
jrmccluskey commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3402275640

   This should have been fixed in #36385? The problem is that the transformers package version started using the 3.10+ union syntax, which makes sense given that Python 3.9 is hitting EOL this month and packages are dropping support. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-3509942650

   Culprit: https://github.com/apache/beam/pull/36665


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-4251558648

   Stabilized


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30799: The PostCommit Python Dependency job is flaky
URL: https://github.com/apache/beam/issues/30799


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-2635629929

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The PostCommit Python Dependency job is flaky [beam]

Posted by "github-actions[bot] (via GitHub) via github" <gi...@beam.apache.org>.
github-actions[bot] commented on issue #30799:
URL: https://github.com/apache/beam/issues/30799#issuecomment-6549425519

   Reopening since the workflow is still flaky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org