You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "tkaymak (via GitHub)" <gi...@apache.org> on 2026/06/15 19:48:22 UTC

[I] [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails consistently (io expansion-service shadowJar not found) [beam]

tkaymak opened a new issue, #38972:
URL: https://github.com/apache/beam/issues/38972

   ### What happened?
   
   The `beam_PreCommit_Yaml_Xlang_Direct` job (`:sdks:python:yamlIntegrationTests`) fails consistently on `master` — the last several scheduled runs are all red. It is not an intermittent flake.
   
   The external-Java yaml integration tests fail because the IO expansion-service shadowJar is missing at runtime:
   
   ```
   RuntimeError: .../sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.75.0-SNAPSHOT.jar not found. Please build the server with ...
   ValueError: Invalid transform specification at "IcebergAddFiles" ... jar not found
   ```
   
   Affected tests include (all using the external Java provider): `IcebergTest`, `Iceberg_Add_FilesTest`, `Iceberg_Add_Files_BatchTest`, `MongodbTest`, `FlattenTest`, `PartitionTest` (`WriteToJson_ExternalJavaProvider`). The `DatadogTest::test_only` failure (`Mismatch in recorded Datadog events!`) also appears in the same runs.
   
   The `yamlIntegrationTests` gradle task `dependsOn :sdks:java:io:expansion-service:build`, but the tests look up the **shadowJar** specifically, which `build` does not necessarily produce — so the jar is absent when the test resolves the external provider.
   
   Recent failing runs on `master`:
   - https://github.com/apache/beam/actions/runs/27549683373 (2026-06-15)
   - https://github.com/apache/beam/actions/runs/27530225891 (2026-06-15)
   - https://github.com/apache/beam/actions/runs/27516024051 (2026-06-14)
   
   ### Issue Priority
   
   Priority: 2 (default / most failing tests should be filed as P2)
   
   ### Issue Components
   
   - [X] Component: Python SDK
   - [ ] Component: Java SDK
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails consistently (io expansion-service shadowJar not found) [beam]

Posted by "bvolpato (via GitHub)" <gi...@apache.org>.
bvolpato commented on issue #38972:
URL: https://github.com/apache/beam/issues/38972#issuecomment-5275354406

   Looks like this was fixed by #38974.
   
   The original failure happened because the IO expansion service tasks were skipped without Java 17, not because `build` omitted `shadowJar`. Current `master` includes `:sdks:java:io:expansion-service:shadowJar` through `build`; a clean local build produced the shaded JAR, and recent YAML runs are green:
   
   - precommit: https://github.com/apache/beam/actions/runs/31651955715
   - postcommit: https://github.com/apache/beam/actions/runs/31651849727
   
   I think this can be closed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails consistently (io expansion-service shadowJar not found) [beam]

Posted by "tkaymak (via GitHub)" <gi...@apache.org>.
tkaymak closed issue #38972: [Failing Test]: beam_PreCommit_Yaml_Xlang_Direct fails consistently (io expansion-service shadowJar not found)
URL: https://github.com/apache/beam/issues/38972


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org