You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "Abacn (via GitHub)" <gi...@apache.org> on 2023/02/15 15:49:47 UTC

[GitHub] [beam] Abacn opened a new issue, #25207: [Failing Test]: beam_PreCommit_Java_GCP_IO_Direct high possibility timeout

Abacn opened a new issue, #25207:
URL: https://github.com/apache/beam/issues/25207

   ### What happened?
   
   When not timing out, the test takes ~30-40 min; or it timing out after 2 hour: https://ci-beam.apache.org/job/beam_PreCommit_Java_GCP_IO_Direct_Cron/
   
   From the log, in the cases of timeout, the task gets stuck early:
   ```
   17:53:23 > Task :sdks:java:io:google-cloud-platform:expansion-service:distZip
   17:53:48 > Task :sdks:java:io:google-cloud-platform:test
   17:53:53 > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowJar
   17:54:03 > Task :sdks:java:io:google-cloud-platform:expansion-service:startShadowScripts
   17:54:03 > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistTar
   17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistZip
   17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:assemble
   17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies
   17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies
   17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
   17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:check
   17:54:11 > Task :sdks:java:io:google-cloud-platform:expansion-service:build
   19:52:33 Build timed out (after 120 minutes). Marking the build as aborted.
   ```
   Particularly, `:sdks:java:io:google-cloud-platform:test` is executing but `:sdks:java:io:google-cloud-platform:integrationTest` not yet started. Likely some unit test having race conditions.
   
   
   ### Issue Failure
   
   Failure: Test is flaky
   
   ### Issue Priority
   
   Priority: 2 (backlog / disabled test but we think the product is healthy)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [x] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #25207: [Failing Test]: beam_PreCommit_Java_GCP_IO_Direct high possibility timeout

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #25207:
URL: https://github.com/apache/beam/issues/25207#issuecomment-1407087408

   Found one timeout flaky test: `org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOWriteTest.testTriggeredFileLoadsWithTempTablesToExistingNullSchemaTable`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #25207: [Failing Test]: beam_PreCommit_Java_GCP_IO_Direct high possibility timeout

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #25207:
URL: https://github.com/apache/beam/issues/25207#issuecomment-1414148752

   Still occurring: https://ci-beam.apache.org/view/PostCommit/job/beam_PreCommit_Java_GCP_IO_Direct_Cron/864/
   `org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOWriteTest.testTriggeredFileLoadsWithTempTablesToExistingNullSchemaTable[1]` timeout after 10 min.
   
   Though less frequent.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #25207: [Failing Test]: beam_PreCommit_Java_GCP_IO_Direct high possibility timeout

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #25207:
URL: https://github.com/apache/beam/issues/25207#issuecomment-1431582611

   reopen this for tracking the (now flaky) timeout test `testTriggeredFileLoadsWithTempTablesToExistingNullSchemaTable[1]`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn closed issue #25207: [Failing Test]: beam_PreCommit_Java_GCP_IO_Direct high possibility timeout

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #25207: [Failing Test]:  beam_PreCommit_Java_GCP_IO_Direct high possibility timeout
URL: https://github.com/apache/beam/issues/25207


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #25207: [Failing Test]: beam_PreCommit_Java_GCP_IO_Direct high possibility timeout

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #25207:
URL: https://github.com/apache/beam/issues/25207#issuecomment-1414150562

   See a log message
   ```
   NFO: Ignoring failed deletion of file /tmp/junit1629866381724064800/files00010 which already does not exist.
   java.nio.file.NoSuchFileException: /tmp/junit1629866381724064800/files00010
   ```
   may be conflicting with other tests that deleted this file, and causing pipeline stuck 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org