You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "chamikaramj (via GitHub)" <gi...@apache.org> on 2024/10/16 21:10:54 UTC

[I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to a connect timed out [beam]

chamikaramj opened a new issue, #32824:
URL: https://github.com/apache/beam/issues/32824

   ### What happened?
   
   Seems like jar file resolution with Maven SNAPSHOT repo is somehow incorrect.
   
   Successful run: https://github.com/apache/beam/actions/runs/11307102323/job/31448448902
   
   ```
   [INFO] Archetype repository not defined. Using the one from [org.apache.beam:beam-sdks-java-maven-archetypes-examples:2.24.0] found in catalog remote
   [INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.61.0-SNAPSHOT/maven-metadata.xml
   [INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.61.0-SNAPSHOT/maven-metadata.xml (1.7 kB at 3.3 kB/s)
   [INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.61.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.61.0-20241012.122627-12.jar
   [INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.61.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.61.0-20241012.122627-12.jar (340 kB at 435 kB/s)
   ```
   
   Failed run: https://github.com/apache/beam/actions/runs/11369820828/job/31628153369
   
   ```
   [INFO] Archetype repository not defined. Using the one from [org.apache.beam:beam-sdks-java-maven-archetypes-examples:2.24.0] found in catalog remote
   [INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.61.0-SNAPSHOT/maven-metadata.xml
   Warning:  Could not transfer metadata org.apache.beam:beam-sdks-java-maven-archetypes-examples:2.61.0-SNAPSHOT/maven-metadata.xml from/to test.release (https://repository.apache.org/content/repositories/snapshots): Connect to repository.apache.org:443 [repository.apache.org/65.109.119.155] failed: connect timed out
   [INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.61.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.61.0-SNAPSHOT.jar
   [INFO] ------------------------------------------------------------------------
   [INFO] BUILD FAILURE
   [INFO] ------------------------------------------------------------------------
   ```
   
   ### Issue Failure
   
   Failure: Test is flaky
   
   ### Issue Priority
   
   Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [X] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam YAML
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Infrastructure
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2427911198

   I think the issue is:
   
   Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
   
   - The deprecated "gradleEnterprise.buildScan.buildFinished" API has been replaced by "develocity.buildScan.buildFinished"
   - The deprecated "gradleEnterprise.buildScan.buildScanPublished" API has been replaced by "develocity.buildScan.buildScanPublished"
   - The deprecated "gradleEnterprise.buildScan.onError" API has been replaced by "develocity.buildScan.onError"
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #32824: [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out"
URL: https://github.com/apache/beam/issues/32824


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2442379245

   It is caused by maven service side issue that is resolved for now


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to a connect timed out [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2417972658

   cc: @Abacn 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2427888758

   Seems like this is still broken after https://github.com/apache/beam/pull/32841.
   
   @Abacn can you check ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2429986238

   Opened https://issues.apache.org/jira/projects/INFRA/issues/INFRA-26230?filter=allopenissues
   
   > For example, to a GCP Artifact Registry repository.
   
   In theory we can, just need to invest in migrations.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2419679190

   This warning message tells the reason:
   
   ```
   Warning:  org.apache.beam:beam-runners-portability-java:2.61.0-SNAPSHOT/maven-metadata.xml failed to transfer from https://repository.apache.org/content/repositories/snapshots during a previous attempt. This failure was cached in the local repository and resolution will not be reattempted until the update interval of test.release has elapsed or updates are forced. Original error: Could not transfer metadata org.apache.beam:beam-runners-portability-java:2.61.0-SNAPSHOT/maven-metadata.xml from/to test.release (https://repository.apache.org/content/repositories/snapshots): Connect to repository.apache.org:443 [repository.apache.org/65.109.119.155] failed: connect timed out
   ```
   
   In particular,
   
   > This failure was cached in the local repository and resolution will not be reattempted until the update interval of test.release has elapsed or updates are forced. 
   
   Did some search: https://stackoverflow.com/questions/4856307/when-maven-says-resolution-will-not-be-reattempted-until-the-update-interval-of
   
   what happens appear to be there was a run introduced bad local artifact, then in next a few days same artifact stays bad, until the "update interval" elapsed.
   
   Noticed this also happened 3 weeks ago and after 6 run it recovered itself.
   
   An action could be add "-U" flag in the mvn invocation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2428066179

   the number of failed task improved but still very flaky. The latest run fails one task.
   
   This error is because client failed to fetch maven-metadata.xml for `beam-sdks-java-maven-archetypes-gcp-bom-examples:2.61.0-SNAPSHOT` from snapshot repo, it falls back to maven central, where 2.61.0-SNAPSHOT does not exist.
   
   -----
   
   In general it seems network condition changed recently and the availability of maven snapshot repo becomes worse than before. #32841 mitigated the issue (originally 8/8 task fail) but it still highly flaky (1-5 out of 8 task fail)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2427911580

   https://github.com/apache/beam/actions/runs/11444459705/job/31839384547


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2428408827

   Is it possible to push SNAPSHOTs to somewhere else ? For example, to a GCP Artifact Registry repository.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Failing Test]: PostRelease Nightly Snapshot is perma-red due to "connect timed out" [beam]

Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #32824:
URL: https://github.com/apache/beam/issues/32824#issuecomment-2429821213

   Might be good to check with Apache INFRA first regarding why the SNAPSHOT repo became unstable.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org