You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/03/24 18:40:35 UTC
[I] The PostRelease Nightly Snapshot job is flaky [beam]
github-actions[bot] opened a new issue, #30505:
URL: https://github.com/apache/beam/issues/30505
The PostRelease Nightly Snapshot is failing over 50% of the time
Please visit https://github.com/apache/beam/actions/workflows/beam_PostRelease_NightlySnapshot.yml?query=is%3Afailure+branch%3Amaster to see the logs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2651124534
> Hi [@Amar3tto](https://github.com/Amar3tto) do you have insight what had caused MobileGaming test being flaky before? I read the fix mostly adding retries, which could make test less flaky, but if there is recent change causing it start failing, the root cause wasn't resolved.
I tried changing the Groovy scripts, also tried explicitly creating the table, but it didn't help. I think there might be a problem with the threads, since the table name doesn't contain any ID (leaderboard_DataflowRunner_team). I'm going to investigate further.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2156206297
Can we just add the retry to this task?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-4416063170
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3361245946
`Root cause: org.apache.beam.sdk.util.UserCodeException: java.lang.AbstractMethodError: Receiver class org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext does not define or inherit an implementation of the resolved method 'abstract org.apache.beam.sdk.values.OutputBuilder builder(java.lang.Object)' of interface org.apache.beam.sdk.transforms.DoFn$OutputReceiver.`
@kennknowles Could you please help?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-4260195047
`Error message from worker: java.lang.AbstractMethodError: Receiver class org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext does not define or inherit an implementation of the resolved method 'abstract void outputWindowedValue(org.apache.beam.sdk.values.TupleTag, org.apache.beam.sdk.values.WindowedValue)' of abstract class org.apache.beam.sdk.transforms.DoFn$WindowedContext.`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2959412322
Beam master container is updated . Current flakiness is due to INFRA-26230 (see https://github.com/apache/beam/issues/30505#issuecomment-2937044473) again
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3361090555
Culprit: https://github.com/apache/beam/pull/34902
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3340005518
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "damccorm (via GitHub)" <gi...@apache.org>.
damccorm closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2937044473
Currently due to connection issue to maven snapshot repository: https://issues.apache.org/jira/browse/INFRA-26230?filter=-2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "chamikaramj (via GitHub)" <gi...@apache.org>.
chamikaramj commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2632408173
Seems like this is still flaky after recent fixes unfortunately.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3370286443
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2749083309
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2944220044
Need to release a new beam-master container that uses latest nightly. Let me do that
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-1997604874
Still failing:
```
Container image gcr.io/cloud-dataflow/v1beta3/beam_java8_sdk:beam-master-20240306 not downloaded yet.
```
It is strange that the container gets resolved to "beam_java8_sdk:beam-master-20240306". What happens is it picks the label for legacy runner but actually trying to pull runner v2 image. This is likely due to Dataflow switched to runner v2 by default in Beam 2.55.0+
https://github.com/apache/beam/blob/ef919e2603fcd6bffde2a15961d1f186448520a9/runners/google-cloud-dataflow-java/build.gradle#L54-L55
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3946645519
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-4335081123
Stabilized
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2951723288
The same error here: #35194
> **Job ID:** 2025-06-04_11_15_55-15227603184381661966
>
> `java.lang.NoSuchFieldError: java8 at org.apache.beam.runners.dataflow.worker.util.MemoryMonitor.<init>(MemoryMonitor.java:318) at org.apache.beam.runners.dataflow.worker.util.MemoryMonitor.fromOptions(MemoryMonitor.java:268) at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.fromOptions(StreamingDataflowWorker.java:444) at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.main(StreamingDataflowWorker.java:811)`
>
> [@Abacn](https://github.com/Abacn) Do you have any thoughts on this error?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2959710551
ACK
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3361266340
We need a new beam-master image release. I try to run one at once after merging #36349 (which also requires beam master image release)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2123085446
@shunping please check this when you have time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2944092277
**Job ID:** 2025-06-04_11_15_55-15227603184381661966
`java.lang.NoSuchFieldError: java8
at org.apache.beam.runners.dataflow.worker.util.MemoryMonitor.<init>(MemoryMonitor.java:318)
at org.apache.beam.runners.dataflow.worker.util.MemoryMonitor.fromOptions(MemoryMonitor.java:268)
at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.fromOptions(StreamingDataflowWorker.java:444)
at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.main(StreamingDataflowWorker.java:811)`
@Abacn Do you have any thoughts on this error?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2632613643
Hi @Amar3tto do you have insight what had caused MobileGaming test being flaky before? I read the fix mostly adding retries, which could make test less flaky, but if there is recent change causing it start failing, the root cause wasn't resolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-4202399703
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3922552385
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2959522583
Another latest breakage is due to #35177. Breaking changes in SDK core/harness keep breaking beam-master containers. CC: @kennknowles
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2889223368
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2444821005
Green now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "damondouglas (via GitHub)" <gi...@apache.org>.
damondouglas commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2153361768
Related to the maven snapshot issue. I wonder if we could use artifact registry's ability to store Java packages https://cloud.google.com/artifact-registry/docs/java/store-java, instead of relying on maven central.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-4104493755
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2049687189
https://github.com/apache/beam/actions/runs/8619063045
```
java.lang.RuntimeException: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/beam_postrelease_mobile_gaming/tables/leaderboard_DataflowRunner_team/insertAll?prettyPrint=false
{
"code" : 404,
"errors" : [ {
"domain" : "global",
"message" : "Not found: Table apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team",
"reason" : "notFound"
} ],
"message" : "Not found: Table apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team",
"status" : "NOT_FOUND"
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2619873156
I am going to fix mobilegaming groovy scripts
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2753482523
Culprit: #33086
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2763444919
Fixed by #34447
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3593074773
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #30505: The PostRelease Nightly Snapshot job is flaky
URL: https://github.com/apache/beam/issues/30505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2430353074
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2123084087
Currently there is a flakiness due to downloading artifacts from maven snapshot repository not get retried. This is a maven tool thing, but probably we can first build (with retry) so the artifacts are get cached in local maven
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2053719924
Looks much better. Close this now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2156182799
```
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java (default-cli) on project word-count-beam: An exception occured while executing the Java class. java.lang.RuntimeException: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found |
-- | --
| [ERROR] POST https://bigquery.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/beam_postrelease_mobile_gaming/tables/leaderboard_DirectRunner_team/insertAll?prettyPrint=false |
| [ERROR] { |
| [ERROR] "code" : 404, |
| [ERROR] "errors" : [ { |
| [ERROR] "domain" : "global", |
| [ERROR] "message" : "Not found: table Table is deleted: 844138762903:beam_postrelease_mobile_gaming.leaderboard_DirectRunner_team", |
| [ERROR] "reason" : "notFound" |
| [ERROR] } ], |
| [ERROR] "message" : "Not found: table Table is deleted: 844138762903:beam_postrelease_mobile_gaming.leaderboard_DirectRunner_team", |
| [ERROR] "status" : "NOT_FOUND" |
| [ERROR] } |
| [ERROR] -> [Help 1] |
| [ERROR]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2959810372
There are a few options
1, the simplest
- Instead of putting harness jar at the front of class path, we can put it at the end: https://github.com/apache/beam/blob/b56f99db5b0fabc43bf278cb3abf8a8e9f10d7e9/sdks/java/container/boot.go#L163
- make Dataflow runner having runtime dependency on SDK harness
Then user submitting pipeline will usually stage SDK harness, that overwrites the one embedded in SDK container
2. We can change our PostRelease test to overwrite worker jar / SDK harnss by adding `--experiments=use_staged_dataflow_worker_jar` when run on SNAPSHOT Beam version
It includes the following change:
In https://github.com/apache/beam/blob/b56f99db5b0fabc43bf278cb3abf8a8e9f10d7e9/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml#L202,
add
```
<snapshots>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-harness</artifactId>
<version>${beam-version}</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId><artifactId>beam-runners-google-cloud-dataflow-java-legacy-worker</artifactId></artifactId>
<version>${beam-version}</version>
</dependency>
</snapshots>
```
and in https://github.com/apache/beam/blob/b56f99db5b0fabc43bf278cb3abf8a8e9f10d7e9/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy#L2582
add
```
if (ver.endsWith('SNAPSHOT' && config.runner == 'DataflowRunner') {
argsNeeded.add("--experiment=use_staged_dataflow_worker_jar")
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2958993651
> Need to release a new beam-master container that uses latest nightly. Let me do that
Any updates on this? Happy to help if there are any blockers
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2959712916
What's the way to do these without breakage?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2932596397
Reopening since the workflow is still flaky
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "ahmedabu98 (via GitHub)" <gi...@apache.org>.
ahmedabu98 commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-2616483905
Opening again because the workflow is broken for the past few days.
Since #33555 got in, it's been failing with the following:
```
Caused by: java.lang.NoClassDefFoundError: org/apache/beam/vendor/grpc/v1p60p1/io/grpc/Channel
```
I wonder if this is due to SDK snapshots failing (see #32161). Optimizing snapshots may fix this error.
Behind it is another error however (seen in workflow runs Jan 22-24):
```
{
"code": 404,
"errors": [
{
"domain": "global",
"message": "Not found: table Table is deleted: 844138762903:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team",
"reason": "notFound"
}
],
"message": "Not found: table Table is deleted: 844138762903:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team",
"status": "NOT_FOUND"
}
```
Should we increase the time out again? Similar to here: https://github.com/apache/beam/pull/30949/files
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "shunping (via GitHub)" <gi...@apache.org>.
shunping commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-1989380326
Related to ##30447
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-3231245472
Fixed by #35908. Apparently there is some rate limiting for snapshot repo. If two many tests running in parallel it triggers the rate limiting. #35908 removed two tasks and tests consistently passing
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] The PostRelease Nightly Snapshot job is flaky [beam]
Posted by "Amar3tto (via GitHub)" <gi...@apache.org>.
Amar3tto commented on issue #30505:
URL: https://github.com/apache/beam/issues/30505#issuecomment-4074489554
Fixed by #37871
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org