You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "bvolpato (via GitHub)" <gi...@apache.org> on 2023/08/07 17:56:22 UTC

[GitHub] [beam] bvolpato opened a new pull request, #27879: Keep GCThrashingPercentagePerPeriod in DataflowPipelineDebugOptions

bvolpato opened a new pull request, #27879:
URL: https://github.com/apache/beam/pull/27879

   This will cause problems until new containers are built and used.
   
   ```
   ERROR 2023-08-07T16:47:48.011Z Uncaught exception in main thread. Exiting with status code 1.
   ERROR 2023-08-07T16:47:48.011Z java.lang.NoSuchMethodError: 'java.lang.Double org.apache.beam.runners.dataflow.options.DataflowPipelineDebugOptions.getGCThrashingPercentagePerPeriod()'
   ERROR 2023-08-07T16:47:48.012Z at org.apache.beam.runners.dataflow.worker.util.MemoryMonitor.fromOptions(MemoryMonitor.java:243)
   ERROR 2023-08-07T16:47:48.012Z at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.<init>(StreamingDataflowWorker.java:588)
   ERROR 2023-08-07T16:47:48.012Z at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.fromDataflowWorkerHarnessOptions(StreamingDataflowWorker.java:556)
   ERROR 2023-08-07T16:47:48.012Z at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.main(StreamingDataflowWorker.java:273)
   ```
   
   Keeping it for now to avoid blocking people using Beam @ HEAD.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] Abacn commented on pull request #27879: Keep GCThrashingPercentagePerPeriod in DataflowPipelineDebugOptions

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on PR #27879:
URL: https://github.com/apache/beam/pull/27879#issuecomment-1668425917

   The line that will cause problem is here:
   
   https://github.com/bvolpato/beam/blob/9e3d8d3c5719bbe8052b10c19be028d6b93f3eaf/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/util/MemoryMonitor.java#L245
   
   this change alone won't be effective to eliminate the issue when using an outdated workerJar
   
   to me this is a non-issue / documentation issue. We need to bump https://github.com/apache/beam/blob/3b112e8bd8da50d934955d64f2fd1e1396d3fe01/runners/google-cloud-dataflow-java/build.gradle#L56 here


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] bvolpato closed pull request #27879: Keep GCThrashingPercentagePerPeriod in DataflowPipelineDebugOptions

Posted by "bvolpato (via GitHub)" <gi...@apache.org>.
bvolpato closed pull request #27879: Keep GCThrashingPercentagePerPeriod in DataflowPipelineDebugOptions
URL: https://github.com/apache/beam/pull/27879


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] bvolpato commented on pull request #27879: Keep GCThrashingPercentagePerPeriod in DataflowPipelineDebugOptions

Posted by "bvolpato (via GitHub)" <gi...@apache.org>.
bvolpato commented on PR #27879:
URL: https://github.com/apache/beam/pull/27879#issuecomment-1668428988

   True, good point @Abacn. I'm building a new container. Provided workaround steps for folks having friction -- closing this for now.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org