You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Bruno Volpato via user <us...@beam.apache.org> on 2023/10/15 01:59:31 UTC
Re: Apache Beam 2.50.0 - org.apache.beam.sdk.options.MemoryMonitorOptions ClassDef Not found
Hi Jaymik,
This class (MemoryMonitorOptions) was indeed introduced in Beam 2.50.0.
My guess is that somehow dependencies were upgraded only partially (for
example, just the Runner module, but not Core).
A good way to make sure that all dependencies are upgraded correctly is to
use a BOM (Bill of Materials) and omit pinning a specific <version> for
every Beam artifact.
Please take a look at
https://beam.apache.org/blog/managing-beam-dependencies-in-java/ and see if
it helps.
In case it still doesn't work, running "mvn dependency:tree" might help
understanding which dependencies are being pulled.
Best,
Bruno
On Thu, Oct 12, 2023 at 5:50 PM Deliwala, Jaymik H. via dev <
dev@beam.apache.org> wrote:
> Hello Team
>
>
>
> Greetings!!
>
>
>
> As part of upgrading our Dataflow - Apache beam version from 2.46.0 to
> 2.49.0/2.50.0, we are able to compile the mvn package successfully.
>
> However, while running the compile exec command, we are getting an error
> as below - *org.apache.beam.sdk.options.MemoryMonitorOptions -
> NoClassefFoundError*
>
>
>
>
> 2023-10-12T10:39:17.9662373Z java.lang.NoClassDefFoundError: org/apache/beam/sdk/options/MemoryMonitorOptions
>
>
> 2023-10-12T10:39:17.9665631Z at java.lang.ClassLoader.defineClass1 (Native Method)
>
>
> 2023-10-12T10:39:17.9668538Z at java.lang.ClassLoader.defineClass (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9670605Z at java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9672586Z at java.net.URLClassLoader.defineClass (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9674516Z at java.net.URLClassLoader$1.run (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9676939Z at java.net.URLClassLoader$1.run (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9678816Z at java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9690248Z at java.net.URLClassLoader.findClass (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9692252Z at java.lang.ClassLoader.loadClass (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9694175Z at java.lang.ClassLoader.loadClass (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9696026Z at java.lang.ClassLoader.defineClass1 (Native Method)
>
>
> 2023-10-12T10:39:17.9699991Z at java.lang.ClassLoader.defineClass (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9704965Z at java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9706908Z at java.net.URLClassLoader.defineClass (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9708814Z at java.net.URLClassLoader$1.run (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9710696Z at java.net.URLClassLoader$1.run (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9712552Z at java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9714469Z at java.net.URLClassLoader.findClass (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9716698Z at java.lang.ClassLoader.loadClass (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9718622Z at java.lang.ClassLoader.loadClass (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9720635Z at org.apache.beam.runners.dataflow.DataflowPipelineRegistrar$Options.getPipelineOptions (DataflowPipelineRegistrar.java:40)
>
>
> 2023-10-12T10:39:17.9722611Z at org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.initializeRegistry (PipelineOptionsFactory.java:2090)
>
>
> 2023-10-12T10:39:17.9724487Z at org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> (PipelineOptionsFactory.java:2083)
>
>
> 2023-10-12T10:39:17.9726421Z at org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> (PipelineOptionsFactory.java:2047)
>
>
> 2023-10-12T10:39:17.9728327Z at org.apache.beam.sdk.options.PipelineOptionsFactory.resetCache (PipelineOptionsFactory.java:581)
>
>
> 2023-10-12T10:39:17.9730230Z at org.apache.beam.sdk.options.PipelineOptionsFactory.<clinit> (PipelineOptionsFactory.java:547)
>
>
> 2023-10-12T10:39:17.9732113Z at cio.mmt.PubSubTopicsToBigQuery.main (PubSubTopicsToBigQuery.java:55)
>
>
> 2023-10-12T10:39:17.9734009Z at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
>
> 2023-10-12T10:39:17.9743608Z at java.lang.Thread.run (Thread.java:829)
>
>
> 2023-10-12T10:39:17.9745720Z Caused by: java.lang.ClassNotFoundException: org.apache.beam.sdk.options.MemoryMonitorOptions
>
>
> 2023-10-12T10:39:17.9748376Z at java.net.URLClassLoader.findClass (URLClassLoader.java:476)
>
>
> 2023-10-12T10:39:17.9750298Z at java.lang.ClassLoader.loadClass (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9752205Z at java.lang.ClassLoader.loadClass (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9754041Z at java.lang.ClassLoader.defineClass1 (Native Method)
>
>
> 2023-10-12T10:39:17.9756293Z at java.lang.ClassLoader.defineClass (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9758225Z at java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9760115Z at java.net.URLClassLoader.defineClass (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9761982Z at java.net.URLClassLoader$1.run (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9763915Z at java.net.URLClassLoader$1.run (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9765721Z at java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9767732Z at java.net.URLClassLoader.findClass (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9769643Z at java.lang.ClassLoader.loadClass (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9771552Z at java.lang.ClassLoader.loadClass (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9821607Z at java.lang.ClassLoader.defineClass1 (Native Method)
>
>
> 2023-10-12T10:39:17.9824027Z at java.lang.ClassLoader.defineClass (ClassLoader.java:1022)
>
>
> 2023-10-12T10:39:17.9825945Z at java.security.SecureClassLoader.defineClass (SecureClassLoader.java:174)
>
>
> 2023-10-12T10:39:17.9827873Z at java.net.URLClassLoader.defineClass (URLClassLoader.java:555)
>
>
> 2023-10-12T10:39:17.9829648Z at java.net.URLClassLoader$1.run (URLClassLoader.java:458)
>
>
> 2023-10-12T10:39:17.9831550Z at java.net.URLClassLoader$1.run (URLClassLoader.java:452)
>
>
> 2023-10-12T10:39:17.9833326Z at java.security.AccessController.doPrivileged (Native Method)
>
>
> 2023-10-12T10:39:17.9835504Z at java.net.URLClassLoader.findClass (URLClassLoader.java:451)
>
>
> 2023-10-12T10:39:17.9837376Z at java.lang.ClassLoader.loadClass (ClassLoader.java:594)
>
>
> 2023-10-12T10:39:17.9839129Z at java.lang.ClassLoader.loadClass (ClassLoader.java:527)
>
>
> 2023-10-12T10:39:17.9840848Z at org.apache.beam.runners.dataflow.DataflowPipelineRegistrar$Options.getPipelineOptions (DataflowPipelineRegistrar.java:40)
>
>
> 2023-10-12T10:39:17.9846061Z at org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.initializeRegistry (PipelineOptionsFactory.java:2090)
>
>
> 2023-10-12T10:39:17.9847894Z at org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> (PipelineOptionsFactory.java:2083)
>
>
> 2023-10-12T10:39:17.9849601Z at org.apache.beam.sdk.options.PipelineOptionsFactory$Cache.<init> (PipelineOptionsFactory.java:2047)
>
>
> 2023-10-12T10:39:17.9851239Z at org.apache.beam.sdk.options.PipelineOptionsFactory.resetCache (PipelineOptionsFactory.java:581)
>
>
> 2023-10-12T10:39:17.9852896Z at org.apache.beam.sdk.options.PipelineOptionsFactory.<clinit> (PipelineOptionsFactory.java:547)
>
>
> 2023-10-12T10:39:17.9854577Z at cio.mmt.PubSubTopicsToBigQuery.main (PubSubTopicsToBigQuery.java:55)
>
>
> 2023-10-12T10:39:17.9856188Z at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
>
> 2023-10-12T10:39:17.9857817Z at java.lang.Thread.run (Thread.java:829)
>
>
> 2023-10-12T10:39:17.9885576Z [INFO] ------------------------------------------------------------------------
>
> 2023-10-12T10:39:17.9885795Z [INFO] BUILD FAILURE
>
>
> 2023-10-12T10:39:17.9886047Z [INFO] ------------------------------------------------------------------------
>
> 2023-10-12T10:39:17.9886514Z [INFO] Total time: 8.555 s
>
> 2023-10-12T10:39:17.9886767Z [INFO] Finished at: 2023-10-12T10:39:17Z
>
>
> 2023-10-12T10:39:17.9887048Z [INFO] ------------------------------------------------------------------------
>
>
> 2023-10-12T10:39:17.9934156Z [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.0.0:java (default-
> *cli) on project bigquery: An exception occured while executing the Java class. org/apache/beam/sdk/options/MemoryMonitorOptions: org.apache.beam.sdk.options.MemoryMonitorOptions -> [Help 1]*
>
> May you assist on the resolving the issue.
>
>
>
> Thanks
>
> Jaymik Deliwala.
>
> ------------------------------
>
> This message is for the designated recipient only and may contain
> privileged, proprietary, or otherwise confidential information. If you have
> received it in error, please notify the sender immediately and delete the
> original. Any other use of the e-mail by you is prohibited. Where allowed
> by local law, electronic communications with Accenture and its affiliates,
> including e-mail and instant messaging (including content), may be scanned
> by our systems for the purposes of information security, AI-powered support
> capabilities, and assessment of internal compliance with Accenture policy.
> Your privacy is important to us. Accenture uses your personal data only in
> compliance with data protection laws. For further information on how
> Accenture processes your personal data, please see our privacy statement at
> https://www.accenture.com/us-en/privacy-policy.
>
> ______________________________________________________________________________________
>
> www.accenture.com
>