You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Udi Meiri (Jira)" <ji...@apache.org> on 2020/04/03 19:13:00 UTC
[jira] [Commented] (BEAM-9313) beam_PostRelease_NightlySnapshot
failure due to ClassNotFoundException:
org.apache.beam.model.pipeline.v1.StandardWindowFns$SessionsPayload$Enum
[ https://issues.apache.org/jira/browse/BEAM-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17074832#comment-17074832 ]
Udi Meiri commented on BEAM-9313:
---------------------------------
Seeing something similar:
{code}
[INFO] Changes detected - recompiling the module!
[WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
[INFO] Compiling 31 source files to /tmp/groovy-generated-8526855374001831465-tmpdir/word-count-beam/target/classes
Waiting for pipeline to produce more results...
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java (default-cli) on project word-count-beam: An exception occured while executing the Java class. org.apache.beam.examples.complete.game.LeaderBoard -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java (default-cli) on project word-count-beam: An exception occured while executing the Java class. org.apache.beam.examples.complete.game.LeaderBoard -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /tmp/groovy-generated-8526855374001831465-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/common/ExamplePubsubTopicOptions.java: error reading /tmp/groovy-generated-8526855374001831465-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/common/ExamplePubsubTopicOptions.java; /tmp/groovy-generated-8526855374001831465-tmpdir/word-count-beam/src/main/java/org/apache/beam/examples/common/ExamplePubsubTopicOptions.java (No such file or directory)
... (lots of file not found errors)
{code}
https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/937/consoleFull
The failed task is sometimes :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow (above) and sometimes :runners:direct-java:runMobileGamingJavaDirect and sometimes both.
Since these tasks run in parallel, perhaps they're overwriting each others' output files.
> beam_PostRelease_NightlySnapshot failure due to ClassNotFoundException: org.apache.beam.model.pipeline.v1.StandardWindowFns$SessionsPayload$Enum
> ------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-9313
> URL: https://issues.apache.org/jira/browse/BEAM-9313
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: Major
> Labels: currently-failing
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Jenkins: https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/885/
> Gradle: https://scans.gradle.com/s/wbwr4nzluxtlc
> :runners:google-cloud-dataflow-java:runQuickstartJavaDataflow and :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow are broken with ClassDefNotFound errors like:
> {code}
> INFO: 2020-02-08T11:05:44.038Z: Finished operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
> Feb 08, 2020 11:05:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2020-02-08T11:05:44.119Z: Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+MapElements/Map+WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
> Feb 08, 2020 11:05:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> SEVERE: 2020-02-08T11:05:46.096Z: java.lang.NoClassDefFoundError: org/apache/beam/model/pipeline/v1/StandardWindowFns$SessionsPayload$Enum
> at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.construction.WindowingStrategyTranslation.<clinit>(WindowingStrategyTranslation.java:211)
> at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowParDoFnFactory.deserializeWindowingStrategy(GroupAlsoByWindowParDoFnFactory.java:234)
> at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowParDoFnFactory.create(GroupAlsoByWindowParDoFnFactory.java:99)
> at org.apache.beam.runners.dataflow.worker.DefaultParDoFnFactory.create(DefaultParDoFnFactory.java:75)
> at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.createParDoOperation(IntrinsicMapTaskExecutorFactory.java:264)
> at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.access$000(IntrinsicMapTaskExecutorFactory.java:86)
> at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:183)
> at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:165)
> at org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:63)
> at org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:50)
> at org.apache.beam.runners.dataflow.worker.graph.Networks.replaceDirectedNetworkNodes(Networks.java:87)
> at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.create(IntrinsicMapTaskExecutorFactory.java:125)
> at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:353)
> at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:306)
> at org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:140)
> at org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:120)
> at org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:107)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.ClassNotFoundException: org.apache.beam.model.pipeline.v1.StandardWindowFns$SessionsPayload$Enum
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 21 more
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)