You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Daniel Oliveira (Jira)" <ji...@apache.org> on 2021/04/28 03:42:00 UTC
[jira] [Updated] (BEAM-11418) [Go XLang] ClassNotFoundException due
to incorrect artifact staging to x-lang environment.
[ https://issues.apache.org/jira/browse/BEAM-11418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Oliveira updated BEAM-11418:
-----------------------------------
Description:
Some of the test XLang transforms (CoGroupByKey, MultiInputOutput, and Partition) fail on the Go SDK (using the Java Test Expansion Service). These tests used to pass and started failing at some point for unknown reasons.
The failures tend to involve a ClassNotFound exception, like so:
{noformat}
RuntimeError: java.lang.IllegalArgumentException: unable to deserialize Custom DoFn With Execution Info
at org.apache.beam.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:78)
at org.apache.beam.runners.core.construction.ParDoTranslation.doFnWithExecutionInformationFromProto(ParDoTranslation.java:712)
at org.apache.beam.runners.core.construction.ParDoTranslation.getDoFn(ParDoTranslation.java:363)
at org.apache.beam.fn.harness.FnApiDoFnRunner.<init>(FnApiDoFnRunner.java:351)
at org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:183)
at org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:157)
{...}
Caused by: java.lang.ClassNotFoundException: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestTransformRegistrar$PartitionBuilder
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
{...}
{noformat}
Edit: This seems to be due to artifact staging issues. This bug has been re-titled to be more accurate to the root cause.
was:Some of the test XLang transforms fail on the Go SDK (using the Java Test Expansion Service). These tests used to pass and started failing at some point for unknown reasons.
Summary: [Go XLang] ClassNotFoundException due to incorrect artifact staging to x-lang environment. (was: Test XLang transforms failing in Go SDK: CoGroupByKey, MultiInputOutput, and Partition)
> [Go XLang] ClassNotFoundException due to incorrect artifact staging to x-lang environment.
> ------------------------------------------------------------------------------------------
>
> Key: BEAM-11418
> URL: https://issues.apache.org/jira/browse/BEAM-11418
> Project: Beam
> Issue Type: Bug
> Components: cross-language, sdk-go
> Reporter: Daniel Oliveira
> Assignee: Daniel Oliveira
> Priority: P2
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Some of the test XLang transforms (CoGroupByKey, MultiInputOutput, and Partition) fail on the Go SDK (using the Java Test Expansion Service). These tests used to pass and started failing at some point for unknown reasons.
> The failures tend to involve a ClassNotFound exception, like so:
> {noformat}
> RuntimeError: java.lang.IllegalArgumentException: unable to deserialize Custom DoFn With Execution Info
> at org.apache.beam.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:78)
> at org.apache.beam.runners.core.construction.ParDoTranslation.doFnWithExecutionInformationFromProto(ParDoTranslation.java:712)
> at org.apache.beam.runners.core.construction.ParDoTranslation.getDoFn(ParDoTranslation.java:363)
> at org.apache.beam.fn.harness.FnApiDoFnRunner.<init>(FnApiDoFnRunner.java:351)
> at org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:183)
> at org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:157)
> {...}
> Caused by: java.lang.ClassNotFoundException: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestTransformRegistrar$PartitionBuilder
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at java.lang.Class.forName0(Native Method)
> {...}
> {noformat}
> Edit: This seems to be due to artifact staging issues. This bug has been re-titled to be more accurate to the root cause.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)