You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2020/05/21 20:21:00 UTC

[jira] [Commented] (BEAM-10059) Several Dataflow load tests failing

    [ https://issues.apache.org/jira/browse/BEAM-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113515#comment-17113515 ] 

Brian Hulette commented on BEAM-10059:
--------------------------------------

The error is an NPE here: https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/TestDataflowRunner.java#L72-L74

{code}
    String tempLocation =
        Joiner.on("/")
            .join(dataflowOptions.getTempRoot(), dataflowOptions.getJobName(), "output", "results");
{code}

It seems tempRoot or jobName is null

> Several Dataflow load tests failing
> -----------------------------------
>
>                 Key: BEAM-10059
>                 URL: https://issues.apache.org/jira/browse/BEAM-10059
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow, sdk-java-core, test-failures
>            Reporter: Brian Hulette
>            Priority: P2
>
> Example Failure: https://builds.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Streaming/380
> The same issue seems to affect every other Dataflow LoadTest
> {code}
> 05:20:56 Exception in thread "main" java.lang.RuntimeException: Failed to construct instance from factory method TestDataflowRunner#fromOptions(interface org.apache.beam.sdk.options.PipelineOptions)
> 05:20:56 	at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
> 05:20:56 	at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
> 05:20:56 	at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
> 05:20:56 	at org.apache.beam.sdk.Pipeline.create(Pipeline.java:149)
> 05:20:56 	at org.apache.beam.sdk.loadtests.LoadTest.<init>(LoadTest.java:86)
> 05:20:56 	at org.apache.beam.sdk.loadtests.CombineLoadTest.<init>(CombineLoadTest.java:112)
> 05:20:56 	at org.apache.beam.sdk.loadtests.CombineLoadTest.main(CombineLoadTest.java:169)
> 05:20:56 Caused by: java.lang.reflect.InvocationTargetException
> 05:20:56 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 05:20:56 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 05:20:56 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 05:20:56 	at java.lang.reflect.Method.invoke(Method.java:498)
> 05:20:56 	at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
> 05:20:56 	... 6 more
> 05:20:56 Caused by: java.lang.NullPointerException
> 05:20:56 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:877)
> 05:20:56 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Joiner.toString(Joiner.java:452)
> 05:20:56 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Joiner.appendTo(Joiner.java:106)
> 05:20:56 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Joiner.appendTo(Joiner.java:152)
> 05:20:56 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Joiner.join(Joiner.java:195)
> 05:20:56 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Joiner.join(Joiner.java:185)
> 05:20:56 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Joiner.join(Joiner.java:211)
> 05:20:56 	at org.apache.beam.runners.dataflow.TestDataflowRunner.fromOptions(TestDataflowRunner.java:74)
> 05:20:56 	... 11 more
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)