You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Alexey Romanenko (Jira)" <ji...@apache.org> on 2021/03/12 16:14:00 UTC

[jira] [Comment Edited] (BEAM-8221) NullPointerException in reading from non-existent Kafka topic

    [ https://issues.apache.org/jira/browse/BEAM-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300403#comment-17300403 ] 

Alexey Romanenko edited comment on BEAM-8221 at 3/12/21, 4:13 PM:
------------------------------------------------------------------

Also, {{auto.create.topics.enable}} should be set to {{false}}


was (Author: aromanenko):
Also, \{{auto.create.topics.enable}} should be set to \{{false}}

> NullPointerException in reading from non-existent Kafka topic
> -------------------------------------------------------------
>
>                 Key: BEAM-8221
>                 URL: https://issues.apache.org/jira/browse/BEAM-8221
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-kafka
>            Reporter: Chandan Kumar
>            Assignee: Alexey Romanenko
>            Priority: P3
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Get this exception when launch apache beam job, which tries to read from non-existent Kafka topic:
> {code:java}
> Exception in thread "main" java.lang.RuntimeException: java.lang.NullPointerException
> 	at org.apache.beam.runners.dataflow.ReadTranslator.translateReadHelper(ReadTranslator.java:54)
> 	at org.apache.beam.runners.dataflow.DataflowRunner$StreamingUnboundedRead$ReadWithIdsTranslator.translate(DataflowRunner.java:1508)
> 	at org.apache.beam.runners.dataflow.DataflowRunner$StreamingUnboundedRead$ReadWithIdsTranslator.translate(DataflowRunner.java:1505)
> 	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator.visitPrimitiveTransform(DataflowPipelineTranslator.java:475)
> 	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:665)
> 	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
> 	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
> 	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
> 	at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:317)
> 	at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:251)
> 	at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
> 	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator.translate(DataflowPipelineTranslator.java:414)
> 	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator.translate(DataflowPipelineTranslator.java:173)
> 	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:737)
> 	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:179)
> 	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
> 	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)
> 	at com.paloaltonetworks.cortex.replication.ingest.ReplicationIngestor.run(ReplicationIngestor.java:109)
> 	at com.paloaltonetworks.cortex.replication.ingest.ReplicationIngestor.main(ReplicationIngestor.java:64)
> Caused by: java.lang.NullPointerException
> 	at org.apache.beam.sdk.io.kafka.KafkaUnboundedSource.split(KafkaUnboundedSource.java:66)
> 	at org.apache.beam.runners.dataflow.internal.CustomSources.serializeToCloudSource(CustomSources.java:87)
> 	at org.apache.beam.runners.dataflow.ReadTranslator.translateReadHelper(ReadTranslator.java:51)
> 	... 18 more {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)