[jira] [Created] (BEAM-11864) NPE when registering fromRowFunction

["Fokko Driesprong (Jira)" <ji...@apache.org>]

Fokko Driesprong created BEAM-11864:
---------------------------------------

             Summary: NPE when registering fromRowFunction
                 Key: BEAM-11864
                 URL: https://issues.apache.org/jira/browse/BEAM-11864
             Project: Beam
          Issue Type: Improvement
          Components: runner-dataflow
            Reporter: Fokko Driesprong
            Assignee: Fokko Driesprong
             Fix For: 2.29.0


When registering multiple coders, it will produce a NPE when checking if the fromRowFunction is already registered:
```
[WARNING] 
java.lang.NullPointerException
 at org.apache.beam.sdk.schemas.utils.AvroUtils$RowToGenericRecordFn.equals (AvroUtils.java:559)
 at org.apache.beam.sdk.schemas.SchemaCoder.equals (SchemaCoder.java:208)
 at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Objects.equal (Objects.java:52)
 at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.HashBiMap.seekByKey (HashBiMap.java:224)
 at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.HashBiMap.get (HashBiMap.java:254)
 at org.apache.beam.runners.core.construction.SdkComponents.registerCoder (SdkComponents.java:265)
 at org.apache.beam.runners.core.construction.PCollectionTranslation.toProto (PCollectionTranslation.java:35)
 at org.apache.beam.runners.core.construction.SdkComponents.registerPCollection (SdkComponents.java:227)
 at org.apache.beam.runners.core.construction.PTransformTranslation.translateAppliedPTransform (PTransformTranslation.java:479)
 at org.apache.beam.runners.core.construction.PTransformTranslation$KnownTransformPayloadTranslator.translate (PTransformTranslation.java:424)
 at org.apache.beam.runners.core.construction.PTransformTranslation.toProto (PTransformTranslation.java:239)
 at org.apache.beam.runners.core.construction.SdkComponents.registerPTransform (SdkComponents.java:175)
 at org.apache.beam.runners.core.construction.PipelineTranslation$1.visitPrimitiveTransform (PipelineTranslation.java:87)
 at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit (TransformHierarchy.java:587)
 at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit (TransformHierarchy.java:579)
 at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$500 (TransformHierarchy.java:239)
 at org.apache.beam.sdk.runners.TransformHierarchy.visit (TransformHierarchy.java:213)
 at org.apache.beam.sdk.Pipeline.traverseTopologically (Pipeline.java:468)
 at org.apache.beam.runners.core.construction.PipelineTranslation.toProto (PipelineTranslation.java:59)
 at org.apache.beam.runners.dataflow.DataflowRunner.run (DataflowRunner.java:933)
 at org.apache.beam.runners.dataflow.DataflowRunner.run (DataflowRunner.java:196)
 at org.apache.beam.sdk.Pipeline.run (Pipeline.java:322)
 at ....PubsubToBigQuery.main (PubsubToBigQuery.java:98)
 at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke (Method.java:498)
 at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
 at java.lang.Thread.run (Thread.java:748)
```

This is because when you register a GenericRecord, the schema will be null, resulting in the NPE above.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)