You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Julien Tournay (JIRA)" <ji...@apache.org> on 2019/02/25 13:45:00 UTC

[jira] [Updated] (BEAM-6742) {{AvroRecordSchema().toRowFunction}} throws a NPE when avro record contain nulls

     [ https://issues.apache.org/jira/browse/BEAM-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julien Tournay updated BEAM-6742:
---------------------------------
    Summary: {{AvroRecordSchema().toRowFunction}} throws a NPE when avro record contain nulls  (was: `AvroRecordSchema().toRowFunction` throws an NPE when avro record contain nulls)

> {{AvroRecordSchema().toRowFunction}} throws a NPE when avro record contain nulls
> --------------------------------------------------------------------------------
>
>                 Key: BEAM-6742
>                 URL: https://issues.apache.org/jira/browse/BEAM-6742
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>    Affects Versions: 2.9.0
>            Reporter: Julien Tournay
>            Priority: Major
>
> When generating a {{SerializableFunction[SomeClass, Row]}}
>  where {{Someclass}} was generated and has nullable fields, the generated function will throw a NPE.
> For example given the following avro schema:
> {code:java}
> {
>     "type": "record",
>     "name": "TestRecord",
>     "namespace": "com.spotify.scio.avro",
>     "doc": "Record for testing",
>     "fields": [
>         {"name": "int_field", "type": ["null", "int"], "default": null},
>         {"name": "long_field", "type": ["null", "long"], "default": null},
>         {"name": "float_field", "type": ["null", "float"], "default": null},
>         {"name": "double_field", "type": ["null", "double"], "default": null},
>         {"name": "boolean_field", "type": ["null", "boolean"], "default": null},
>         {"name": "string_field", "type": ["null", "string"], "default": null},
>         {"name": "array_field", "type": {"type": "array", "items": "string"}, "default": null}
>     ]
> }
> {code}
> the following code witl throw:
> {code:java}
>     val clazz = classTag[avro.TestRecord].runtimeClass.asInstanceOf[Class[avro.TestRecord]]
>     val toRow = new AvroRecordSchema().toRowFunction(TypeDescriptor.of(clazz))
>     avroWithNullable.map(x => toRow(x)).foreach(println)
> {code}
> Stacktrace:
> {code:java}
> [info]   java.lang.NullPointerException:
> [info]   at com.spotify.scio.avro.FieldValueGetter$SchemaCodeGen$4CLQpLwl.get(Unknown Source)
> [info]   at com.spotify.scio.avro.FieldValueGetter$SchemaCodeGen$4CLQpLwl.get(Unknown Source)
> [info]   at org.apache.beam.sdk.values.RowWithGetters.lambda$getValues$2(RowWithGetters.java:117)
> [info]   at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> [info]   at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)