[jira] [Commented] (GORA-246) Upgrade to Avro 1.7.X in gora-hbase

["Alparslan Avcı (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/GORA-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13862252#comment-13862252 ] 

Alparslan Avcı commented on GORA-246:
-------------------------------------

Hi [~lewismc],

I have faced some problems when I tried to use GORA_94 branch on Nutch. In PersistentSerializer class, SpecificDatumWriter class is used to write objects in GORA_94. However, within this writer, there are no specific write() method and GenericDatumWriter's write() methods are used. When serializing a Persistent object, these methods can throw NullPointerException when any of the object's fields is null. For instance, when writing the Webpage to context as a value in GeneratorMapper, the baseUrl field is null and causes a NullPointerException. 
In Gora 0.3, PersistentSerializer class uses PersistentDatumWriter (extended from SpecificDatumWriter) to writes objects according to their fields' readibility. Maybe in GORA_94, we also have to extend SpecificDatumWriter to a new class in order to add some controls like null field checking.

> Upgrade to Avro 1.7.X in gora-hbase
> -----------------------------------
>
>                 Key: GORA-246
>                 URL: https://issues.apache.org/jira/browse/GORA-246
>             Project: Apache Gora
>          Issue Type: Sub-task
>          Components: gora-core, gora-hbase
>    Affects Versions: 0.4
>            Reporter: Lewis John McGibbney
>             Fix For: 0.4
>
>         Attachments: GORA-246.patch, GORA-246v2.patch, GORA-246v3.patch, GORA-246v3.patch, GORA-246v4.patch, GORA_246.HBaseDriverTest.patch, GORA_246.HBaseDriverTest.v2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.1.5#6160)