You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gora.apache.org by "Matzz (JIRA)" <ji...@apache.org> on 2014/04/15 13:18:15 UTC

[jira] [Updated] (GORA-144) Upgrade gora so to be compatible with hadoop 2

     [ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matzz updated GORA-144:
-----------------------

    Attachment: GORA-144-v1.patch

I attached a patch for the current version of trunk.
It contains maven profile (hadoop2) for compiling with Cloudera's version of Hadoop (2.3.0-mr1-cdh5. 0.0). I couldn't find global maven repo with Hadoop 2. probably it is available only by FTP.
I also changed JobContext to Job in GoraMapReduceUtils. I am not sure if it breaks something but it is required to support both Hadoop versions.

> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
>                 Key: GORA-144
>                 URL: https://issues.apache.org/jira/browse/GORA-144
>             Project: Apache Gora
>          Issue Type: Task
>          Components: avro, build process, maven
>    Affects Versions: 0.2
>            Reporter: raf shin
>            Priority: Minor
>             Fix For: 0.5
>
>         Attachments: GORA-144-v1.patch
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.



--
This message was sent by Atlassian JIRA
(v6.2#6252)