You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gora.apache.org by "Matzz (JIRA)" <ji...@apache.org> on 2014/04/15 13:18:15 UTC
[jira] [Updated] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matzz updated GORA-144:
-----------------------
Attachment: GORA-144-v1.patch
I attached a patch for the current version of trunk.
It contains maven profile (hadoop2) for compiling with Cloudera's version of Hadoop (2.3.0-mr1-cdh5. 0.0). I couldn't find global maven repo with Hadoop 2. probably it is available only by FTP.
I also changed JobContext to Job in GoraMapReduceUtils. I am not sure if it breaks something but it is required to support both Hadoop versions.
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Priority: Minor
> Fix For: 0.5
>
> Attachments: GORA-144-v1.patch
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message was sent by Atlassian JIRA
(v6.2#6252)