You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gora.apache.org by "raf shin (JIRA)" <ji...@apache.org> on 2012/06/09 13:40:42 UTC
[jira] [Created] (GORA-144) Upgrade gora so to be compatible with
hadoop 0.23
raf shin created GORA-144:
-----------------------------
Summary: Upgrade gora so to be compatible with hadoop 0.23
Key: GORA-144
URL: https://issues.apache.org/jira/browse/GORA-144
Project: Apache Gora
Issue Type: Task
Reporter: raf shin
TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
Compiling gora with new hadoop version 0.23 fails.
BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
avro.ipc.BinaryOutputStream and avro.ipc.BinaryInputStream are also moved to avro.util package.
There might be much more incompatibilities there which we have not seen yet.
We gave up upgrading our nutchgora to the new hadoop 0.23 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
Posted by "raf shin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
raf shin updated GORA-144:
--------------------------
Description:
TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
Compiling gora with new hadoop version 2 fails.
BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
There might be much more incompatibilities there which we have not seen yet.
We gave up upgrading our nutchgora to the new hadoop 2 version.
was:
TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
Compiling gora with new hadoop version 2 fails.
BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
avro.ipc.BinaryOutputStream and avro.ipc.BinaryInputStream are also moved to avro.util package.
There might be much more incompatibilities there which we have not seen yet.
We gave up upgrading our nutchgora to the new hadoop 2 version.
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Reporter: raf shin
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
Posted by "Lewis John McGibbney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lewis John McGibbney updated GORA-144:
--------------------------------------
Priority: Minor (was: Major)
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Priority: Minor
> Fix For: 0.3
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
Posted by "raf shin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292471#comment-13292471 ]
raf shin commented on GORA-144:
-------------------------------
Yes, Many of the Avro 1.5.4 library API has been changed. All Encoder/Decoder codes in gora should be modified.
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Fix For: 0.3
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
Posted by "raf shin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
raf shin updated GORA-144:
--------------------------
Description:
TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
Compiling gora with new hadoop version 2 fails.
BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
avro.ipc.BinaryOutputStream and avro.ipc.BinaryInputStream are also moved to avro.util package.
There might be much more incompatibilities there which we have not seen yet.
We gave up upgrading our nutchgora to the new hadoop 2 version.
was:
TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
Compiling gora with new hadoop version 0.23 fails.
BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
avro.ipc.BinaryOutputStream and avro.ipc.BinaryInputStream are also moved to avro.util package.
There might be much more incompatibilities there which we have not seen yet.
We gave up upgrading our nutchgora to the new hadoop 0.23 version.
Summary: Upgrade gora so to be compatible with hadoop 2 (was: Upgrade gora so to be compatible with hadoop 0.23)
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Reporter: raf shin
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.BinaryOutputStream and avro.ipc.BinaryInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
Posted by "Lewis John McGibbney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lewis John McGibbney updated GORA-144:
--------------------------------------
Component/s: maven
build process
avro
Affects Version/s: 0.2
Fix Version/s: 0.3
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Fix For: 0.3
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (GORA-144) Upgrade gora so to be compatible
with hadoop 2
Posted by "raf shin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292471#comment-13292471 ]
raf shin edited comment on GORA-144 at 6/10/12 8:37 AM:
--------------------------------------------------------
Yes, Many of the Avro 1.5.4 library API has been changed from 1.3.2 version. All Encoder/Decoder codes in Gora should be modified specially FakeResolvingDecoder.
was (Author: rafshin):
Yes, Many of the Avro 1.5.4 library API has been changed from 1.3.2 version. All Encoder/Decoder codes in Gora should be modified.
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Fix For: 0.3
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
Posted by "Lewis John McGibbney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491921#comment-13491921 ]
Lewis John McGibbney commented on GORA-144:
-------------------------------------------
We need to wait until the Avro dependencies have been upgraded
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Priority: Minor
> Fix For: 0.3
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (GORA-144) Upgrade gora so to be compatible
with hadoop 2
Posted by "raf shin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292471#comment-13292471 ]
raf shin edited comment on GORA-144 at 6/10/12 5:11 AM:
--------------------------------------------------------
Yes, Many of the Avro 1.5.4 library API has been changed from 1.3.2 version. All Encoder/Decoder codes in Gora should be modified.
was (Author: rafshin):
Yes, Many of the Avro 1.5.4 library API has been changed. All Encoder/Decoder codes in gora should be modified.
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Fix For: 0.3
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-144) Upgrade gora so to be compatible with
hadoop 2
Posted by "Lewis John McGibbney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292318#comment-13292318 ]
Lewis John McGibbney commented on GORA-144:
-------------------------------------------
We made the decision to upgrade the Gora hadoop deps to 1.0.1. Nutchgora currently ships with 1.0.0 iirc. Yes it will certainly be on the roadmap to shift to the 2.X Alpha release but do you think that this is heavily weighted on the upgrade of the Avro library?
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Reporter: raf shin
>
> TaskAttemptContext and JobContext which were a class in previous hadoop versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira