You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Joep Rottinghuis (JIRA)" <ji...@apache.org> on 2011/09/16 07:48:15 UTC
[jira] [Created] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Make hadoop-common use same version of avro as HBase
----------------------------------------------------
Key: HADOOP-7646
URL: https://issues.apache.org/jira/browse/HADOOP-7646
Project: Hadoop Common
Issue Type: Bug
Components: io, ipc
Affects Versions: 0.22.0
Reporter: Joep Rottinghuis
Assignee: Joep Rottinghuis
Fix For: 0.22.0
HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106820#comment-13106820 ]
Doug Cutting commented on HADOOP-7646:
--------------------------------------
Patch looks good to me.
One minor improvement would to be replace java.lang.CharSequence with just CharSequence.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joep Rottinghuis updated HADOOP-7646:
-------------------------------------
Attachment: HADOOP-7646-branch-22.patch
Still get compilation error, but it's not immediately obvious why. Should probably call it quits for today and look at this again tomorrow.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Konstantin Shvachko (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13115916#comment-13115916 ]
Konstantin Shvachko commented on HADOOP-7646:
---------------------------------------------
I think I found out what is going on with the tests. Reverting the patch.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108967#comment-13108967 ]
Konstantin Shvachko commented on HADOOP-7646:
---------------------------------------------
+1
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13115923#comment-13115923 ]
Hudson commented on HADOOP-7646:
--------------------------------
Integrated in Hadoop-Common-22-branch #85 (See [https://builds.apache.org/job/Hadoop-Common-22-branch/85/])
HADOOP-7646.Revert due to test failures.
shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1176616
Files :
* /hadoop/common/branches/branch-0.22/common/CHANGES.txt
* /hadoop/common/branches/branch-0.22/common/build.xml
* /hadoop/common/branches/branch-0.22/common/ivy.xml
* /hadoop/common/branches/branch-0.22/common/ivy/hadoop-common-instrumented-template.xml
* /hadoop/common/branches/branch-0.22/common/ivy/hadoop-common-template.xml
* /hadoop/common/branches/branch-0.22/common/ivy/libraries.properties
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/io/serializer/avro/AvroSerialization.java
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/ipc/AvroRpcEngine.java
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/ipc/AvroSpecificRpcEngine.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/io/AvroTestUtil.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/ipc/AvroTestProtocol.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/ipc/TestAvroRpc.java
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106834#comment-13106834 ]
Joep Rottinghuis commented on HADOOP-7646:
------------------------------------------
Let me file a Jira for hdfs and mapreduce (the latter seems to be the most work).
Then I'll run all three through our Jenkins builds together and do a quick test on it before we commit them together.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13115761#comment-13115761 ]
Hudson commented on HADOOP-7646:
--------------------------------
Integrated in Hadoop-Common-22-branch #84 (See [https://builds.apache.org/job/Hadoop-Common-22-branch/84/])
HADOOP-7646. Upgrade to Avro 1.5.3. Contributed by Joep Rottinghuis.
shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1176485
Files :
* /hadoop/common/branches/branch-0.22/common/CHANGES.txt
* /hadoop/common/branches/branch-0.22/common/build.xml
* /hadoop/common/branches/branch-0.22/common/ivy.xml
* /hadoop/common/branches/branch-0.22/common/ivy/hadoop-common-instrumented-template.xml
* /hadoop/common/branches/branch-0.22/common/ivy/hadoop-common-template.xml
* /hadoop/common/branches/branch-0.22/common/ivy/libraries.properties
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/io/serializer/avro/AvroSerialization.java
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/ipc/AvroRpcEngine.java
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/ipc/AvroSpecificRpcEngine.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/io/AvroTestUtil.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/ipc/AvroTestProtocol.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/ipc/TestAvroRpc.java
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joep Rottinghuis updated HADOOP-7646:
-------------------------------------
Attachment: HADOOP-7646-branch-22.patch
I had used the fully qualified java.lang.CharSequence to match the generated AvroSpecificTestProtocol, but adjusted according to Doug's suggestion.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13116081#comment-13116081 ]
Hudson commented on HADOOP-7646:
--------------------------------
Integrated in Hadoop-Common-22-branch #86 (See [https://builds.apache.org/job/Hadoop-Common-22-branch/86/])
HADOOP-7646. Upgrade to Avro 1.5.3. Contributed by Joep Rottinghuis.
shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1176688
Files :
* /hadoop/common/branches/branch-0.22/common/CHANGES.txt
* /hadoop/common/branches/branch-0.22/common/build.xml
* /hadoop/common/branches/branch-0.22/common/ivy.xml
* /hadoop/common/branches/branch-0.22/common/ivy/hadoop-common-instrumented-template.xml
* /hadoop/common/branches/branch-0.22/common/ivy/hadoop-common-template.xml
* /hadoop/common/branches/branch-0.22/common/ivy/libraries.properties
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/io/serializer/avro/AvroSerialization.java
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/ipc/AvroRpcEngine.java
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/ipc/AvroSpecificRpcEngine.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/io/AvroTestUtil.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/ipc/AvroTestProtocol.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/ipc/TestAvroRpc.java
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22-shv.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106823#comment-13106823 ]
Joep Rottinghuis commented on HADOOP-7646:
------------------------------------------
Eli: yes makes sense to have all branches on the same version.
Doug: good point, will make suggested change.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13109088#comment-13109088 ]
Konstantin Shvachko commented on HADOOP-7646:
---------------------------------------------
3 tests are failing with this patch:
[junit] Test org.apache.hadoop.fs.TestPath FAILED
[junit] Test org.apache.hadoop.io.TestEnumSetWritable FAILED
[junit] Test org.apache.hadoop.io.TestText FAILED
Will commit as long as those are fixed.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joep Rottinghuis updated HADOOP-7646:
-------------------------------------
Attachment: HADOOP-7646-branch-22.patch
Resolved all compilation issues. Further testing will follow.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Posted by "Konstantin Shvachko (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HADOOP-7646:
----------------------------------------
Attachment: HADOOP-7646-branch-22-shv.patch
Here is a modification. The point is that BinaryEncoder needs to flush before written data will be available for the reader. Looks like a difference in semantics with the old avro.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22-shv.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108302#comment-13108302 ]
Joep Rottinghuis commented on HADOOP-7646:
------------------------------------------
A patch is available for each of the sub-projects: common, hdfs, and mapreduce. The latter one needs review as I think more work is required there.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Posted by "Konstantin Shvachko (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko resolved HADOOP-7646.
-----------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
I just committed this. Thank you Joep.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22-shv.patch, HADOOP-7646-branch-22-shv.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106657#comment-13106657 ]
Eli Collins commented on HADOOP-7646:
-------------------------------------
Btw trunk is currently on 1.5.3 in some places (HADOOP-7264, see /hadoop-project/pom.xml) and 1.5.2 in others (/hadoop-mapreduce-project/ivy/libraries.properties). How about we bring all branches/projects up to 1.5.3?
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Konstantin Shvachko (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13115038#comment-13115038 ]
Konstantin Shvachko commented on HADOOP-7646:
---------------------------------------------
The last patch passes the tests.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joep Rottinghuis updated HADOOP-7646:
-------------------------------------
Attachment: HADOOP-7646-branch-22.patch
Resolved compilation issues. Further testing to follow...
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7646) Make hadoop-common use same version
of avro as HBase
Posted by "Konstantin Shvachko (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HADOOP-7646:
----------------------------------------
Attachment: HADOOP-7646-branch-22-shv.patch
Removed white space change.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22-shv.patch, HADOOP-7646-branch-22-shv.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7646) Make hadoop-common use same
version of avro as HBase
Posted by "Joep Rottinghuis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108205#comment-13108205 ]
Joep Rottinghuis commented on HADOOP-7646:
------------------------------------------
Ivy seems to cache some of the dependencies. I've found that cleaning out the local cache (~/.ivy2 and ~/.m2/cache if needed) can help with this.
After that I build common first with target mvn:install, then hdfs, then mapreduce.
> Make hadoop-common use same version of avro as HBase
> ----------------------------------------------------
>
> Key: HADOOP-7646
> URL: https://issues.apache.org/jira/browse/HADOOP-7646
> Project: Hadoop Common
> Issue Type: Bug
> Components: io, ipc
> Affects Versions: 0.22.0
> Reporter: Joep Rottinghuis
> Assignee: Joep Rottinghuis
> Fix For: 0.22.0
>
> Attachments: HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch, HADOOP-7646-branch-22.patch
>
>
> HBase depends on avro 1.5.3 whereas hadoop-common depends on 1.3.2.
> When building HBase on top of hadoop, this should be consistent.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira