You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jeff Hammerbacher (JIRA)" <ji...@apache.org> on 2010/12/26 19:53:45 UTC
[jira] Created: (HBASE-3393) Update Avro gateway to use Avro 1.4.1
and the new server.join() method
Update Avro gateway to use Avro 1.4.1 and the new server.join() method
----------------------------------------------------------------------
Key: HBASE-3393
URL: https://issues.apache.org/jira/browse/HBASE-3393
Project: HBase
Issue Type: Sub-task
Components: avro
Reporter: Jeff Hammerbacher
Assignee: Jeff Hammerbacher
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3393) Update Avro gateway to use Avro
1.4.1 and the new server.join() method
Posted by "Lars Francke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998063#comment-12998063 ]
Lars Francke commented on HBASE-3393:
-------------------------------------
I know this is closed but just to add that Scott Carey was incorrect in saying that repositories in dependent projects aren't picked up. We need that JBoss repository simply because the Avro 1.4.1 POM is incorrect. Should we upgrade to 1.5.0 or later we can remove it again.
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Fix For: 0.92.0
>
> Attachments: HBASE-3393-2.patch, HBASE-3393-3.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3393) Update Avro gateway to use Avro 1.4.1
and the new server.join() method
Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeff Hammerbacher updated HBASE-3393:
-------------------------------------
Attachment: HBASE-3393.patch
Tests fail with "java.lang.NoSuchFieldError: families at org.apache.hadoop.hbase.avro.TestAvroServer.testFamilyAdminAndMetadata(TestAvroServer.java:156)" and similar failures.
Also, won't build without manually adding JBoss repository to pom.xml as directed at http://www.jboss.org/netty/downloads.html.
That said, wanted to get the patch up in case others can figure out the test failures.
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Attachments: HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3393) Update Avro gateway to use Avro
1.4.1 and the new server.join() method
Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12975149#action_12975149 ]
Jeff Hammerbacher commented on HBASE-3393:
------------------------------------------
I also fixed a bug here where the Avro server wasn't using the port passed to it at the command line.
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3393) Update Avro gateway to use Avro
1.4.1 and the new server.join() method
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12975594#action_12975594 ]
stack commented on HBASE-3393:
------------------------------
I applied the patch along w/ Lars qualification on the jboss repo and got this compiling:
{code}
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Compilation failure
/Users/Stack/checkouts/trunk/src/main/java/org/apache/hadoop/hbase/avro/AvroUtil.java:[140,26] incompatible types
found : org.apache.avro.generic.GenericData.Array<org.apache.avro.util.Utf8>
required: java.util.List<java.lang.CharSequence>
{code}
You get that Jeff?
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Attachments: HBASE-3393-2.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HBASE-3393) Update Avro gateway to use Avro 1.4.1
and the new server.join() method
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-3393.
--------------------------
Resolution: Fixed
Fix Version/s: 0.92.0
Hadoop Flags: [Reviewed]
Applied to TRUNK. Thanks for the patch Jeff (and the amendment Lars). Let me know if you want it on branch though it probably doesn't belong there.
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Fix For: 0.92.0
>
> Attachments: HBASE-3393-2.patch, HBASE-3393-3.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-3393) Update Avro gateway to use Avro 1.4.1
and the new server.join() method
Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeff Hammerbacher updated HBASE-3393:
-------------------------------------
Attachment: HBASE-3393-3.patch
This one should work. Tests pass, and I was able to use pyhbase to throw some data at a local cluster.
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Attachments: HBASE-3393-2.patch, HBASE-3393-3.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3393) Update Avro gateway to use Avro
1.4.1 and the new server.join() method
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12975746#action_12975746 ]
Hudson commented on HBASE-3393:
-------------------------------
Integrated in HBase-TRUNK #1700 (See [https://hudson.apache.org/hudson/job/HBase-TRUNK/1700/])
HBASE-3393 Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Fix For: 0.92.0
>
> Attachments: HBASE-3393-2.patch, HBASE-3393-3.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3393) Update Avro gateway to use Avro
1.4.1 and the new server.join() method
Posted by "Lars Francke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12975485#action_12975485 ]
Lars Francke commented on HBASE-3393:
-------------------------------------
The correct JBoss repository is: http://repository.jboss.org/nexus/content/groups/public-jboss/ the "public" one also mirrors central. The Netty page should be updated.
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Attachments: HBASE-3393-2.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Commented] (HBASE-3393) Update Avro gateway to use Avro
1.4.1 and the new server.join() method
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046884#comment-13046884 ]
stack commented on HBASE-3393:
------------------------------
This upgrade is incompatible with hadoop 0.22; if you run hbase unit tests TestHFileOutputFormat fails because of the incompatible avros (hbase has 1.4.1 and hadoop 0.22 has 1.3.2).
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Fix For: 0.92.0
>
> Attachments: HBASE-3393-2.patch, HBASE-3393-3.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3393) Update Avro gateway to use Avro
1.4.1 and the new server.join() method
Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12975604#action_12975604 ]
Jeff Hammerbacher commented on HBASE-3393:
------------------------------------------
Hey Stack,
Huh, that's a new one for me. I was getting a different error (the NoSuchFieldError quoted above). Your error is easier to fix. I need to figure out the GenericArray --> List API change that happened during Avro 1.3.3 --> 1.4.1 and get this working. Will do what I can today.
Regards,
Jeff
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Attachments: HBASE-3393-2.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-3393) Update Avro gateway to use Avro 1.4.1
and the new server.join() method
Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jeff Hammerbacher updated HBASE-3393:
-------------------------------------
Attachment: HBASE-3393-2.patch
Turns out Maven won't read repositories from dependent projects. I've added the JBoss repository to the HBase pom.xml so that Avro will build correctly.
> Update Avro gateway to use Avro 1.4.1 and the new server.join() method
> ----------------------------------------------------------------------
>
> Key: HBASE-3393
> URL: https://issues.apache.org/jira/browse/HBASE-3393
> Project: HBase
> Issue Type: Sub-task
> Components: avro
> Reporter: Jeff Hammerbacher
> Assignee: Jeff Hammerbacher
> Attachments: HBASE-3393-2.patch, HBASE-3393.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.