You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Nick Dimiduk (JIRA)" <ji...@apache.org> on 2013/11/15 23:19:21 UTC

[jira] [Updated] (PIG-3285) Jobs using HBaseStorage fail to ship dependency jars

     [ https://issues.apache.org/jira/browse/PIG-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nick Dimiduk updated PIG-3285:
------------------------------

    Attachment: 0001-PIG-3285-Add-HBase-dependency-jars.patch

Here's an updated patch. It would be nice to test and confirm end-to-end. Testing in my local checkout results in an NPE; I assume I'm doing something wrong.

{noformat}
$ ant clean && ant && ant -Dtestcase=TestHBaseStorage test
...
Testcase: org.apache.pig.test.TestHBaseStorage took 0 sec
        Caused an ERROR
null not an instance of org.apache.hadoop.hbase.MiniHBaseCluster
java.lang.RuntimeException: null not an instance of org.apache.hadoop.hbase.MiniHBaseCluster
        at org.apache.hadoop.hbase.HBaseTestingUtility.getMiniHBaseCluster(HBaseTestingUtility.java:701)
        at org.apache.hadoop.hbase.HBaseTestingUtility.getHBaseCluster(HBaseTestingUtility.java:1591)
        at org.apache.pig.test.TestHBaseStorage.oneTimeTearDown(TestHBaseStorage.java:92)
{noformat}

> Jobs using HBaseStorage fail to ship dependency jars
> ----------------------------------------------------
>
>                 Key: PIG-3285
>                 URL: https://issues.apache.org/jira/browse/PIG-3285
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>             Fix For: 0.11.1
>
>         Attachments: 0001-PIG-3285-Add-HBase-dependency-jars.patch, 0001-PIG-3285-Add-HBase-dependency-jars.patch, 0001-PIG-3285-Add-HBase-dependency-jars.patch, 1.pig, 1.txt, 2.pig
>
>
> Launching a job consuming {{HBaseStorage}} fails out of the box. The user must specify {{-Dpig.additional.jars}} for HBase and all of its dependencies. Exceptions look something like this:
> {noformat}
> 2013-04-19 18:58:39,360 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.NoClassDefFoundError: com/google/protobuf/Message
> 	at org.apache.hadoop.hbase.io.HbaseObjectWritable.<clinit>(HbaseObjectWritable.java:266)
> 	at org.apache.hadoop.hbase.ipc.Invocation.write(Invocation.java:139)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.sendParam(HBaseClient.java:612)
> 	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:975)
> 	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:84)
> 	at $Proxy7.getProtocolVersion(Unknown Source)
> 	at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:136)
> 	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:208)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1#6144)