about HBaseStorage

["Yigitbasi, Nezih" <ne...@intel.com>]

Hi all,

1-      I couldn't get TestHBaseStorage unit test running with hadoop-1.2.1 and hbase-0.94.12. Is it supposed to work with those versions? The test hangs for some time and fails with the exception below.

2-      Is there any Pig function for deleting rows from an existing HBase table? With some research I couldn't find one and I am implementing a store function for that purpose. If anyone is interested I will be happy to contribute it. The delete functionality can also be imitated with the existing HBaseStorage function by storing the filtered tuples to a new HBase table, but this has quite some overhead for large datasets.

Thanks,
Nezih

    [junit] java.io.IOException: Shutting down
    [junit]     at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:203)
    [junit]     at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:76)
    [junit]     at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:632)
    [junit]     at org.apache.pig.test.TestHBaseStorage.setUp(TestHBaseStorage.java:86)
    [junit] Caused by: java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterKeeperErrorCode = ConnectionLoss for /hbase
    [junit]     at org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:134)
    [junit]     at org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:197)
    [junit]     at org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:147)
    [junit]     at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:185)
    [junit] Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: master:57543-0x143b26706a80000-0x143b26706a80000-0x143b26706a80000-0x143b26706a80000 Unexpected KeeperException creating base node
    [junit]     at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:169)
    [junit]     at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:154)
    [junit]     at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:282)
    [junit]     at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    [junit]     at org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:131)
    [junit] Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
    [junit]     at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
    [junit]     at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
    [junit]     at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1036)
    [junit]     at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1064)
    [junit]     at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:176)
    [junit]     at org.apache.hadoop.hbase.zookeeper.ZKUtil.createAndFailSilent(ZKUtil.java:903)
    [junit]     at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:161)
    [junit]
    [junit] Test org.apache.pig.test.TestHBaseStorage FAILED