You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Mohit Anchlia <mo...@gmail.com> on 2012/08/06 20:31:32 UTC
pig with Hbase
I am trying to read records from HBase using HBaseStorage. When I execute
simple load I get this error. I think I am missing some property, but I am
running pig on the cluster where hadoop and hbase is there.
I also have HBASE_HOME set:
# env|grep HBASE
HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias raw
at org.apache.pig.PigServer.openIterator(PigServer.java:900)
at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
at org.apache.pig.Main.run(Main.java:487)
at org.apache.pig.Main.main(Main.java:108)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
raw
at org.apache.pig.PigServer.storeEx(PigServer.java:999)
at org.apache.pig.PigServer.store(PigServer.java:962)
at org.apache.pig.PigServer.openIterator(PigServer.java:875)
... 7 more
Caused by:
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
ERROR 2017: Internal error creating job configuration.
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
at org.apache.pig.PigServer.storeEx(PigServer.java:995)
... 9 more
Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An error
is preventing HBase from connecting to ZooKeeper
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
at
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
at
org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
... 14 more
Caused by: java.io.IOException: Unable to determine ZooKeeper ensemble
at org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:92)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
... 21 more
Re: pig with Hbase
Posted by Bill Graham <bi...@gmail.com>.
What version of Pig are you using and does it work if you try setting
PIG_CLASSPATH with the HBase conf path?
On Mon, Aug 6, 2012 at 9:59 PM, Mohit Anchlia <mo...@gmail.com>wrote:
>
>
> On Mon, Aug 6, 2012 at 8:54 PM, Bill Graham <bi...@gmail.com> wrote:
>
>> Have you verified that the HBase confs point to the correct ZK nodes? Are
>> you able to run the hbase shell with those env settings?
>>
>>
> Yes HBase shell has no issues on those nodes.
>
>
>> On Mon, Aug 6, 2012 at 11:46 AM, Mohit Anchlia <mohitanchlia@gmail.com
>> >wrote:
>>
>> > On Mon, Aug 6, 2012 at 11:41 AM, Dmitriy Ryaboy <dv...@gmail.com>
>> > wrote:
>> >
>> > > Sounds like your hbase conf is not on the classpath.
>> > >
>> > I tried this too but didn't help
>> >
>> > # cat hbase_cp.sh
>> > HBASE_CONF_DIR=$HBASE_HOME/conf
>> > CLASSPATH=$HBASE_CONF_DIR:$CLASSPATH
>> > # ls $HBASE_CONF_DIR
>> > hadoop-metrics.properties hbase-env.sh hbase-site.xml
>> log4j.properties
>> > regionservers
>> >
>> >
>> > > D
>> > >
>> > > On Mon, Aug 6, 2012 at 11:31 AM, Mohit Anchlia <
>> mohitanchlia@gmail.com>
>> > > wrote:
>> > > > I am trying to read records from HBase using HBaseStorage. When I
>> > execute
>> > > > simple load I get this error. I think I am missing some property,
>> but I
>> > > am
>> > > > running pig on the cluster where hadoop and hbase is there.
>> > > >
>> > > > I also have HBASE_HOME set:
>> > > >
>> > > > # env|grep HBASE
>> > > > HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
>> > > >
>> > > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066:
>> Unable
>> > > to
>> > > > open iterator for alias raw
>> > > > at org.apache.pig.PigServer.openIterator(PigServer.java:900)
>> > > > at
>> > > >
>> > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>> > > > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
>> > > > at org.apache.pig.Main.run(Main.java:487)
>> > > > at org.apache.pig.Main.main(Main.java:108)
>> > > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
>> > alias
>> > > > raw
>> > > > at org.apache.pig.PigServer.storeEx(PigServer.java:999)
>> > > > at org.apache.pig.PigServer.store(PigServer.java:962)
>> > > > at org.apache.pig.PigServer.openIterator(PigServer.java:875)
>> > > > ... 7 more
>> > > > Caused by:
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
>> > > > ERROR 2017: Internal error creating job configuration.
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
>> > > > at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
>> > > > at
>> > > >
>> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
>> > > > at org.apache.pig.PigServer.storeEx(PigServer.java:995)
>> > > > ... 9 more
>> > > > Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An
>> > error
>> > > > is preventing HBase from connecting to ZooKeeper
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
>> > > > at
>> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
>> > > > at
>> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
>> > > > ... 14 more
>> > > > Caused by: java.io.IOException: Unable to determine ZooKeeper
>> ensemble
>> > > > at
>> > > org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:92)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
>> > > > ... 21 more
>> > >
>> >
>>
>>
>>
>> --
>> *Note that I'm no longer using my Yahoo! email address. Please email me at
>> billgraham@gmail.com going forward.*
>>
>
>
--
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*
Re: pig with Hbase
Posted by Mohit Anchlia <mo...@gmail.com>.
On Mon, Aug 6, 2012 at 8:54 PM, Bill Graham <bi...@gmail.com> wrote:
> Have you verified that the HBase confs point to the correct ZK nodes? Are
> you able to run the hbase shell with those env settings?
>
>
Yes HBase shell has no issues on those nodes.
> On Mon, Aug 6, 2012 at 11:46 AM, Mohit Anchlia <mohitanchlia@gmail.com
> >wrote:
>
> > On Mon, Aug 6, 2012 at 11:41 AM, Dmitriy Ryaboy <dv...@gmail.com>
> > wrote:
> >
> > > Sounds like your hbase conf is not on the classpath.
> > >
> > I tried this too but didn't help
> >
> > # cat hbase_cp.sh
> > HBASE_CONF_DIR=$HBASE_HOME/conf
> > CLASSPATH=$HBASE_CONF_DIR:$CLASSPATH
> > # ls $HBASE_CONF_DIR
> > hadoop-metrics.properties hbase-env.sh hbase-site.xml log4j.properties
> > regionservers
> >
> >
> > > D
> > >
> > > On Mon, Aug 6, 2012 at 11:31 AM, Mohit Anchlia <mohitanchlia@gmail.com
> >
> > > wrote:
> > > > I am trying to read records from HBase using HBaseStorage. When I
> > execute
> > > > simple load I get this error. I think I am missing some property,
> but I
> > > am
> > > > running pig on the cluster where hadoop and hbase is there.
> > > >
> > > > I also have HBASE_HOME set:
> > > >
> > > > # env|grep HBASE
> > > > HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
> > > >
> > > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066:
> Unable
> > > to
> > > > open iterator for alias raw
> > > > at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> > > > at
> > > >
> > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> > > > at
> > > >
> > >
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> > > > at
> > > >
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> > > > at
> > > >
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> > > > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
> > > > at org.apache.pig.Main.run(Main.java:487)
> > > > at org.apache.pig.Main.main(Main.java:108)
> > > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
> > alias
> > > > raw
> > > > at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> > > > at org.apache.pig.PigServer.store(PigServer.java:962)
> > > > at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> > > > ... 7 more
> > > > Caused by:
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> > > > ERROR 2017: Internal error creating job configuration.
> > > > at
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> > > > at
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> > > > at
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> > > > at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> > > > at
> > > >
> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> > > > at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> > > > ... 9 more
> > > > Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An
> > error
> > > > is preventing HBase from connecting to ZooKeeper
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> > > > at
> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> > > > at
> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> > > > at
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> > > > at
> > > >
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> > > > ... 14 more
> > > > Caused by: java.io.IOException: Unable to determine ZooKeeper
> ensemble
> > > > at
> > > org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:92)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> > > > ... 21 more
> > >
> >
>
>
>
> --
> *Note that I'm no longer using my Yahoo! email address. Please email me at
> billgraham@gmail.com going forward.*
>
Re: pig with Hbase
Posted by Bill Graham <bi...@gmail.com>.
Have you verified that the HBase confs point to the correct ZK nodes? Are
you able to run the hbase shell with those env settings?
On Mon, Aug 6, 2012 at 11:46 AM, Mohit Anchlia <mo...@gmail.com>wrote:
> On Mon, Aug 6, 2012 at 11:41 AM, Dmitriy Ryaboy <dv...@gmail.com>
> wrote:
>
> > Sounds like your hbase conf is not on the classpath.
> >
> I tried this too but didn't help
>
> # cat hbase_cp.sh
> HBASE_CONF_DIR=$HBASE_HOME/conf
> CLASSPATH=$HBASE_CONF_DIR:$CLASSPATH
> # ls $HBASE_CONF_DIR
> hadoop-metrics.properties hbase-env.sh hbase-site.xml log4j.properties
> regionservers
>
>
> > D
> >
> > On Mon, Aug 6, 2012 at 11:31 AM, Mohit Anchlia <mo...@gmail.com>
> > wrote:
> > > I am trying to read records from HBase using HBaseStorage. When I
> execute
> > > simple load I get this error. I think I am missing some property, but I
> > am
> > > running pig on the cluster where hadoop and hbase is there.
> > >
> > > I also have HBASE_HOME set:
> > >
> > > # env|grep HBASE
> > > HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
> > >
> > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
> > to
> > > open iterator for alias raw
> > > at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> > > at
> > >
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> > > at
> > >
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> > > at
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> > > at
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> > > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
> > > at org.apache.pig.Main.run(Main.java:487)
> > > at org.apache.pig.Main.main(Main.java:108)
> > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
> alias
> > > raw
> > > at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> > > at org.apache.pig.PigServer.store(PigServer.java:962)
> > > at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> > > ... 7 more
> > > Caused by:
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> > > ERROR 2017: Internal error creating job configuration.
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> > > at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> > > at
> > >
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> > > at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> > > ... 9 more
> > > Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An
> error
> > > is preventing HBase from connecting to ZooKeeper
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> > > at
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> > > at
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> > > ... 14 more
> > > Caused by: java.io.IOException: Unable to determine ZooKeeper ensemble
> > > at
> > org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:92)
> > > at
> > >
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> > > ... 21 more
> >
>
--
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*
Re: pig with Hbase
Posted by Mohit Anchlia <mo...@gmail.com>.
On Mon, Aug 6, 2012 at 11:41 AM, Dmitriy Ryaboy <dv...@gmail.com> wrote:
> Sounds like your hbase conf is not on the classpath.
>
I tried this too but didn't help
# cat hbase_cp.sh
HBASE_CONF_DIR=$HBASE_HOME/conf
CLASSPATH=$HBASE_CONF_DIR:$CLASSPATH
# ls $HBASE_CONF_DIR
hadoop-metrics.properties hbase-env.sh hbase-site.xml log4j.properties
regionservers
> D
>
> On Mon, Aug 6, 2012 at 11:31 AM, Mohit Anchlia <mo...@gmail.com>
> wrote:
> > I am trying to read records from HBase using HBaseStorage. When I execute
> > simple load I get this error. I think I am missing some property, but I
> am
> > running pig on the cluster where hadoop and hbase is there.
> >
> > I also have HBASE_HOME set:
> >
> > # env|grep HBASE
> > HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
> >
> > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
> to
> > open iterator for alias raw
> > at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> > at
> > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> > at
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> > at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> > at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
> > at org.apache.pig.Main.run(Main.java:487)
> > at org.apache.pig.Main.main(Main.java:108)
> > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
> > raw
> > at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> > at org.apache.pig.PigServer.store(PigServer.java:962)
> > at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> > ... 7 more
> > Caused by:
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> > ERROR 2017: Internal error creating job configuration.
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> > at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> > at
> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> > at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> > ... 9 more
> > Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An error
> > is preventing HBase from connecting to ZooKeeper
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> > at
> >
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> > ... 14 more
> > Caused by: java.io.IOException: Unable to determine ZooKeeper ensemble
> > at
> org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:92)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> > ... 21 more
>
Re: pig with Hbase
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
Sounds like your hbase conf is not on the classpath.
D
On Mon, Aug 6, 2012 at 11:31 AM, Mohit Anchlia <mo...@gmail.com> wrote:
> I am trying to read records from HBase using HBaseStorage. When I execute
> simple load I get this error. I think I am missing some property, but I am
> running pig on the cluster where hadoop and hbase is there.
>
> I also have HBASE_HOME set:
>
> # env|grep HBASE
> HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
>
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> open iterator for alias raw
> at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> at
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
> at org.apache.pig.Main.run(Main.java:487)
> at org.apache.pig.Main.main(Main.java:108)
> Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
> raw
> at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> at org.apache.pig.PigServer.store(PigServer.java:962)
> at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> ... 7 more
> Caused by:
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> ERROR 2017: Internal error creating job configuration.
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> ... 9 more
> Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An error
> is preventing HBase from connecting to ZooKeeper
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> at
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> at
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> ... 14 more
> Caused by: java.io.IOException: Unable to determine ZooKeeper ensemble
> at org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:92)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> ... 21 more