You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Mohit Anchlia <mo...@gmail.com> on 2012/08/11 03:01:03 UTC
Pig HBaseStorage error
I am running basic pig script but it's failing. There is other job that
loads data that works.
Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias raw
at org.apache.pig.PigServer.openIterator(PigServer.java:900)
at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
at org.apache.pig.Main.run(Main.java:427)
at org.apache.pig.Main.main(Main.java:108)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
raw
at org.apache.pig.PigServer.storeEx(PigServer.java:999)
at org.apache.pig.PigServer.store(PigServer.java:962)
at org.apache.pig.PigServer.openIterator(PigServer.java:875)
... 7 more
Caused by:
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
ERROR 2017: Internal error creating job configuration.
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
at org.apache.pig.PigServer.storeEx(PigServer.java:995)
... 9 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
at
org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
at
org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
at
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
at
org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
... 14 more
raw = LOAD 'hbase://SESSION_TIMELINE1'
USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
's_t_mtx:*', '-loadKey true -limit 5')
AS (id:bytearray, s_t_mtx_map:map[]);
dump raw;
[root@dsdb4 mapr]# hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
hbase(main):001:0> describe SESSION_TIMELINE1
NameError: uninitialized constant SESSION_TIMELINE1
hbase(main):002:0> describe 'SESSION_TIMELINE1'
DESCRIPTION
ENABLED
{NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX', BLOOMFILTER
=> 'NONE', REPLICATION_SCOPE => '0', COMPRES true
SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
}
1 row(s) in 0.5750 seconds
Re: Pig HBaseStorage error
Posted by Bill Graham <bi...@gmail.com>.
HBase CF names are case sensitive, so you're query might be off since
you're using lowercase.
If that the problem still persists with the same case, would it be possible
to see if you can reproduce against a Pig build from the trunk?
On Mon, Aug 13, 2012 at 8:28 AM, Mohit Anchlia <mo...@gmail.com>wrote:
>
>
> On Sun, Aug 12, 2012 at 11:26 PM, Bill Graham <bi...@gmail.com>wrote:
>
>> This seems to be the problem:
>>
>> Caused by: java.lang.NullPointerException
>> at
>> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
>>
>> Which seems like the Conf is null, which is really odd.
>>
>> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKConfig.java?view=markup
>>
>> What version of Pig are you using? Does this happen when using a Pig build
>> from the trunk?
>>
>> I am using .9, strange thing is that when I run load job it works.
>
>>
>> On Sat, Aug 11, 2012 at 7:20 PM, Mohit Anchlia <mohitanchlia@gmail.com
>> >wrote:
>>
>> > I am wondering if my pig script is correct? I took it from some of the
>> > examples from the wiki:
>> >
>> > raw = LOAD 'hbase://SESSION_TIMELINE1'
>> > USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
>> > 's_t_mtx:*', '-loadKey true -limit 5')
>> > AS (id:bytearray, s_t_mtx_map:map[]);
>> > dump raw;
>> >
>> > On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <mohitanchlia@gmail.com
>> > >wrote:
>> >
>> > > I am running basic pig script but it's failing. There is other job
>> that
>> > > loads data that works.
>> > >
>> > >
>> > > Pig Stack Trace
>> > > ---------------
>> > > ERROR 2017: Internal error creating job configuration.
>> > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066:
>> Unable to
>> > > open iterator for alias raw
>> > > at org.apache.pig.PigServer.openIterator(PigServer.java:900)
>> > > at
>> > >
>> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
>> > > at
>> > >
>> >
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
>> > > at
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
>> > > at
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>> > > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
>> > > at org.apache.pig.Main.run(Main.java:427)
>> > > at org.apache.pig.Main.main(Main.java:108)
>> > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
>> alias
>> > > raw
>> > > at org.apache.pig.PigServer.storeEx(PigServer.java:999)
>> > > at org.apache.pig.PigServer.store(PigServer.java:962)
>> > > at org.apache.pig.PigServer.openIterator(PigServer.java:875)
>> > > ... 7 more
>> > > Caused by:
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
>> > > ERROR 2017: Internal error creating job configuration.
>> > > at
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
>> > > at
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
>> > > at
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
>> > > at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
>> > > at
>> > >
>> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
>> > > at org.apache.pig.PigServer.storeEx(PigServer.java:995)
>> > > ... 9 more
>> > > Caused by: java.lang.NullPointerException
>> > > at
>> > >
>> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
>> > > at
>> > >
>> org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
>> > > at
>> > >
>> >
>> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
>> > > at
>> > >
>> >
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
>> > > at
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
>> > > at
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
>> > > at
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
>> > > at
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
>> > > at
>> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
>> > > at
>> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
>> > > at
>> > >
>> >
>> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
>> > > at
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
>> > > ... 14 more
>> > >
>> > > raw = LOAD 'hbase://SESSION_TIMELINE1'
>> > > USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
>> > > 's_t_mtx:*', '-loadKey true -limit 5')
>> > > AS (id:bytearray, s_t_mtx_map:map[]);
>> > > dump raw;
>> > > [root@dsdb4 mapr]# hbase shell
>> > > HBase Shell; enter 'help<RETURN>' for list of supported commands.
>> > > Type "exit<RETURN>" to leave the HBase Shell
>> > > Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
>> > > hbase(main):001:0> describe SESSION_TIMELINE1
>> > > NameError: uninitialized constant SESSION_TIMELINE1
>> > > hbase(main):002:0> describe 'SESSION_TIMELINE1'
>> > > DESCRIPTION
>> > > ENABLED
>> > > {NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX',
>> > > BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRES true
>> > > SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
>> > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
>> > > }
>> > > 1 row(s) in 0.5750 seconds
>> > >
>> >
>>
>>
>>
>> --
>> *Note that I'm no longer using my Yahoo! email address. Please email me at
>> billgraham@gmail.com going forward.*
>>
>
>
--
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*
Re: Pig HBaseStorage error
Posted by Mohit Anchlia <mo...@gmail.com>.
On Sun, Aug 12, 2012 at 11:26 PM, Bill Graham <bi...@gmail.com> wrote:
> This seems to be the problem:
>
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
>
> Which seems like the Conf is null, which is really odd.
>
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKConfig.java?view=markup
>
> What version of Pig are you using? Does this happen when using a Pig build
> from the trunk?
>
> I am using .9, strange thing is that when I run load job it works.
>
> On Sat, Aug 11, 2012 at 7:20 PM, Mohit Anchlia <mohitanchlia@gmail.com
> >wrote:
>
> > I am wondering if my pig script is correct? I took it from some of the
> > examples from the wiki:
> >
> > raw = LOAD 'hbase://SESSION_TIMELINE1'
> > USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
> > 's_t_mtx:*', '-loadKey true -limit 5')
> > AS (id:bytearray, s_t_mtx_map:map[]);
> > dump raw;
> >
> > On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <mohitanchlia@gmail.com
> > >wrote:
> >
> > > I am running basic pig script but it's failing. There is other job that
> > > loads data that works.
> > >
> > >
> > > Pig Stack Trace
> > > ---------------
> > > ERROR 2017: Internal error creating job configuration.
> > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
> to
> > > open iterator for alias raw
> > > at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> > > at
> > >
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> > > at
> > >
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> > > at
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> > > at
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> > > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> > > at org.apache.pig.Main.run(Main.java:427)
> > > at org.apache.pig.Main.main(Main.java:108)
> > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
> alias
> > > raw
> > > at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> > > at org.apache.pig.PigServer.store(PigServer.java:962)
> > > at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> > > ... 7 more
> > > Caused by:
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> > > ERROR 2017: Internal error creating job configuration.
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> > > at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> > > at
> > >
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> > > at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> > > ... 9 more
> > > Caused by: java.lang.NullPointerException
> > > at
> > >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
> > > at
> > >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
> > > at
> > >
> >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
> > > at
> > >
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> > > at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> > > at
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> > > at
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> > > at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> > > ... 14 more
> > >
> > > raw = LOAD 'hbase://SESSION_TIMELINE1'
> > > USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
> > > 's_t_mtx:*', '-loadKey true -limit 5')
> > > AS (id:bytearray, s_t_mtx_map:map[]);
> > > dump raw;
> > > [root@dsdb4 mapr]# hbase shell
> > > HBase Shell; enter 'help<RETURN>' for list of supported commands.
> > > Type "exit<RETURN>" to leave the HBase Shell
> > > Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
> > > hbase(main):001:0> describe SESSION_TIMELINE1
> > > NameError: uninitialized constant SESSION_TIMELINE1
> > > hbase(main):002:0> describe 'SESSION_TIMELINE1'
> > > DESCRIPTION
> > > ENABLED
> > > {NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX',
> > > BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRES true
> > > SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
> > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
> > > }
> > > 1 row(s) in 0.5750 seconds
> > >
> >
>
>
>
> --
> *Note that I'm no longer using my Yahoo! email address. Please email me at
> billgraham@gmail.com going forward.*
>
Re: Pig HBaseStorage error
Posted by Bill Graham <bi...@gmail.com>.
This seems to be the problem:
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
Which seems like the Conf is null, which is really odd.
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKConfig.java?view=markup
What version of Pig are you using? Does this happen when using a Pig build
from the trunk?
On Sat, Aug 11, 2012 at 7:20 PM, Mohit Anchlia <mo...@gmail.com>wrote:
> I am wondering if my pig script is correct? I took it from some of the
> examples from the wiki:
>
> raw = LOAD 'hbase://SESSION_TIMELINE1'
> USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
> 's_t_mtx:*', '-loadKey true -limit 5')
> AS (id:bytearray, s_t_mtx_map:map[]);
> dump raw;
>
> On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <mohitanchlia@gmail.com
> >wrote:
>
> > I am running basic pig script but it's failing. There is other job that
> > loads data that works.
> >
> >
> > Pig Stack Trace
> > ---------------
> > ERROR 2017: Internal error creating job configuration.
> > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> > open iterator for alias raw
> > at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> > at
> > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> > at
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> > at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> > at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> > at org.apache.pig.Main.run(Main.java:427)
> > at org.apache.pig.Main.main(Main.java:108)
> > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
> > raw
> > at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> > at org.apache.pig.PigServer.store(PigServer.java:962)
> > at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> > ... 7 more
> > Caused by:
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> > ERROR 2017: Internal error creating job configuration.
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> > at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> > at
> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> > at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> > ... 9 more
> > Caused by: java.lang.NullPointerException
> > at
> > org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
> > at
> > org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> > at
> >
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> > ... 14 more
> >
> > raw = LOAD 'hbase://SESSION_TIMELINE1'
> > USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
> > 's_t_mtx:*', '-loadKey true -limit 5')
> > AS (id:bytearray, s_t_mtx_map:map[]);
> > dump raw;
> > [root@dsdb4 mapr]# hbase shell
> > HBase Shell; enter 'help<RETURN>' for list of supported commands.
> > Type "exit<RETURN>" to leave the HBase Shell
> > Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
> > hbase(main):001:0> describe SESSION_TIMELINE1
> > NameError: uninitialized constant SESSION_TIMELINE1
> > hbase(main):002:0> describe 'SESSION_TIMELINE1'
> > DESCRIPTION
> > ENABLED
> > {NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX',
> > BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRES true
> > SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
> > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
> > }
> > 1 row(s) in 0.5750 seconds
> >
>
--
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*
Re: Pig HBaseStorage error
Posted by Mohit Anchlia <mo...@gmail.com>.
I am wondering if my pig script is correct? I took it from some of the
examples from the wiki:
raw = LOAD 'hbase://SESSION_TIMELINE1'
USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
's_t_mtx:*', '-loadKey true -limit 5')
AS (id:bytearray, s_t_mtx_map:map[]);
dump raw;
On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <mo...@gmail.com>wrote:
> I am running basic pig script but it's failing. There is other job that
> loads data that works.
>
>
> Pig Stack Trace
> ---------------
> ERROR 2017: Internal error creating job configuration.
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> open iterator for alias raw
> at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> at
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> at org.apache.pig.Main.run(Main.java:427)
> at org.apache.pig.Main.main(Main.java:108)
> Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
> raw
> at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> at org.apache.pig.PigServer.store(PigServer.java:962)
> at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> ... 7 more
> Caused by:
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> ERROR 2017: Internal error creating job configuration.
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> ... 9 more
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
> at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
> at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> at
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> at
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> ... 14 more
>
> raw = LOAD 'hbase://SESSION_TIMELINE1'
> USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
> 's_t_mtx:*', '-loadKey true -limit 5')
> AS (id:bytearray, s_t_mtx_map:map[]);
> dump raw;
> [root@dsdb4 mapr]# hbase shell
> HBase Shell; enter 'help<RETURN>' for list of supported commands.
> Type "exit<RETURN>" to leave the HBase Shell
> Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
> hbase(main):001:0> describe SESSION_TIMELINE1
> NameError: uninitialized constant SESSION_TIMELINE1
> hbase(main):002:0> describe 'SESSION_TIMELINE1'
> DESCRIPTION
> ENABLED
> {NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX',
> BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRES true
> SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
> }
> 1 row(s) in 0.5750 seconds
>