You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Marcin Cylke <mc...@touk.pl> on 2012/03/08 09:05:39 UTC

Re: [ pigusers ] Re: pig and hbase integration = hanging jobs

On 08/03/12 08:38, Dmitriy Ryaboy wrote:
> If the task did not start at all, you want to check the setup stage to
> see if there was an error. Does the MR job page have something at the
> top that says "Job Setup: Failed", with "failed" being a link? Are
> there error messages there?


Clicking on the status page on the link for "Job status" I see an error 
in running a job:

java.lang.RuntimeException: java.io.IOException: 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@64df83e5 
closed
	at 
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:200)
	at 
org.apache.pig.backend.hadoop.hbase.HBaseStorage.getOutputFormat(HBaseStorage.java:521)
	at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputCommitter.getCommitters(PigOutputCommitter.java:91)
	at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputCommitter.<init>(PigOutputCommitter.java:69)
	at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getOutputCommitter(PigOutputFormat.java:279)
	at org.apache.hadoop.mapred.Task.initialize(Task.java:515)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:363)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.io.IOException: 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@64df83e5 
closed
	at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:794)
	at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:782)
	at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:249)
	at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:213)
	at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:171)
	at 
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:195)
	... 11 more


I'll dig into this, but I You have some thoughts about the above 
exception, please share :)

Regards
Marcin