You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Dmitriy V. Ryaboy (Resolved) (JIRA)" <ji...@apache.org> on 2012/03/27 22:50:28 UTC

[jira] [Resolved] (PIG-2085) HBaseStorage fails with multiple STORE statements

     [ https://issues.apache.org/jira/browse/PIG-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dmitriy V. Ryaboy resolved PIG-2085.
------------------------------------

    Resolution: Not A Problem

Just doing some housecleaning.
                
> HBaseStorage fails with multiple STORE statements
> -------------------------------------------------
>
>                 Key: PIG-2085
>                 URL: https://issues.apache.org/jira/browse/PIG-2085
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Bill Graham
>            Assignee: Bill Graham
>         Attachments: PIG-2085_example_input.txt, PIG-2085_example_script.pig, PIG-2085_schema.hbase
>
>
> Scripts with multiple STORE statements using HBaseStorage fail when run against a cluster (they succeed in local mode). Below is an example script:
> {code}
> raw = LOAD 'hbase_split_load_bug.txt' AS
>       (f1: chararray, f2:chararray);
> SPLIT raw INTO apples IF (f2 == 'apple'), oranges IF (f2 == 'orange');
> STORE apples INTO 'hbase://test_table'
>    USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:apple');
> STORE oranges INTO 'hbase://test_table'
>    USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:orange');
> {code}
> The server throws the following exception after {{apples}} is successfully stored:
> {code}
> Backend error message
> ---------------------
> java.io.IOException: org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@6273305c closed
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:566)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1113)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatchOfPuts(HConnectionManager.java:1233)
>         at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:819)
>         at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.close(TableOutputFormat.java:106)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReducePOStoreImpl.tearDown(MapReducePOStoreImpl.java:96)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.tearDown(POStore.java:122)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.cleanup(PigMapBase.java:128)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
>         at org.apache.hadoop.mapred.Child.main(Child.java:170)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira