[jira] [Commented] (PIG-3132) NPE when illustrating a relation with HCatLoader

["Daniel Dai (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560140#comment-13560140 ] 

Daniel Dai commented on PIG-3132:
---------------------------------

There are multiple root causes:
1. There is no distinguish between backend and frontend in illustrate
2. ReadToEndLoader (invoked by POLoader, only used in illustrate) does not invoke setLocation
3. ReadToEndLoader does not have signature

There is also a fix in HCat side tracked by HCATALOG-163.
                
>  NPE when illustrating a relation with HCatLoader
> -------------------------------------------------
>
>                 Key: PIG-3132
>                 URL: https://issues.apache.org/jira/browse/PIG-3132
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.12
>
>         Attachments: PIG-3132-1.patch
>
>
> Get NPE exception when illustrate a relation with HCatLoader:
> {code}
> A = LOAD 'studenttab10k' USING org.apache.hcatalog.pig.HCatLoader();
> illustrate A;
> {code}
> Exception:
> {code}
> java.lang.NullPointerException
>         at org.apache.hcatalog.pig.PigHCatUtil.transformToTuple(PigHCatUtil.java:274)
>         at org.apache.hcatalog.pig.PigHCatUtil.transformToTuple(PigHCatUtil.java:238)
>         at org.apache.hcatalog.pig.HCatBaseLoader.getNext(HCatBaseLoader.java:61)
>         at org.apache.pig.impl.io.ReadToEndLoader.getNextHelper(ReadToEndLoader.java:210)
>         at org.apache.pig.impl.io.ReadToEndLoader.getNext(ReadToEndLoader.java:190)
>         at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLoad.getNext(POLoad.java:129)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:267)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:262)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
>         at org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:194)
>         at org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257)
>         at org.apache.pig.pen.ExampleGenerator.readBaseData(ExampleGenerator.java:222)
>         at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:154)
>         at org.apache.pig.PigServer.getExamples(PigServer.java:1245)
>         at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:698)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScriptParser.java:591)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:306)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
> {code}
> HCatalog side is tracked with HCATALOG-163.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira