You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Bill Graham (JIRA)" <ji...@apache.org> on 2012/08/13 03:46:38 UTC
[jira] [Commented] (PIG-2870) pigServer.openIterator fails for jobs
with no input splits
[ https://issues.apache.org/jira/browse/PIG-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432881#comment-13432881 ]
Bill Graham commented on PIG-2870:
----------------------------------
FYI, this is what the exception looks like:
{noformat}
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias T2
at org.apache.pig.PigServer.openIterator(PigServer.java:836)
at xxxx.TestIndexing.testEmptySearch(TestIndexing.java:283)
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2088: Unable to get results for: file:/tmp/temp1703266029/tmp911072373:org.apache.pig.impl.io.InterStorage
at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:99)
at org.apache.pig.PigServer.openIterator(PigServer.java:818)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/tmp/temp1703266029/tmp911072373
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:231)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigFileInputFormat.listStatus(PigFileInputFormat.java:37)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:248)
at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:158)
at org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:120)
at org.apache.pig.backend.hadoop.executionengine.HJob.getResults(HJob.java:92)
{noformat}
> pigServer.openIterator fails for jobs with no input splits
> ----------------------------------------------------------
>
> Key: PIG-2870
> URL: https://issues.apache.org/jira/browse/PIG-2870
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: PIG-2870.1.patch
>
>
> Jobs that have valid input data, but 0 input splits (this is the case where indexing implemented in the {{InputFormat}} might return 0 splits for an aggressive filter) fail when {{pigServer.openIterator}} is called. This is because {{mapred.output.dir}} isn't set, so the job succeeds without creating the empty output directory. The {{ReadToEndLoader}} then fails due to the null input directory.
> It seems PIG-2578 introduced this issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira