[jira] Commented: (PIG-1001) Generate more meaningful error message when one input file does not exist

["Daniel Dai (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764979#action_12764979 ] 

Daniel Dai commented on PIG-1001:
---------------------------------

Change the error handling for map-reduce jobs. Changes are:
1. If one job complete fail (If we have only one store and that job fail), then we do not start all dependent map-reduce jobs
2. Before, we do not report error message of MR job with temporary store. It is possible that we miss the root cause of the entire script. So we instead print error message of all MR jobs we kick off. With the change of not starting dependent map-reduce jobs, hopefully only the error message of the MR job causing the problem printed out.
3. Change the way we report error message when "-F" is on. Before, we only report "fail to produce xxxx", now we print out the error message that cause the problem.

> Generate more meaningful error message when one input file does not exist
> -------------------------------------------------------------------------
>
>                 Key: PIG-1001
>                 URL: https://issues.apache.org/jira/browse/PIG-1001
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.4.0
>            Reporter: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1001-1.patch
>
>
> In the following query, if 2.txt does not exist, 
> a = load '1.txt';
> b = order a by $0;
> c = load '2.txt';
> d = order c by $0;
> e = join b by $0, d by $0;
> dump e;
> Pig throws error message "ERROR 2100: file:/tmp/temp155054664/tmp1144108421 does not exist.", Pig should deal with it with the error message "Input file 2.txt not exist" instead of those confusing messages.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.