[jira] Resolved: (PIG-1591) pig does not create a log file, if tje MR job succeeds but front end fails.

["Daniel Dai (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai resolved PIG-1591.
-----------------------------

     Hadoop Flags: [Reviewed]
    Fix Version/s: 0.8.0
       Resolution: Fixed

Patch committed to both trunk and 0.8 branch.

> pig does not create a log file, if tje MR job succeeds but front end fails.
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1591
>                 URL: https://issues.apache.org/jira/browse/PIG-1591
>             Project: Pig
>          Issue Type: Bug
>            Reporter: niraj rai
>            Assignee: niraj rai
>             Fix For: 0.8.0
>
>         Attachments: pig_1591.patch
>
>
> When I run this script:
> A = load 'limit_empty.input_a' as (a1:int);
> B = load 'limit_empty.input_b' as (b1:int);
> C =COGROUP A by a1, B by b1;
> C1 = foreach C { Alim = limit A 1; Blim = limit B 1; generate Alim, Blim; }
> D1 = FOREACH C1 generate Alim,Blim, (IsEmpty(Alim)? 0:1), (IsEmpty(Blim)? 0:1), COUNT(Alim), COUNT(Blim);
> dump D1;
> The MR job succeeds but the pig job fails with the fillowing error:
> 2010-08-31 13:33:09,960 [main] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2010-08-31 13:33:09,962 [main] INFO  org.apache.pig.impl.io.InterStorage - Pig Internal storage in use
> 2010-08-31 13:33:09,963 [main] INFO  org.apache.pig.impl.io.InterStorage - Pig Internal storage in use
> 2010-08-31 13:33:09,963 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success!
> 2010-08-31 13:33:09,964 [main] INFO  org.apache.pig.impl.io.InterStorage - Pig Internal storage in use
> 2010-08-31 13:33:09,965 [main] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2010-08-31 13:33:09,969 [main] INFO  org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
> 2010-08-31 13:33:09,969 [main] INFO  org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1
> 2010-08-31 13:33:09,973 [main] ERROR org.apache.pig.backend.hadoop.executionengine.HJob - java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple
> since MR job is succeeded, so the pig does not create any log file, but it should still create a log file, giving the cause of failure in the pig.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.