You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2017/03/28 21:28:41 UTC
[jira] [Updated] (PIG-4677) Display failure information on stop on
failure
[ https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-4677:
------------------------------------
Attachment: PIG-4677-5.patch
With the attached patch, it display job stats when stop on failure is set as below in mapreduce.
{code}
2017-03-28 14:15:04,580 [main] ERROR org.apache.pig.tools.pigstats.PigStats - ERROR 0: org.apache.pig.backend.executionengine.ExecException: ERROR 2055: Received Error while processing the map plan: 'false (stdin-org.apache.pig.builtin.PigStreaming/stdout-org.apache.pig.builtin.PigStreaming)' failed with exit status: 1
2017-03-28 14:15:04,580 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 2 map reduce job(s) failed!
2017-03-28 14:15:04,580 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
2.7.3 0.17.0-SNAPSHOT rohinip 2017-03-28 14:14:41 2017-03-28 14:15:04 STREAMING
Failed!
Failed Jobs:
JobId Alias Feature Message Outputs
job_1490735309298_0017 A,B STREAMING,MAP_ONLY Message: Job failed! hdfs://localhost:56480/bar,
job_1490735309298_0018 A1 MAP_ONLY Message: Failing running job for -stop_on_failure: job_1490735309298_0018 hdfs://localhost:56480/bar1,
Input(s):
Output(s):
Failed to produce result in "hdfs://localhost:56480/bar"
Failed to produce result in "hdfs://localhost:56480/bar1"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_1490735309298_0017 -> null,
null
job_1490735309298_0018
{code}
> Display failure information on stop on failure
> ----------------------------------------------
>
> Key: PIG-4677
> URL: https://issues.apache.org/jira/browse/PIG-4677
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11.1
> Reporter: Mit Desai
> Assignee: Mit Desai
> Attachments: PIG-4677.2.patch, PIG-4677.3.patch, PIG-4677.4.patch, PIG-4677-5.patch, PIG-4677.patch
>
>
> When stop on failure option is specified, pig abruptly exits without displaying any job stats or failed job information which it usually does in case of failures.
> {code}
> 2015-06-04 20:35:38,170 [uber-SubtaskRunner] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 9% complete
> 2015-06-04 20:35:38,171 [uber-SubtaskRunner] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Running jobs are [job_1428329756093_3741748,job_1428329756093_3741752,job_1428329756093_3741753,job_1428329756093_3741754,job_1428329756093_3741756]
> 2015-06-04 20:35:40,201 [uber-SubtaskRunner] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 6017: Job failed!
> Hadoop Job IDs executed by Pig: job_1428329756093_3739816,job_1428329756093_3741752,job_1428329756093_3739814,job_1428329756093_3741748,job_1428329756093_3741756,job_1428329756093_3741753,job_1428329756093_3741754
> <<< Invocation of Main class completed <<<
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)