You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Yongzhi Chen (JIRA)" <ji...@apache.org> on 2018/04/25 15:15:00 UTC
[jira] [Commented] (HIVE-19296) Add log to record MapredLocalTask
Failure
[ https://issues.apache.org/jira/browse/HIVE-19296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16452446#comment-16452446 ]
Yongzhi Chen commented on HIVE-19296:
-------------------------------------
When use MapredLocal Task uses logging system defined file, but task fails before the defined file is created. The System.err has nowhere to direct. It should be helpful to let HS2 also log the error details. Attached the patch to add the log.
> Add log to record MapredLocalTask Failure
> -----------------------------------------
>
> Key: HIVE-19296
> URL: https://issues.apache.org/jira/browse/HIVE-19296
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability
> Affects Versions: 1.1.0
> Reporter: Yongzhi Chen
> Assignee: Yongzhi Chen
> Priority: Major
>
> In some cases, When MapredLocalTask fails around Child process start time, we can not find the detail error information anywhere(not in strerr log, no MapredLocal log file). All we get is :
> {noformat}
> ******************* ERROR org.apache.hadoop.hive.ql.exec.Task: [HiveServer2-Background-Pool: Thread-****]: Execution failed with exit status: 1
> ******************* ERROR org.apache.hadoop.hive.ql.exec.Task: [HiveServer2-Background-Pool: Thread-****]: Obtaining error information
> ******************* ERROR org.apache.hadoop.hive.ql.exec.Task: [HiveServer2-Background-Pool: Thread-****]:
> Task failed!
> Task ID:
> Stage-48
> Logs:
> ******************* ERROR org.apache.hadoop.hive.ql.exec.Task: [HiveServer2-Background-Pool: Thread-****]: /var/log/hive/hadoop-cmf-hive1-HIVESERVER2-t.log.out
> ******************* ERROR org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask: [HiveServer2-Background-Pool: Thread-****]: Execution failed with exit status: 1
> {noformat}
> It is really hard to debug.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)