[jira] [Commented] (HIVE-17078) Add more logs to MapredLocalTask

["Hive QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-17078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189833#comment-16189833 ] 

Hive QA commented on HIVE-17078:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12890146/HIVE-17078.6.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 11 failed/errored test(s), 11193 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_predicate_pushdown] (batchId=232)
org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_single_sourced_multi_insert] (batchId=232)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[skewjoin_union_remove_1] (batchId=83)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[optimize_nullscan] (batchId=162)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=157)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_explainuser_1] (batchId=171)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_2] (batchId=101)
org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[query14] (batchId=240)
org.apache.hadoop.hive.cli.TestTezPerfCliDriver.testCliDriver[query23] (batchId=240)
org.apache.hadoop.hive.cli.control.TestDanglingQOuts.checkDanglingQOut (batchId=203)
org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testWriteSetTracking1 (batchId=284)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/7092/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/7092/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-7092/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 11 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12890146 - PreCommit-HIVE-Build

> Add more logs to MapredLocalTask
> --------------------------------
>
>                 Key: HIVE-17078
>                 URL: https://issues.apache.org/jira/browse/HIVE-17078
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yibing Shi
>            Assignee: Yibing Shi
>            Priority: Minor
>         Attachments: HIVE-17078.1.patch, HIVE-17078.2.patch, HIVE-17078.3.patch, HIVE-17078.4.PATCH, HIVE-17078.5.PATCH, HIVE-17078.6.patch
>
>
> By default, {{MapredLocalTask}} is executed in a child process of Hive, in case the local task uses too much resources that may affect Hive. Currently, the stdout and stderr information of the child process is printed in Hive's stdout/stderr log, which doesn't have a timestamp information, and is separated from Hive service logs. This makes it hard to troubleshoot problems in MapredLocalTasks.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)