You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Thejas M Nair (JIRA)" <ji...@apache.org> on 2015/01/12 21:34:35 UTC
[jira] [Commented] (HIVE-9351) Running Hive Jobs with Tez cause
templeton to never report percent complete
[ https://issues.apache.org/jira/browse/HIVE-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274126#comment-14274126 ]
Thejas M Nair commented on HIVE-9351:
-------------------------------------
+1
> Running Hive Jobs with Tez cause templeton to never report percent complete
> ---------------------------------------------------------------------------
>
> Key: HIVE-9351
> URL: https://issues.apache.org/jira/browse/HIVE-9351
> Project: Hive
> Issue Type: Bug
> Components: WebHCat
> Affects Versions: 0.14.0
> Reporter: Eugene Koifman
> Assignee: Eugene Koifman
> Attachments: HIVE-9351.patch
>
>
> Currently, when submitting Hive jobs through WebHCat and Hive is configured to use Tez, the "percentComplete" field returned by WebHCat is empty.
> LaunchMapper in WebHCat parses stderr of the process that it launches to extract map = 100%, reduce = 100% for Map/Reduce case. With Tez the content of stderr looks like
> {noformat}
> Map 1: -/- Reducer 2: 0/1
> Map 1: -/- Reducer 2: 0(+1)/1
> Map 1: -/- Reducer 2: 1/1
> {noformat}
> WebHCat should handle that as well.
> WebHCat will follow HIVE-8495 and report (completed tasks)/(total tasks) as a percentage.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)