You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2015/01/12 21:12:35 UTC

[jira] [Created] (HIVE-9351) Running Hive Jobs with Tez cause templeton to never report percent complete

Eugene Koifman created HIVE-9351:
------------------------------------

             Summary: Running Hive Jobs with Tez cause templeton to never report percent complete
                 Key: HIVE-9351
                 URL: https://issues.apache.org/jira/browse/HIVE-9351
             Project: Hive
          Issue Type: Bug
          Components: WebHCat
    Affects Versions: 0.14.0
            Reporter: Eugene Koifman
            Assignee: Eugene Koifman


Currently, when submitting Hive jobs through WebHCat and Hive is configured to use Tez, the "percentComplete" field returned by WebHCat is empty.

LaunchMapper in WebHCat parses stderr of the process that it launches to extract map = 100%,  reduce = 100%.  With Tez the content of stderr looks like 

{noformat}
  Map 1: -/-	Reducer 2: 0/1	
  Map 1: -/-	Reducer 2: 0(+1)/1	
  Map 1: -/-	Reducer 2: 1/1
{noformat}

WebHCat should handle that as well.
WebHCat will follow HIVE-8495 and report (completed tasks)/(total tasks) as a percentage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)