You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Sahil Takiar (JIRA)" <ji...@apache.org> on 2018/05/29 17:33:00 UTC

[jira] [Created] (HIVE-19733) RemoteSparkJobStatus#getSparkStageProgress inefficient implementation

Sahil Takiar created HIVE-19733:
-----------------------------------

             Summary: RemoteSparkJobStatus#getSparkStageProgress inefficient implementation
                 Key: HIVE-19733
                 URL: https://issues.apache.org/jira/browse/HIVE-19733
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Sahil Takiar


The implementation of {{RemoteSparkJobStatus#getSparkStageProgress}} is a bit inefficient. There is one RPC call to get the {{SparkJobInfo}} and then for every stage there is another RPC call to get each {{SparkStageInfo}}. This could all be done in a single RPC call.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)