You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Thomas Scott (JIRA)" <ji...@apache.org> on 2016/06/29 13:27:57 UTC

[jira] [Created] (HIVE-14124) Spark app name should be in line with MapReduce app name when using Hive On Spark

Thomas Scott created HIVE-14124:
-----------------------------------

             Summary: Spark app name should be in line with MapReduce app name when using Hive On Spark
                 Key: HIVE-14124
                 URL: https://issues.apache.org/jira/browse/HIVE-14124
             Project: Hive
          Issue Type: Improvement
          Components: Spark
    Affects Versions: 1.1.0
            Reporter: Thomas Scott
            Priority: Minor


When using the spark execution engine the jobs submitted to YARN are submitted with name "Hive On Spark" whereas in mr  execution engine the name contains the query executed. This is overrideable via spark.app.name but it should automatically fill out the query executed in line with the mr engine.

Example:

set hive.execution.engine=spark;
Select count(*) from sometable; 
 
-> Launched YARN Job description: Hive On Spark

set hive.execution.engine=mr;
Select count(*) from sometable; 
 
-> Launched YARN Job description: Select count(*) from sometable





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)