You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Thomas Scott (JIRA)" <ji...@apache.org> on 2016/06/29 13:27:57 UTC
[jira] [Created] (HIVE-14124) Spark app name should be in line with
MapReduce app name when using Hive On Spark
Thomas Scott created HIVE-14124:
-----------------------------------
Summary: Spark app name should be in line with MapReduce app name when using Hive On Spark
Key: HIVE-14124
URL: https://issues.apache.org/jira/browse/HIVE-14124
Project: Hive
Issue Type: Improvement
Components: Spark
Affects Versions: 1.1.0
Reporter: Thomas Scott
Priority: Minor
When using the spark execution engine the jobs submitted to YARN are submitted with name "Hive On Spark" whereas in mr execution engine the name contains the query executed. This is overrideable via spark.app.name but it should automatically fill out the query executed in line with the mr engine.
Example:
set hive.execution.engine=spark;
Select count(*) from sometable;
-> Launched YARN Job description: Hive On Spark
set hive.execution.engine=mr;
Select count(*) from sometable;
-> Launched YARN Job description: Select count(*) from sometable
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)