You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2017/02/05 05:54:41 UTC

[jira] [Commented] (HIVE-15815) Allow to pass some Oozie properties to Spark in HoS

    [ https://issues.apache.org/jira/browse/HIVE-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853125#comment-15853125 ] 

Xuefu Zhang commented on HIVE-15815:
------------------------------------

+1. I assume that spark.hadoop.oozie properties will be interpreted correctly by Spark.

> Allow to pass some Oozie properties to Spark in HoS
> ---------------------------------------------------
>
>                 Key: HIVE-15815
>                 URL: https://issues.apache.org/jira/browse/HIVE-15815
>             Project: Hive
>          Issue Type: Improvement
>          Components: Diagnosability, Spark
>            Reporter: Chaoyu Tang
>            Assignee: Chaoyu Tang
>            Priority: Minor
>         Attachments: HIVE-15815.patch
>
>
> Oozie passes some of its properties (e.g. oozie.job.id) to Beeline/HS2 when it invokes Hive2 action. If we allow these properties to be passed to Spark in HoS, we can easily associate an Ooize workflow ID to an HoS client and Spark job in Spark history. It will be very helpful in diagnosing some issues involving Oozie Hive2/HoS/Spark.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)