[jira] [Updated] (HIVE-19894) remote spark driver can use ip to connect Hive Client

["Song Jun (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-19894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Song Jun updated HIVE-19894:
----------------------------
    Attachment: HIVE-19894.1.patch

> remote spark driver can use ip to connect Hive Client
> -----------------------------------------------------
>
>                 Key: HIVE-19894
>                 URL: https://issues.apache.org/jira/browse/HIVE-19894
>             Project: Hive
>          Issue Type: Improvement
>          Components: Spark
>            Reporter: Song Jun
>            Priority: Minor
>         Attachments: HIVE-19894.1.patch
>
>
> There is no DNS in some real cluster network.
> When we create a HiveClient in a Gateway machine, and submit a sql for HiveonSpark, then
> 1. the HiveClient will spark-submit a RemoteDriver class to YARN cluster, with args --remote-host which value is the Gateway hostname
> 2. the RemoteDriver which run on one slave of the YARN cluster, and it will connect to Gateway use the value of arg(--remote-host)
> 3. if the slave do not resolve the Gateway hostname(no DNS)，it will connect failed
> So, we can use ip of the Gateway for the  --remote-host , and the slave can use ip to connect Hive Client on the Gateway



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)