[jira] [Commented] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

["Teng Qiu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256142#comment-15256142 ] 

Teng Qiu commented on SPARK-13768:
----------------------------------

perhaps it is a beeline issue, we used the beeline from official hive 1.2 package, --hiveconf and --hivevar worked with spark 1.5.x, since spark 1.6, the thriftserver implementation changed, therefore we got the issue described in SPARK-13983, the official beeline do not work either...

> Set hive conf failed use --hiveconf when beeline connect to thriftserver
> ------------------------------------------------------------------------
>
>                 Key: SPARK-13768
>                 URL: https://issues.apache.org/jira/browse/SPARK-13768
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.5.1
>            Reporter: Weizhong
>            Priority: Minor
>
> 1. Start thriftserver
> 2. ./bin/beeline -u '...' --hiveconf hive.exec.max.dynamic.partitions=10000
> 3. set hive.exec.max.dynamic.partitions;  --  return is default value 1000, not 10000
> May be we can pass conf to context when open session
> {code:java}
> override def openSession(...): SessionHandle = {
>   ...
>   if (sessionConf != null) {
>     import scala.collection.JavaConversions._
>     for ((k, v) <- sessionConf) {
>       if (k.startsWith("set:hiveconf:")) {
>         val setK = k.split("set:hiveconf:")(1)
>         ctx.setConf(setK, v)
>       }
>     }
>   }
>   ctx.setConf("spark.sql.hive.version", HiveContext.hiveExecutionVersion)
>   ...
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org