You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2015/05/22 02:19:17 UTC
[jira] [Resolved] (SPARK-6387) HTTP mode of HiveThriftServer2
doesn't work when built with Hive 0.12.0
[ https://issues.apache.org/jira/browse/SPARK-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Armbrust resolved SPARK-6387.
-------------------------------------
Resolution: Won't Fix
We aren't building with Hive 12 anymore.
> HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0
> -----------------------------------------------------------------------
>
> Key: SPARK-6387
> URL: https://issues.apache.org/jira/browse/SPARK-6387
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 1.2.1, 1.3.0
> Reporter: Cheng Lian
>
> Reproduction steps:
> # Compile Spark against Hive 0.12.0
> {noformat}$ ./build/sbt -Pyarn,hadoop-2.4,hive,hive-thriftserver,hive-0.12.0,scala-2.10 -Dhadoop.version=2.4.1 clean assembly/assembly{noformat}
> # Start the Thrift server in HTTP mode
> Add the following stanza in {{hive-site.xml}}:
> {noformat}<property>
> <name>hive.server2.transport.mode</name>
> <value>http</value>
> </property>{noformat}
> and
> {noformat}$ ./bin/start-thriftserver.sh{noformat}
> # Connect to the Thrift server via Beeline
> {noformat}$ ./bin/beeline -u "jdbc:hive2://localhost:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice"{noformat}
> # Execute any query and check the server log
> We can see that no query execution related logs are output.
> The reason is that, when running under HTTP mode, although we pass in a {{SparkSQLCLIService}} instance ([here|https://github.com/apache/spark/blob/master/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala#L102]) to {{ThriftHttpCLIService}}, Hive 0.12.0 just ignores it, and instantiate a new {{CLIService}} ([here|https://github.com/apache/hive/blob/release-0.12.0/service/src/java/org/apache/hive/service/cli/thrift/ThriftHttpCLIService.java#L91-L92] and [here|https://github.com/apache/hive/blob/release-0.12.0/service/src/java/org/apache/hive/service/cli/thrift/EmbeddedThriftBinaryCLIService.java#L32]).
> Notice that while compiling against Hive 0.13.1, Spark SQL doesn't suffer from this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org