You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2016/10/17 05:14:58 UTC
[jira] [Updated] (SPARK-17819) Specified database in JDBC URL is
ignored when connecting to thriftserver
[ https://issues.apache.org/jira/browse/SPARK-17819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin updated SPARK-17819:
--------------------------------
Fix Version/s: 2.0.2
> Specified database in JDBC URL is ignored when connecting to thriftserver
> -------------------------------------------------------------------------
>
> Key: SPARK-17819
> URL: https://issues.apache.org/jira/browse/SPARK-17819
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.6.2, 2.0.0, 2.0.1
> Reporter: Todd Nemet
> Assignee: Dongjoon Hyun
> Fix For: 2.0.2, 2.1.0
>
>
> Filing this based on a email thread with Reynold Xin. From the [docs|http://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server], the JDBC connection URL to the thriftserver looks like:
> {code}
> beeline> !connect jdbc:hive2://<host>:<port>/<database>?hive.server2.transport.mode=http;hive.server2.thrift.http.path=<http_endpoint>
> {code}
> However, anything specified in <database> results in being put in default schema. I'm running these with -e commands, but the shell shows the same behavior.
> In 2.0.1, I created a table foo in schema spark_jira:
> {code}
> [558|18:01:20] ~/Documents/spark/spark$ bin/beeline -u jdbc:hive2://localhost:10006/spark_jira -n hive -e "show tables"
> Connecting to jdbc:hive2://localhost:10006/spark_jira
> 16/10/06 18:01:28 INFO jdbc.Utils: Supplied authorities: localhost:10006
> 16/10/06 18:01:28 INFO jdbc.Utils: Resolved authority: localhost:10006
> 16/10/06 18:01:28 INFO jdbc.HiveConnection: Will try to open client transport with JDBC Uri: jdbc:hive2://localhost:10006/spark_jira
> Connected to: Spark SQL (version 2.0.1)
> Driver: Hive JDBC (version 1.2.1.spark2)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> +------------+--------------+--+
> | tableName | isTemporary |
> +------------+--------------+--+
> +------------+--------------+--+
> No rows selected (0.558 seconds)
> Beeline version 1.2.1.spark2 by Apache Hive
> Closing: 0: jdbc:hive2://localhost:10006/spark_jira
> [559|18:01:30] ~/Documents/spark/spark$ bin/beeline -u jdbc:hive2://localhost:10006/spark_jira -n hive -e "show tables in spark_jira"
> Connecting to jdbc:hive2://localhost:10006/spark_jira
> 16/10/06 18:01:34 INFO jdbc.Utils: Supplied authorities: localhost:10006
> 16/10/06 18:01:34 INFO jdbc.Utils: Resolved authority: localhost:10006
> 16/10/06 18:01:34 INFO jdbc.HiveConnection: Will try to open client transport with JDBC Uri: jdbc:hive2://localhost:10006/spark_jira
> Connected to: Spark SQL (version 2.0.1)
> Driver: Hive JDBC (version 1.2.1.spark2)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> +------------+--------------+--+
> | tableName | isTemporary |
> +------------+--------------+--+
> | foo | false |
> +------------+--------------+--+
> 1 row selected (0.664 seconds)
> Beeline version 1.2.1.spark2 by Apache Hive
> Closing: 0: jdbc:hive2://localhost:10006/spark_jira
> {code}
> I also see this in Spark 1.6.2:
> {code}
> [555|18:13:32] ~/Documents/spark/spark16$ bin/beeline -u jdbc:hive2://localhost:10005/spark_jira -n hive -e "show tables"
> Connecting to jdbc:hive2://localhost:10005/spark_jira
> 16/10/06 18:13:37 INFO jdbc.Utils: Supplied authorities: localhost:10005
> 16/10/06 18:13:37 INFO jdbc.Utils: Resolved authority: localhost:10005
> 16/10/06 18:13:37 INFO jdbc.HiveConnection: Will try to open client transport with JDBC Uri: jdbc:hive2://localhost:10005/spark_jira
> Connected to: Spark SQL (version 1.6.2)
> Driver: Hive JDBC (version 1.2.1.spark2)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> +--------------+--------------+--+
> | tableName | isTemporary |
> +--------------+--------------+--+
> | all_types | false |
> | order_items | false |
> | orders | false |
> | users | false |
> +--------------+--------------+--+
> 4 rows selected (0.653 seconds)
> Beeline version 1.2.1.spark2 by Apache Hive
> Closing: 0: jdbc:hive2://localhost:10005/spark_jira
> [556|18:13:39] ~/Documents/spark/spark16$ bin/beeline -u jdbc:hive2://localhost:10005/spark_jira -n hive -e "show tables in spark_jira"
> Connecting to jdbc:hive2://localhost:10005/spark_jira
> 16/10/06 18:13:45 INFO jdbc.Utils: Supplied authorities: localhost:10005
> 16/10/06 18:13:45 INFO jdbc.Utils: Resolved authority: localhost:10005
> 16/10/06 18:13:45 INFO jdbc.HiveConnection: Will try to open client transport with JDBC Uri: jdbc:hive2://localhost:10005/spark_jira
> Connected to: Spark SQL (version 1.6.2)
> Driver: Hive JDBC (version 1.2.1.spark2)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> +------------+--------------+--+
> | tableName | isTemporary |
> +------------+--------------+--+
> | foo | false |
> +------------+--------------+--+
> 1 row selected (0.633 seconds)
> Beeline version 1.2.1.spark2 by Apache Hive
> Closing: 0: jdbc:hive2://localhost:10005/spark_jira
> {code}
> This appeared to work back in Spark 1.4.1:
> {code}
> [560|18:17:19] ~/Documents/spark/spark14$ bin/beeline -u jdbc:hive2://localhost:11001/imdb -n hive -e "show tables"
> scan complete in 2ms
> Connecting to jdbc:hive2://localhost:11001/imdb
> Connected to: Spark SQL (version 1.4.1)
> Driver: Spark Project Core (version 1.4.1)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> +------------------+--------------+
> | tableName | isTemporary |
> +------------------+--------------+
> | aka_name | false |
> | aka_title | false |
> | cast_info | false |
> | char_name | false |
> | company_name | false |
> | complete_cast | false |
> | foo | false |
> | keyword | false |
> | movie_companies | false |
> | movie_info | false |
> | movie_keyword | false |
> | movie_link | false |
> | name | false |
> | person_info | false |
> | title | false |
> +------------------+--------------+
> 15 rows selected (0.519 seconds)
> Beeline version 1.4.1 by Apache Hive
> Closing: 0: jdbc:hive2://localhost:11001/imdb
> [561|18:17:36] ~/Documents/spark/spark14$ bin/beeline -u jdbc:hive2://localhost:11001/imdb -n hive -e "show tables in imdb"
> scan complete in 1ms
> Connecting to jdbc:hive2://localhost:11001/imdb
> Connected to: Spark SQL (version 1.4.1)
> Driver: Spark Project Core (version 1.4.1)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> +------------------+--------------+
> | tableName | isTemporary |
> +------------------+--------------+
> | aka_name | false |
> | aka_title | false |
> | cast_info | false |
> | char_name | false |
> | company_name | false |
> | complete_cast | false |
> | foo | false |
> | keyword | false |
> | movie_companies | false |
> | movie_info | false |
> | movie_keyword | false |
> | movie_link | false |
> | name | false |
> | person_info | false |
> | title | false |
> +------------------+--------------+
> 15 rows selected (0.509 seconds)
> Beeline version 1.4.1 by Apache Hive
> Closing: 0: jdbc:hive2://localhost:11001/imdb
> [562|18:17:43] ~/Documents/spark/spark14$ bin/beeline -u jdbc:hive2://localhost:11001/imdb -n hive -e "show tables in default"
> scan complete in 2ms
> Connecting to jdbc:hive2://localhost:11001/imdb
> Connected to: Spark SQL (version 1.4.1)
> Driver: Spark Project Core (version 1.4.1)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> +------------+--------------+
> | tableName | isTemporary |
> +------------+--------------+
> | foo | false |
> +------------+--------------+
> 1 row selected (0.511 seconds)
> Beeline version 1.4.1 by Apache Hive
> Closing: 0: jdbc:hive2://localhost:11001/imdb
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org