You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "karthik G S (JIRA)" <ji...@apache.org> on 2016/12/28 11:23:58 UTC

[jira] [Comment Edited] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

    [ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782669#comment-15782669 ] 

karthik G S  edited comment on SPARK-9686 at 12/28/16 11:23 AM:
----------------------------------------------------------------

hi [~lian cheng]
Im facing the similar issue with spark 1.6.1 in Mapr, i've enable the hive.metastore.uris(.setConf("hive.metastore.uris","thrift://####:9083") in my spark application.But it is still failing to connect with the hive metastore what so ever. I have placed the derby jar in to my classpath(copied the exact derby jar from hive lib).
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.derby.jdbc.EmbeddedDriver

Just found out that spark assembly jar and derby jar in hive/lib have same class(org.apache.derby.jdbc.EmbeddedDriver). So this is lead in ambiguity, and can leading to noclassdeffound error, now i have to remove the jar from derby or the other, and check the logs again.


Any fix on this issue? 


was (Author: karthikgs):
hi [~lian cheng]
Im facing the similar issue with spark 1.6.1, i've enable the hive.metastore.uris(.setConf("hive.metastore.uris","thrift://####:9083") in my spark application.But it is still failing to connect with the hive metastore what so ever. I have placed the derby jar in to my classpath(copied the exact derby jar from hive lib).
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.derby.jdbc.EmbeddedDriver

Any fix on this issue? 

> Spark Thrift server doesn't return correct JDBC metadata 
> ---------------------------------------------------------
>
>                 Key: SPARK-9686
>                 URL: https://issues.apache.org/jira/browse/SPARK-9686
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.4.0, 1.4.1, 1.5.0, 1.5.1, 1.5.2
>            Reporter: pin_zhang
>            Assignee: Cheng Lian
>            Priority: Critical
>         Attachments: SPARK-9686.1.patch.txt
>
>
> 1. Start  start-thriftserver.sh
> 2. connect with beeline
> 3. create table
> 4.show tables, the new created table returned
> 5.
> 	Class.forName("org.apache.hive.jdbc.HiveDriver");
> 	String URL = "jdbc:hive2://localhost:10000/default";
> 	 Properties info = new Properties();
>         Connection conn = DriverManager.getConnection(URL, info);
> 	ResultSet tables = conn.getMetaData().getTables(conn.getCatalog(),
> 		 null, null, null);
> Problem:
>            No tables with returned this API, that work in spark1.3



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org