回复： spark Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

[鹰 <98...@qq.com>]

thanks  jeanlyn itworks




------------------ 原始邮件 ------------------
发件人: "jeanlyn";<ou...@jd.com>;
发送时间: 2015年5月5日(星期二) 下午3:40
收件人: "鹰"<98...@qq.com>; 
抄送: "Wang, Daoyuan"<da...@intel.com>; "user"<us...@spark.apache.org>; 
主题: Re: spark Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient



Have you config the SPARK_CLASSPATH with the jar of mysql in spark-env.sh?For example (export SPARK_CLASSPATH+=:/path/to/mysql-connector-java-5.1.18-bin.jar)
在 2015年5月5日，下午3:32，鹰 <98...@qq.com> 写道：

my metastore is like this  
 <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mysql://192.168.1.40:3306/hive</value>
    </property>
    
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.jdbc.Driver</value>
        <description>Driver class name for a JDBC metastore</description>
    </property>

    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>hive</value>
    </property> 

    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>hive123!@#</value>
    </property>

    <property>
        <name>hive.metastore.warehouse.dir</name>                                                                                                    
        <value>/user/${user.name}/hive-warehouse</value>
        <description>location of default database for the warehouse</description>
    </property>





------------------ 原始邮件 ------------------
发件人: "Wang, Daoyuan";<da...@intel.com>;
发送时间: 2015年5月5日(星期二) 下午3:22
收件人: "鹰"<98...@qq.com>; "luohui20001"<lu...@sina.com>; 
抄送: "user"<us...@spark.apache.org>; 
主题: RE: 回复：spark Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient




How did you configure your metastore?

 

Thanks,

Daoyuan

 

From: 鹰 [mailto:980548079@qq.com] 
Sent: Tuesday, May 05, 2015 3:11 PM
To: luohui20001
Cc: user
Subject: 回复：spark Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

 

hi luo,
thanks for your reply in fact I can use hive by spark on my  spark master machine, but when I copy my spark files to another machine  and when I want to access the hive by spark get the error "Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient" , I have copy hive-site.xml to spark conf directory and I have the authenticated to access hive metastore warehouse;

 


Thanks , Best regards!


------------------ 原始邮件 ------------------


发件人: "luohui20001";<lu...@sina.com>;


发送时间: 2015年5月5日(星期二) 上午9:56


收件人: "鹰"<98...@qq.com>; "user"<us...@spark.apache.org>; 


主题: 回复：spark Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient



 


you may need to copy hive-site.xml to your spark conf directory and check your hive metastore warehouse setting, and also check if you are authenticated to access hive metastore warehouse.



--------------------------------


 


Thanks&amp;Best regards!
罗辉 San.Luo


 

----- 原始邮件 -----
发件人："鹰" <98...@qq.com>
收件人："user" <us...@spark.apache.org>
主题：spark Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
日期：2015年05月05日 08点49分



hi all,
       when i use submit a spark-sql programe to select data from my hive database I get an error like this:
User class threw exception: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient ,what's wrong with my spark configure ,thank any help !