You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Kevin Verhoeven <Ke...@ds-iq.com> on 2016/07/25 23:30:10 UTC
Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class
java.lang.ClassNotFoundException
I built Zeppelin 0.6.0 against CDH 5.7.1 using the following command:
sudo mvn clean package -Pspark-1.6 -Dhadoop.version=2.6.0-cdh5.7.1 -Phadoop-2.6 -Pvendor-repo –DskipTests
Zeppelin started successfully. I then created an Interpreter for Hive using the Jdbc Interpreter. I created a new Notebook, bound to the Hive Interpreter, and ran a Paragraph. The Hive query failed with the following error message:
org.apache.hive.jdbc.HiveDriver
class java.lang.ClassNotFoundException
java.net.URLClassLoader.findClass(URLClassLoader.java:381)
java.lang.ClassLoader.loadClass(ClassLoader.java:424)
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
java.lang.ClassLoader.loadClass(ClassLoader.java:357)
java.lang.Class.forName0(Native Method)
java.lang.Class.forName(Class.java:264)
org.apache.zeppelin.jdbc.JDBCInterpreter.getConnection(JDBCInterpreter.java:224)
org.apache.zeppelin.jdbc.JDBCInterpreter.getStatement(JDBCInterpreter.java:237)
org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:306)
org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:412)
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
org.apache.zeppelin.scheduler.Job.run(Job.java:176)
org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:745)
The command I ran is very simple:
%hive
show databases
Do you have any recommendations?
Regards,
Kevin
RE: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class
java.lang.ClassNotFoundException
Posted by Kevin Verhoeven <Ke...@ds-iq.com>.
That worked successfully, thanks for the quick response!
Kevin
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Monday, July 25, 2016 4:35 PM
To: users@zeppelin.apache.org
Subject: Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException
You need to specfiy the following 2 dependencies, see the doc here http://zeppelin.apache.org/docs/0.6.0/interpreter/hive.html
org.apache.hive:hive-jdbc:0.14.0
org.apache.hadoop:hadoop-common:2.6.0
On Tue, Jul 26, 2016 at 7:30 AM, Kevin Verhoeven <Ke...@ds-iq.com>> wrote:
I built Zeppelin 0.6.0 against CDH 5.7.1 using the following command:
sudo mvn clean package -Pspark-1.6 -Dhadoop.version=2.6.0-cdh5.7.1 -Phadoop-2.6 -Pvendor-repo –DskipTests
Zeppelin started successfully. I then created an Interpreter for Hive using the Jdbc Interpreter. I created a new Notebook, bound to the Hive Interpreter, and ran a Paragraph. The Hive query failed with the following error message:
org.apache.hive.jdbc.HiveDriver
class java.lang.ClassNotFoundException
java.net.URLClassLoader.findClass(URLClassLoader.java:381)
java.lang.ClassLoader.loadClass(ClassLoader.java:424)
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
java.lang.ClassLoader.loadClass(ClassLoader.java:357)
java.lang.Class.forName0(Native Method)
java.lang.Class.forName(Class.java:264)
org.apache.zeppelin.jdbc.JDBCInterpreter.getConnection(JDBCInterpreter.java:224)
org.apache.zeppelin.jdbc.JDBCInterpreter.getStatement(JDBCInterpreter.java:237)
org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:306)
org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:412)
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
org.apache.zeppelin.scheduler.Job.run(Job.java:176)
org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:745)
The command I ran is very simple:
%hive
show databases
Do you have any recommendations?
Regards,
Kevin
--
Best Regards
Jeff Zhang
Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException
Posted by Hyung Sung Shim <hs...@nflabs.com>.
If you want to use JDBC interpreter with your hive server,
You should know hive server IP or host and port.
then put the value of hive.url like as jdbc:hive2://[YOUR HIVESERVER
IP]:[PORT]
Hope this helps.
2016-12-19 20:26 GMT+09:00 Nabajyoti Dash <na...@rakuten.com>:
> How to confirm that?
> While I am doing /usr/bin/lsof -i it's not showing 10000 port.
>
> my questions are silly I know.But I am new to hbase/hive/zeppelin.Plz
> suggest.
>
>
>
>
>
> --
> View this message in context: http://apache-zeppelin-users-
> incubating-mailing-list.75479.x6.nabble.com/Cannot-use-Hive-
> Interpreter-in-Zeppelin-0-6-0-Hive-class-java-lang-ClassNotFoundException-
> tp3635p4767.html
> Sent from the Apache Zeppelin Users (incubating) mailing list mailing list
> archive at Nabble.com.
>
Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class
java.lang.ClassNotFoundException
Posted by Nabajyoti Dash <na...@rakuten.com>.
How to confirm that?
While I am doing /usr/bin/lsof -i it's not showing 10000 port.
my questions are silly I know.But I am new to hbase/hive/zeppelin.Plz
suggest.
--
View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Cannot-use-Hive-Interpreter-in-Zeppelin-0-6-0-Hive-class-java-lang-ClassNotFoundException-tp3635p4767.html
Sent from the Apache Zeppelin Users (incubating) mailing list mailing list archive at Nabble.com.
Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException
Posted by Hyung Sung Shim <hs...@nflabs.com>.
Please make sure that your hive server is running on localhost:10000 .
2016년 12월 19일 (월) 오후 7:56, Nabajyoti Dash <na...@rakuten.com>님이 작성:
> Thanks.It was a typo..(my nightmare).
> But after fixing this I am getting the ConnectionRefused exception.I am
> using Hive on mysql and has given the mysql username /password in zeppelin
> jdbc interpreter. Am I wrong?
>
> java.sql.SQLException: Could not open client transport with JDBC Uri:
> jdbc:hive2://localhost:10000: java.net.ConnectException: Connection refused
> (Connection refused)
> at
> org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:231)
> at
> org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:176)
> at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
> at java.sql.DriverManager.getConnection(DriverManager.java:664)
> at java.sql.DriverManager.getConnection(DriverManager.java:208)
> at
>
> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:79)
> at
>
> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:205)
> at
>
> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
> at
>
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
> at
>
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
> at
> org.apache.commons.dbcp2.PoolingDriver.connect(PoolingDriver.java:129)
> at java.sql.DriverManager.getConnection(DriverManager.java:664)
> at java.sql.DriverManager.getConnection(DriverManager.java:270)
> at
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.getConnectionFromPool(JDBCInterpreter.java:322)
> at
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.getConnection(JDBCInterpreter.java:340)
> at
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:401)
> at
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:526)
> at
>
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
> at
>
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:489)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
> at
>
> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException:
> java.net.ConnectException: Connection refused (Connection refused)
> at org.apache.thrift.transport.TSocket.open(TSocket.java:187)
> at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
> at
>
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> at
> org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204)
> ... 27 more
> Caused by: java.net.ConnectException: Connection refused (Connection
> refused)
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at
> java.net
> .AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
> at
> java.net
> .AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:589)
> at org.apache.thrift.transport.TSocket.open(TSocket.java:182)
> ... 30 more
>
>
>
>
>
> --
> View this message in context:
> http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Cannot-use-Hive-Interpreter-in-Zeppelin-0-6-0-Hive-class-java-lang-ClassNotFoundException-tp3635p4765.html
> Sent from the Apache Zeppelin Users (incubating) mailing list mailing list
> archive at Nabble.com.
>
Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class
java.lang.ClassNotFoundException
Posted by Nabajyoti Dash <na...@rakuten.com>.
Thanks.It was a typo..(my nightmare).
But after fixing this I am getting the ConnectionRefused exception.I am
using Hive on mysql and has given the mysql username /password in zeppelin
jdbc interpreter. Am I wrong?
java.sql.SQLException: Could not open client transport with JDBC Uri:
jdbc:hive2://localhost:10000: java.net.ConnectException: Connection refused
(Connection refused)
at
org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:231)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:176)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at
org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:79)
at
org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:205)
at
org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.commons.dbcp2.PoolingDriver.connect(PoolingDriver.java:129)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.getConnectionFromPool(JDBCInterpreter.java:322)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.getConnection(JDBCInterpreter.java:340)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:401)
at
org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:526)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:489)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at
org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException:
java.net.ConnectException: Connection refused (Connection refused)
at org.apache.thrift.transport.TSocket.open(TSocket.java:187)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
at
org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at
org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204)
... 27 more
Caused by: java.net.ConnectException: Connection refused (Connection
refused)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.apache.thrift.transport.TSocket.open(TSocket.java:182)
... 30 more
--
View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Cannot-use-Hive-Interpreter-in-Zeppelin-0-6-0-Hive-class-java-lang-ClassNotFoundException-tp3635p4765.html
Sent from the Apache Zeppelin Users (incubating) mailing list mailing list archive at Nabble.com.
Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException
Posted by Hyung Sung Shim <hs...@nflabs.com>.
Hi.
It seems there is typo on default.driver.
default.driver value should be org.apache.hive.jdbc.HiveDriver not *c*
org.apache.hive.jdbc.HiveDriver.
2016-12-19 18:24 GMT+09:00 Nabajyoti Dash <na...@rakuten.com>:
> I am facing the same issue even after adding both the jars to the
> interpreter.
> please suggest anything else i could be me missing.
> <http://apache-zeppelin-users-incubating-mailing-list.75479.
> x6.nabble.com/file/n4758/Screen_Shot_2016-12-19_at_2.png>
>
>
>
> --
> View this message in context: http://apache-zeppelin-users-
> incubating-mailing-list.75479.x6.nabble.com/Cannot-use-Hive-
> Interpreter-in-Zeppelin-0-6-0-Hive-class-java-lang-ClassNotFoundException-
> tp3635p4758.html
> Sent from the Apache Zeppelin Users (incubating) mailing list mailing list
> archive at Nabble.com.
>
Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class
java.lang.ClassNotFoundException
Posted by Nabajyoti Dash <na...@rakuten.com>.
I am facing the same issue even after adding both the jars to the
interpreter.
please suggest anything else i could be me missing.
<http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/file/n4758/Screen_Shot_2016-12-19_at_2.png>
--
View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Cannot-use-Hive-Interpreter-in-Zeppelin-0-6-0-Hive-class-java-lang-ClassNotFoundException-tp3635p4758.html
Sent from the Apache Zeppelin Users (incubating) mailing list mailing list archive at Nabble.com.
Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException
Posted by Jeff Zhang <zj...@gmail.com>.
You need to specfiy the following 2 dependencies, see the doc here
http://zeppelin.apache.org/docs/0.6.0/interpreter/hive.html
org.apache.hive:hive-jdbc:0.14.0
org.apache.hadoop:hadoop-common:2.6.0
On Tue, Jul 26, 2016 at 7:30 AM, Kevin Verhoeven <Ke...@ds-iq.com>
wrote:
> I built Zeppelin 0.6.0 against CDH 5.7.1 using the following command:
>
>
>
> sudo mvn clean package -Pspark-1.6 -Dhadoop.version=2.6.0-cdh5.7.1
> -Phadoop-2.6 -Pvendor-repo –DskipTests
>
>
>
> Zeppelin started successfully. I then created an Interpreter for Hive
> using the Jdbc Interpreter. I created a new Notebook, bound to the Hive
> Interpreter, and ran a Paragraph. The Hive query failed with the following
> error message:
>
>
>
> org.apache.hive.jdbc.HiveDriver
>
> class java.lang.ClassNotFoundException
>
> java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>
> java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>
> java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>
> java.lang.Class.forName0(Native Method)
>
> java.lang.Class.forName(Class.java:264)
>
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.getConnection(JDBCInterpreter.java:224)
>
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.getStatement(JDBCInterpreter.java:237)
>
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:306)
>
>
> org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:412)
>
>
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
>
>
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
>
> org.apache.zeppelin.scheduler.Job.run(Job.java:176)
>
>
> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
>
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
>
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>
>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> java.lang.Thread.run(Thread.java:745)
>
>
>
> The command I ran is very simple:
>
>
>
> %hive
>
> show databases
>
>
>
> Do you have any recommendations?
>
>
>
> Regards,
>
>
>
> Kevin
>
--
Best Regards
Jeff Zhang