You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Abhi Basu <90...@gmail.com> on 2016/02/09 22:33:23 UTC
Hive interpreter error - HiveInterpreter.getConnection
Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
Getting this error using the hive interpreter, doing a count(*) or create
of table.
Show tables -- works fine.
java.lang.NullPointerException at
org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
at
org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
at
org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
at
org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
at
org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
at org.apache.zeppelin.scheduler.Job.run(Job.java:169) at
org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Thanks,
Abhi
--
Abhi Basu
Re: Hive interpreter error - HiveInterpreter.getConnection
Posted by Abhi Basu <90...@gmail.com>.
Yes using %hive (default) works. Is there a way to set that in the
interpreter setting so as not to have to enter it for every SQL statement?
On Tue, Feb 9, 2016 at 3:14 PM, Victor Manuel Garcia <
victor.garcia@beeva.com> wrote:
> One option it use on this way %hive (default)
> El 9/2/2016 23:51, "Abhi Basu" <90...@gmail.com> escribió:
>
>> Ok, so this bug is in the current 0.56 binary? Is the binary going to be
>> regenerated or do I need to build from source?
>>
>> Thanks,
>>
>> Abhi
>>
>> On Tue, Feb 9, 2016 at 2:31 PM, Victor Manuel Garcia <
>> victor.garcia@beeva.com> wrote:
>>
>>> Hi, Abhi
>>> This is a bug...you can test in PR #668
>>>
>>> Cheers
>>> El 9/2/2016 23:09, "Abhi Basu" <90...@gmail.com> escribió:
>>>
>>>> Added note: Zeppelin was built from binary and all configs done as
>>>> stated on site.
>>>>
>>>> On Tue, Feb 9, 2016 at 1:33 PM, Abhi Basu <90...@gmail.com> wrote:
>>>>
>>>>> Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
>>>>>
>>>>> Getting this error using the hive interpreter, doing a count(*) or
>>>>> create of table.
>>>>>
>>>>> Show tables -- works fine.
>>>>>
>>>>>
>>>>> java.lang.NullPointerException at
>>>>> org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
>>>>> at
>>>>> org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
>>>>> at
>>>>> org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
>>>>> at
>>>>> org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
>>>>> at
>>>>> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
>>>>> at
>>>>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
>>>>> at
>>>>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
>>>>> at org.apache.zeppelin.scheduler.Job.run(Job.java:169) at
>>>>> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
>>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>>>>> at
>>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>>>>> at
>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>>> at
>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Abhi
>>>>>
>>>>> --
>>>>> Abhi Basu
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Abhi Basu
>>>>
>>>
>>
>>
>> --
>> Abhi Basu
>>
>
--
Abhi Basu
Re: Hive interpreter error - HiveInterpreter.getConnection
Posted by Victor Manuel Garcia <vi...@beeva.com>.
One option it use on this way %hive (default)
El 9/2/2016 23:51, "Abhi Basu" <90...@gmail.com> escribió:
> Ok, so this bug is in the current 0.56 binary? Is the binary going to be
> regenerated or do I need to build from source?
>
> Thanks,
>
> Abhi
>
> On Tue, Feb 9, 2016 at 2:31 PM, Victor Manuel Garcia <
> victor.garcia@beeva.com> wrote:
>
>> Hi, Abhi
>> This is a bug...you can test in PR #668
>>
>> Cheers
>> El 9/2/2016 23:09, "Abhi Basu" <90...@gmail.com> escribió:
>>
>>> Added note: Zeppelin was built from binary and all configs done as
>>> stated on site.
>>>
>>> On Tue, Feb 9, 2016 at 1:33 PM, Abhi Basu <90...@gmail.com> wrote:
>>>
>>>> Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
>>>>
>>>> Getting this error using the hive interpreter, doing a count(*) or
>>>> create of table.
>>>>
>>>> Show tables -- works fine.
>>>>
>>>>
>>>> java.lang.NullPointerException at
>>>> org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
>>>> at
>>>> org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
>>>> at
>>>> org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
>>>> at
>>>> org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
>>>> at
>>>> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
>>>> at
>>>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
>>>> at
>>>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
>>>> at org.apache.zeppelin.scheduler.Job.run(Job.java:169) at
>>>> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>>>> at
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>>>> at
>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>> at
>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>>
>>>> Thanks,
>>>>
>>>> Abhi
>>>>
>>>> --
>>>> Abhi Basu
>>>>
>>>
>>>
>>>
>>> --
>>> Abhi Basu
>>>
>>
>
>
> --
> Abhi Basu
>
Re: Hive interpreter error - HiveInterpreter.getConnection
Posted by Abhi Basu <90...@gmail.com>.
Ok, so this bug is in the current 0.56 binary? Is the binary going to be
regenerated or do I need to build from source?
Thanks,
Abhi
On Tue, Feb 9, 2016 at 2:31 PM, Victor Manuel Garcia <
victor.garcia@beeva.com> wrote:
> Hi, Abhi
> This is a bug...you can test in PR #668
>
> Cheers
> El 9/2/2016 23:09, "Abhi Basu" <90...@gmail.com> escribió:
>
>> Added note: Zeppelin was built from binary and all configs done as stated
>> on site.
>>
>> On Tue, Feb 9, 2016 at 1:33 PM, Abhi Basu <90...@gmail.com> wrote:
>>
>>> Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
>>>
>>> Getting this error using the hive interpreter, doing a count(*) or
>>> create of table.
>>>
>>> Show tables -- works fine.
>>>
>>>
>>> java.lang.NullPointerException at
>>> org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
>>> at
>>> org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
>>> at
>>> org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
>>> at
>>> org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
>>> at
>>> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
>>> at
>>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
>>> at
>>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
>>> at org.apache.zeppelin.scheduler.Job.run(Job.java:169) at
>>> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>>> at
>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>> Thanks,
>>>
>>> Abhi
>>>
>>> --
>>> Abhi Basu
>>>
>>
>>
>>
>> --
>> Abhi Basu
>>
>
--
Abhi Basu
Re: Hive interpreter error - HiveInterpreter.getConnection
Posted by Victor Manuel Garcia <vi...@beeva.com>.
Hi, Abhi
This is a bug...you can test in PR #668
Cheers
El 9/2/2016 23:09, "Abhi Basu" <90...@gmail.com> escribió:
> Added note: Zeppelin was built from binary and all configs done as stated
> on site.
>
> On Tue, Feb 9, 2016 at 1:33 PM, Abhi Basu <90...@gmail.com> wrote:
>
>> Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
>>
>> Getting this error using the hive interpreter, doing a count(*) or
>> create of table.
>>
>> Show tables -- works fine.
>>
>>
>> java.lang.NullPointerException at
>> org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
>> at
>> org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
>> at
>> org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
>> at
>> org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
>> at
>> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
>> at
>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
>> at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
>> at org.apache.zeppelin.scheduler.Job.run(Job.java:169) at
>> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Thanks,
>>
>> Abhi
>>
>> --
>> Abhi Basu
>>
>
>
>
> --
> Abhi Basu
>
Re: Hive interpreter error - HiveInterpreter.getConnection
Posted by Abhi Basu <90...@gmail.com>.
Added note: Zeppelin was built from binary and all configs done as stated
on site.
On Tue, Feb 9, 2016 at 1:33 PM, Abhi Basu <90...@gmail.com> wrote:
> Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
>
> Getting this error using the hive interpreter, doing a count(*) or create
> of table.
>
> Show tables -- works fine.
>
>
> java.lang.NullPointerException at
> org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
> at
> org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
> at
> org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
> at
> org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
> at
> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
> at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:169) at
> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
> Thanks,
>
> Abhi
>
> --
> Abhi Basu
>
--
Abhi Basu
Re: Hive interpreter error - HiveInterpreter.getConnection
Posted by Abhi Basu <90...@gmail.com>.
Yes, I had these setup already, still does not work.
On Tue, Feb 9, 2016 at 1:57 PM, Benjamin Kim <bb...@gmail.com> wrote:
> Abhi,
>
> Do you have hive-site.xml and yarn-conf symlinked in your spark/conf dir?
>
> ln -s /etc/hive/conf/hive-site.xml /etc/spark/conf/hive-site.xml
> ln -s /etc/spark/conf/yarn-conf /etc/spark/conf/yarn-conf
>
> This made it work for me.
>
> Cheers,
> Ben
>
>
> On Feb 9, 2016, at 1:33 PM, Abhi Basu <90...@gmail.com> wrote:
>
> Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
>
> Getting this error using the hive interpreter, doing a count(*) or create
> of table.
>
> Show tables -- works fine.
>
>
> java.lang.NullPointerException at
> org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
> at
> org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
> at
> org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
> at
> org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
> at
> org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
> at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:169) at
> org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
> Thanks,
>
> Abhi
>
> --
> Abhi Basu
>
>
>
--
Abhi Basu
Re: Hive interpreter error - HiveInterpreter.getConnection
Posted by Benjamin Kim <bb...@gmail.com>.
Abhi,
Do you have hive-site.xml and yarn-conf symlinked in your spark/conf dir?
ln -s /etc/hive/conf/hive-site.xml /etc/spark/conf/hive-site.xml
ln -s /etc/spark/conf/yarn-conf /etc/spark/conf/yarn-conf
This made it work for me.
Cheers,
Ben
> On Feb 9, 2016, at 1:33 PM, Abhi Basu <90...@gmail.com> wrote:
>
> Zeppelin 0.56, running on Yarn on top of CDH 5.5.1, Spark 1.5.0
>
> Getting this error using the hive interpreter, doing a count(*) or create of table.
>
> Show tables -- works fine.
>
>
> java.lang.NullPointerException
> at org.apache.zeppelin.hive.HiveInterpreter.getConnection(HiveInterpreter.java:184)
> at org.apache.zeppelin.hive.HiveInterpreter.getStatement(HiveInterpreter.java:204)
> at org.apache.zeppelin.hive.HiveInterpreter.executeSql(HiveInterpreter.java:233)
> at org.apache.zeppelin.hive.HiveInterpreter.interpret(HiveInterpreter.java:328)
> at org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
> at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:169)
> at org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:157)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
> Thanks,
>
> Abhi
>
> --
> Abhi Basu