You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by vincent gromakowski <vi...@gmail.com> on 2016/10/12 22:27:58 UTC
zeppelin with spark 2.0.1
Hi all,
I am trying to configure zeppelin for spark 2.0.1 but when I precise the
SPARK_HOME in zeppelin-env.sh I get this error
java.net.ConnectException: Connection refused at
java.net.PlainSocketImpl.socketConnect(Native Method) at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
java.net.Socket.connect(Socket.java:589) at
org.apache.thrift.transport.TSocket.open(TSocket.java:182) at
org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
at
org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
at
org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60)
at
org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:96)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:216)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:290) at
org.apache.zeppelin.scheduler.Job.run(Job.java:176) at
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Thansk for your help
Re: zeppelin with spark 2.0.1
Posted by vincent gromakowski <vi...@gmail.com>.
It is a problem with my spark-defaults, if I set a brand new spark 2.0.1
install it works.
2016-10-13 9:47 GMT+02:00 Mich Talebzadeh <mi...@gmail.com>:
> put this in your env file
>
> export MASTER=spark://<hostname>:7077 #
> Spark master url. eg. spark://master_addr:7077
>
> as is in /etc/hosts
>
> and reboot zeppelin
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
> On 13 October 2016 at 08:44, vincent gromakowski <
> vincent.gromakowski@gmail.com> wrote:
>
>> In this case it works with spark included in zeppelin (2.0.0) but i want
>> to deploy to mesos in distributed...
>>
>> Le 13 oct. 2016 9:42 AM, "Mich Talebzadeh" <mi...@gmail.com> a
>> écrit :
>>
>> comment out spark_home in zeppelin-env.sh and restart zeppelin to test
>>
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>> On 13 October 2016 at 08:38, vincent gromakowski <
>> vincent.gromakowski@gmail.com> wrote:
>>
>>> I am on localhost only
>>> MASTER=local[*]
>>> SPARK_HOME=/opt/spark-2.0.1
>>>
>>> Firewalld is stopped, plain VM no docker...
>>>
>>> Le 13 oct. 2016 2:39 AM, "Xi Shen" <da...@gmail.com> a écrit :
>>>
>>> java.net.ConnectException: Connection refused
>>>
>>> is a clear sign of network issue. What is your network topology like?
>>> Maybe you want to check the firewall settings.
>>>
>>> On Thu, Oct 13, 2016 at 6:43 AM Mich Talebzadeh <
>>> mich.talebzadeh@gmail.com> wrote:
>>>
>>>> what have you defined your export MASTER=
>>>>
>>>> and
>>>>
>>>> export SPARK_HOME=
>>>>
>>>> in zeppelin-env.sh
>>>>
>>>> Dr Mich Talebzadeh
>>>>
>>>>
>>>>
>>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>
>>>>
>>>>
>>>> http://talebzadehmich.wordpress.com
>>>>
>>>>
>>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>>> any loss, damage or destruction of data or any other property which may
>>>> arise from relying on this email's technical content is explicitly
>>>> disclaimed. The author will in no case be liable for any monetary damages
>>>> arising from such loss, damage or destruction.
>>>>
>>>>
>>>>
>>>> On 12 October 2016 at 23:27, vincent gromakowski <
>>>> vincent.gromakowski@gmail.com> wrote:
>>>>
>>>> Hi all,
>>>> I am trying to configure zeppelin for spark 2.0.1 but when I precise
>>>> the SPARK_HOME in zeppelin-env.sh I get this error
>>>>
>>>> java.net.ConnectException: Connection refused at
>>>> java.net.PlainSocketImpl.socketConnect(Native Method) at java.net
>>>> .AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
>>>> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
>>>> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
>>>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
>>>> java.net.Socket.connect(Socket.java:589) at
>>>> org.apache.thrift.transport.TSocket.open(TSocket.java:182) at
>>>> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
>>>> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
>>>> at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(
>>>> BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.
>>>> GenericObjectPool.create(GenericObjectPool.java:861) at
>>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
>>>> at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
>>>> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProc
>>>> ess.getClient(RemoteInterpreterProcess.java:96) at
>>>> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:216)
>>>> at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.get
>>>> FormType(RemoteInterpreter.java:383) at org.apache.zeppelin.interprete
>>>> r.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105) at
>>>> org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:290) at
>>>> org.apache.zeppelin.scheduler.Job.run(Job.java:176) at
>>>> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>>>> tureTask.access$201(ScheduledThreadPoolExecutor.java:180) at
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>>>> tureTask.run(ScheduledThreadPoolExecutor.java:293) at
>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>>
>>>>
>>>> Thansk for your help
>>>>
>>>>
>>>> --
>>>
>>>
>>> Thanks,
>>> David S.
>>>
>>>
>>>
>>
>>
>
Re: zeppelin with spark 2.0.1
Posted by Mich Talebzadeh <mi...@gmail.com>.
put this in your env file
export MASTER=spark://<hostname>:7077 # Spark
master url. eg. spark://master_addr:7077
as is in /etc/hosts
and reboot zeppelin
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.
On 13 October 2016 at 08:44, vincent gromakowski <
vincent.gromakowski@gmail.com> wrote:
> In this case it works with spark included in zeppelin (2.0.0) but i want
> to deploy to mesos in distributed...
>
> Le 13 oct. 2016 9:42 AM, "Mich Talebzadeh" <mi...@gmail.com> a
> écrit :
>
> comment out spark_home in zeppelin-env.sh and restart zeppelin to test
>
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
> On 13 October 2016 at 08:38, vincent gromakowski <
> vincent.gromakowski@gmail.com> wrote:
>
>> I am on localhost only
>> MASTER=local[*]
>> SPARK_HOME=/opt/spark-2.0.1
>>
>> Firewalld is stopped, plain VM no docker...
>>
>> Le 13 oct. 2016 2:39 AM, "Xi Shen" <da...@gmail.com> a écrit :
>>
>> java.net.ConnectException: Connection refused
>>
>> is a clear sign of network issue. What is your network topology like?
>> Maybe you want to check the firewall settings.
>>
>> On Thu, Oct 13, 2016 at 6:43 AM Mich Talebzadeh <
>> mich.talebzadeh@gmail.com> wrote:
>>
>>> what have you defined your export MASTER=
>>>
>>> and
>>>
>>> export SPARK_HOME=
>>>
>>> in zeppelin-env.sh
>>>
>>> Dr Mich Talebzadeh
>>>
>>>
>>>
>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>
>>>
>>>
>>> http://talebzadehmich.wordpress.com
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>> On 12 October 2016 at 23:27, vincent gromakowski <
>>> vincent.gromakowski@gmail.com> wrote:
>>>
>>> Hi all,
>>> I am trying to configure zeppelin for spark 2.0.1 but when I precise the
>>> SPARK_HOME in zeppelin-env.sh I get this error
>>>
>>> java.net.ConnectException: Connection refused at
>>> java.net.PlainSocketImpl.socketConnect(Native Method) at java.net
>>> .AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at
>>> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
>>> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
>>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
>>> java.net.Socket.connect(Socket.java:589) at
>>> org.apache.thrift.transport.TSocket.open(TSocket.java:182) at
>>> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
>>> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
>>> at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(
>>> BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.
>>> GenericObjectPool.create(GenericObjectPool.java:861) at
>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
>>> at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
>>> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProc
>>> ess.getClient(RemoteInterpreterProcess.java:96) at
>>> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:216)
>>> at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.get
>>> FormType(RemoteInterpreter.java:383) at org.apache.zeppelin.interprete
>>> r.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105) at
>>> org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:290) at
>>> org.apache.zeppelin.scheduler.Job.run(Job.java:176) at
>>> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>>> tureTask.access$201(ScheduledThreadPoolExecutor.java:180) at
>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>>> tureTask.run(ScheduledThreadPoolExecutor.java:293) at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>>
>>> Thansk for your help
>>>
>>>
>>> --
>>
>>
>> Thanks,
>> David S.
>>
>>
>>
>
>
Re: zeppelin with spark 2.0.1
Posted by vincent gromakowski <vi...@gmail.com>.
In this case it works with spark included in zeppelin (2.0.0) but i want to
deploy to mesos in distributed...
Le 13 oct. 2016 9:42 AM, "Mich Talebzadeh" <mi...@gmail.com> a
écrit :
comment out spark_home in zeppelin-env.sh and restart zeppelin to test
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.
On 13 October 2016 at 08:38, vincent gromakowski <
vincent.gromakowski@gmail.com> wrote:
> I am on localhost only
> MASTER=local[*]
> SPARK_HOME=/opt/spark-2.0.1
>
> Firewalld is stopped, plain VM no docker...
>
> Le 13 oct. 2016 2:39 AM, "Xi Shen" <da...@gmail.com> a écrit :
>
> java.net.ConnectException: Connection refused
>
> is a clear sign of network issue. What is your network topology like?
> Maybe you want to check the firewall settings.
>
> On Thu, Oct 13, 2016 at 6:43 AM Mich Talebzadeh <mi...@gmail.com>
> wrote:
>
>> what have you defined your export MASTER=
>>
>> and
>>
>> export SPARK_HOME=
>>
>> in zeppelin-env.sh
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>> On 12 October 2016 at 23:27, vincent gromakowski <
>> vincent.gromakowski@gmail.com> wrote:
>>
>> Hi all,
>> I am trying to configure zeppelin for spark 2.0.1 but when I precise the
>> SPARK_HOME in zeppelin-env.sh I get this error
>>
>> java.net.ConnectException: Connection refused at
>> java.net.PlainSocketImpl.socketConnect(Native Method) at java.net
>> .AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at
>> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
>> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
>> java.net.Socket.connect(Socket.java:589) at
>> org.apache.thrift.transport.TSocket.open(TSocket.java:182) at
>> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
>> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
>> at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(
>> BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.
>> GenericObjectPool.create(GenericObjectPool.java:861) at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
>> at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
>> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProc
>> ess.getClient(RemoteInterpreterProcess.java:96) at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:216)
>> at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.get
>> FormType(RemoteInterpreter.java:383) at org.apache.zeppelin.interprete
>> r.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105) at
>> org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:290) at
>> org.apache.zeppelin.scheduler.Job.run(Job.java:176) at
>> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>> tureTask.access$201(ScheduledThreadPoolExecutor.java:180) at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>> tureTask.run(ScheduledThreadPoolExecutor.java:293) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>>
>>
>> Thansk for your help
>>
>>
>> --
>
>
> Thanks,
> David S.
>
>
>
Re: zeppelin with spark 2.0.1
Posted by Mich Talebzadeh <mi...@gmail.com>.
comment out spark_home in zeppelin-env.sh and restart zeppelin to test
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.
On 13 October 2016 at 08:38, vincent gromakowski <
vincent.gromakowski@gmail.com> wrote:
> I am on localhost only
> MASTER=local[*]
> SPARK_HOME=/opt/spark-2.0.1
>
> Firewalld is stopped, plain VM no docker...
>
> Le 13 oct. 2016 2:39 AM, "Xi Shen" <da...@gmail.com> a écrit :
>
> java.net.ConnectException: Connection refused
>
> is a clear sign of network issue. What is your network topology like?
> Maybe you want to check the firewall settings.
>
> On Thu, Oct 13, 2016 at 6:43 AM Mich Talebzadeh <mi...@gmail.com>
> wrote:
>
>> what have you defined your export MASTER=
>>
>> and
>>
>> export SPARK_HOME=
>>
>> in zeppelin-env.sh
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>> On 12 October 2016 at 23:27, vincent gromakowski <
>> vincent.gromakowski@gmail.com> wrote:
>>
>> Hi all,
>> I am trying to configure zeppelin for spark 2.0.1 but when I precise the
>> SPARK_HOME in zeppelin-env.sh I get this error
>>
>> java.net.ConnectException: Connection refused at
>> java.net.PlainSocketImpl.socketConnect(Native Method) at java.net
>> .AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at
>> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
>> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
>> java.net.Socket.connect(Socket.java:589) at
>> org.apache.thrift.transport.TSocket.open(TSocket.java:182) at
>> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
>> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
>> at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(
>> BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.
>> GenericObjectPool.create(GenericObjectPool.java:861) at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
>> at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
>> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProc
>> ess.getClient(RemoteInterpreterProcess.java:96) at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.
>> init(RemoteInterpreter.java:216) at org.apache.zeppelin.interprete
>> r.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383) at
>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormT
>> ype(LazyOpenInterpreter.java:105) at org.apache.zeppelin.notebook.P
>> aragraph.jobRun(Paragraph.java:290) at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
>> at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>> tureTask.access$201(ScheduledThreadPoolExecutor.java:180) at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu
>> tureTask.run(ScheduledThreadPoolExecutor.java:293) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>>
>>
>> Thansk for your help
>>
>>
>> --
>
>
> Thanks,
> David S.
>
>
>
Re: zeppelin with spark 2.0.1
Posted by vincent gromakowski <vi...@gmail.com>.
I am on localhost only
MASTER=local[*]
SPARK_HOME=/opt/spark-2.0.1
Firewalld is stopped, plain VM no docker...
Le 13 oct. 2016 2:39 AM, "Xi Shen" <da...@gmail.com> a écrit :
java.net.ConnectException: Connection refused
is a clear sign of network issue. What is your network topology like? Maybe
you want to check the firewall settings.
On Thu, Oct 13, 2016 at 6:43 AM Mich Talebzadeh <mi...@gmail.com>
wrote:
> what have you defined your export MASTER=
>
> and
>
> export SPARK_HOME=
>
> in zeppelin-env.sh
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
> On 12 October 2016 at 23:27, vincent gromakowski <
> vincent.gromakowski@gmail.com> wrote:
>
> Hi all,
> I am trying to configure zeppelin for spark 2.0.1 but when I precise the
> SPARK_HOME in zeppelin-env.sh I get this error
>
> java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native
> Method) at java.net.AbstractPlainSocketImpl.doConnect(
> AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.
> connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.
> AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at
> java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
> java.net.Socket.connect(Socket.java:589) at org.apache.thrift.transport.TSocket.open(TSocket.java:182)
> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
> at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(
> BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.
> GenericObjectPool.create(GenericObjectPool.java:861) at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
> at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.
> getClient(RemoteInterpreterProcess.java:96) at org.apache.zeppelin.
> interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:216) at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383)
> at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105)
> at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:290) at
> org.apache.zeppelin.scheduler.Job.run(Job.java:176) at
> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(
> ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.
> ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
> Thansk for your help
>
>
> --
Thanks,
David S.
Re: zeppelin with spark 2.0.1
Posted by Xi Shen <da...@gmail.com>.
java.net.ConnectException: Connection refused
is a clear sign of network issue. What is your network topology like? Maybe
you want to check the firewall settings.
On Thu, Oct 13, 2016 at 6:43 AM Mich Talebzadeh <mi...@gmail.com>
wrote:
> what have you defined your export MASTER=
>
> and
>
> export SPARK_HOME=
>
> in zeppelin-env.sh
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
> On 12 October 2016 at 23:27, vincent gromakowski <
> vincent.gromakowski@gmail.com> wrote:
>
> Hi all,
> I am trying to configure zeppelin for spark 2.0.1 but when I precise the
> SPARK_HOME in zeppelin-env.sh I get this error
>
> java.net.ConnectException: Connection refused at
> java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
> java.net.Socket.connect(Socket.java:589) at
> org.apache.thrift.transport.TSocket.open(TSocket.java:182) at
> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
> at
> org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
> at
> org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:96)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:216)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383)
> at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105)
> at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:290) at
> org.apache.zeppelin.scheduler.Job.run(Job.java:176) at
> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
> Thansk for your help
>
>
> --
Thanks,
David S.
Re: zeppelin with spark 2.0.1
Posted by Mich Talebzadeh <mi...@gmail.com>.
what have you defined your export MASTER=
and
export SPARK_HOME=
in zeppelin-env.sh
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.
On 12 October 2016 at 23:27, vincent gromakowski <
vincent.gromakowski@gmail.com> wrote:
> Hi all,
> I am trying to configure zeppelin for spark 2.0.1 but when I precise the
> SPARK_HOME in zeppelin-env.sh I get this error
>
> java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native
> Method) at java.net.AbstractPlainSocketImpl.doConnect(
> AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.
> connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.
> AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at
> java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at
> java.net.Socket.connect(Socket.java:589) at org.apache.thrift.transport.TSocket.open(TSocket.java:182)
> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)
> at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37)
> at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(
> BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.
> GenericObjectPool.create(GenericObjectPool.java:861) at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
> at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.
> getClient(RemoteInterpreterProcess.java:96) at org.apache.zeppelin.
> interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:216) at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383)
> at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105)
> at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:290) at
> org.apache.zeppelin.scheduler.Job.run(Job.java:176) at
> org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(
> ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.
> ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
> Thansk for your help
>
>