You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Guillermo Ortiz <ko...@gmail.com> on 2015/11/24 15:17:34 UTC
Zeppeling isn't connected in CDH 5.4.8
I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to connect. It
starts correctly and I don't see any error in the logs but it has a
"disconnect" state in the web.
I have tried with export MASTER=yarn-client and local[*]
I have edited the zeppelin-env.sh adding the export
HADOOP_CONF_DIR=/etc/hadoop/conf
Spark works fine with the spark-shell.
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by moon soo Lee <mo...@apache.org>.
It was kind of popular problem showing 'Disconnect' status in Zeppelin
0.5.0, while it was using separate websocket port and in may cases, that
separate websocket port was blocked by firewall or proxy.
However, from 0.5.5, websocket is no longer uses separate port. So, seeing
'disconnect' while webapp is normally loaded is very uncommon.
If you still see 'disconnect', could you open such things like 'Developer
tools' or 'Javascript console', and go to 'network' tab and find 'ws'
(websocket) connection?
That information might help to narrow down the cause of the problem.
Thanks,
moon
On Wed, Nov 25, 2015 at 7:17 PM Hyung Sung Shim <hs...@nflabs.com> wrote:
> VM zeppelin works? But zeppelin in the spark host does not work right?
> It's a strange.
> What's the different environments(configurations) between VM zeppelin and
> Host zeppelin?
>
> And If you don't use pyspark, you don't need to install the python.
>
>
> 2015-11-25 17:24 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
>
>> I have three node cluster but I installed YARN, SPARK, HDFS and Zeppelin
>> in the same node.
>>
>> It must be something missing, I tried to install Zeppelin in the
>> QuickStart VM of Cloudera and it works.
>>
>> When do I install the binary format, Do I have to install some extra
>> package like python, and so on and it's all in the binary version?
>>
>> 2015-11-25 2:16 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
>>
>>> hello.
>>> Is there zeppelin and spark and yarn in the same machine?
>>> If is not you should open port they(zeppelin,spark,yarn,hdfs) are using.
>>>
>>> 2015년 11월 25일 수요일, Guillermo Ortiz<ko...@gmail.com>님이 작성한 메시지:
>>>
>>> The spark's version is 1.3.1 in this CDH.
>>>>
>>>> 2015-11-24 17:38 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>>>
>>>>> I'm using zeppelin 0.5.5 (binary installation)
>>>>>
>>>>> SPARK_HOME is correct /opt/cloudera/parcels/CDH/lib/spark/
>>>>> and I checked /opt/cloudera/parcels/CDH/lib/spark/bin/spark-submit
>>>>>
>>>>> I don't know about checking connection between zeppelin and spark.
>>>>> Could you be more specific? thanks.
>>>>>
>>>>> 2015-11-24 17:19 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
>>>>>
>>>>>> Hello.
>>>>>>
>>>>>> It seems like no problem with your configuration.
>>>>>>
>>>>>> Please check the below things.
>>>>>> - Check connection(port) between zeppelin and spark.
>>>>>>
>>>>>> - If you set the SPARK_HOME in conf/zeppelin-env.sh, zeppelin use the
>>>>>> SPARK_HOME/bin/spark-submit command.
>>>>>> So check spark-submit command exist.
>>>>>>
>>>>>> Let me know your check result and if you still have the problem,
>>>>>> tell me the zeppelin version you are using then I will test your
>>>>>> problem.
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> 2015-11-24 23:57 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
>>>>>>
>>>>>>> I config spark.home to
>>>>>>> /opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>>>>> I'm not sure about the configuration of spark.yarn.jar
>>>>>>>
>>>>>>> I only have this configuration in zeppelin-env.sh
>>>>>>> export MASTER=yarn-client
>>>>>>> export
>>>>>>> SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>>>>> export HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>>>>
>>>>>>>
>>>>>>> 2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>>>>>>
>>>>>>>> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to
>>>>>>>> connect. It starts correctly and I don't see any error in the logs but it
>>>>>>>> has a "disconnect" state in the web.
>>>>>>>>
>>>>>>>> I have tried with export MASTER=yarn-client and local[*]
>>>>>>>> I have edited the zeppelin-env.sh adding the export
>>>>>>>> HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>>>>>
>>>>>>>> Spark works fine with the spark-shell.
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>
>
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by Hyung Sung Shim <hs...@nflabs.com>.
VM zeppelin works? But zeppelin in the spark host does not work right?
It's a strange.
What's the different environments(configurations) between VM zeppelin and
Host zeppelin?
And If you don't use pyspark, you don't need to install the python.
2015-11-25 17:24 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
> I have three node cluster but I installed YARN, SPARK, HDFS and Zeppelin
> in the same node.
>
> It must be something missing, I tried to install Zeppelin in the
> QuickStart VM of Cloudera and it works.
>
> When do I install the binary format, Do I have to install some extra
> package like python, and so on and it's all in the binary version?
>
> 2015-11-25 2:16 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
>
>> hello.
>> Is there zeppelin and spark and yarn in the same machine?
>> If is not you should open port they(zeppelin,spark,yarn,hdfs) are using.
>>
>> 2015년 11월 25일 수요일, Guillermo Ortiz<ko...@gmail.com>님이 작성한 메시지:
>>
>> The spark's version is 1.3.1 in this CDH.
>>>
>>> 2015-11-24 17:38 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>>
>>>> I'm using zeppelin 0.5.5 (binary installation)
>>>>
>>>> SPARK_HOME is correct /opt/cloudera/parcels/CDH/lib/spark/
>>>> and I checked /opt/cloudera/parcels/CDH/lib/spark/bin/spark-submit
>>>>
>>>> I don't know about checking connection between zeppelin and spark.
>>>> Could you be more specific? thanks.
>>>>
>>>> 2015-11-24 17:19 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
>>>>
>>>>> Hello.
>>>>>
>>>>> It seems like no problem with your configuration.
>>>>>
>>>>> Please check the below things.
>>>>> - Check connection(port) between zeppelin and spark.
>>>>>
>>>>> - If you set the SPARK_HOME in conf/zeppelin-env.sh, zeppelin use the
>>>>> SPARK_HOME/bin/spark-submit command.
>>>>> So check spark-submit command exist.
>>>>>
>>>>> Let me know your check result and if you still have the problem,
>>>>> tell me the zeppelin version you are using then I will test your
>>>>> problem.
>>>>>
>>>>> Thanks.
>>>>>
>>>>> 2015-11-24 23:57 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
>>>>>
>>>>>> I config spark.home to
>>>>>> /opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>>>> I'm not sure about the configuration of spark.yarn.jar
>>>>>>
>>>>>> I only have this configuration in zeppelin-env.sh
>>>>>> export MASTER=yarn-client
>>>>>> export
>>>>>> SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>>>> export HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>>>
>>>>>>
>>>>>> 2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>>>>>
>>>>>>> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to
>>>>>>> connect. It starts correctly and I don't see any error in the logs but it
>>>>>>> has a "disconnect" state in the web.
>>>>>>>
>>>>>>> I have tried with export MASTER=yarn-client and local[*]
>>>>>>> I have edited the zeppelin-env.sh adding the export
>>>>>>> HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>>>>
>>>>>>> Spark works fine with the spark-shell.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by Guillermo Ortiz <ko...@gmail.com>.
I have three node cluster but I installed YARN, SPARK, HDFS and Zeppelin in
the same node.
It must be something missing, I tried to install Zeppelin in the QuickStart
VM of Cloudera and it works.
When do I install the binary format, Do I have to install some extra
package like python, and so on and it's all in the binary version?
2015-11-25 2:16 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
> hello.
> Is there zeppelin and spark and yarn in the same machine?
> If is not you should open port they(zeppelin,spark,yarn,hdfs) are using.
>
> 2015년 11월 25일 수요일, Guillermo Ortiz<ko...@gmail.com>님이 작성한 메시지:
>
> The spark's version is 1.3.1 in this CDH.
>>
>> 2015-11-24 17:38 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>
>>> I'm using zeppelin 0.5.5 (binary installation)
>>>
>>> SPARK_HOME is correct /opt/cloudera/parcels/CDH/lib/spark/
>>> and I checked /opt/cloudera/parcels/CDH/lib/spark/bin/spark-submit
>>>
>>> I don't know about checking connection between zeppelin and spark. Could
>>> you be more specific? thanks.
>>>
>>> 2015-11-24 17:19 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
>>>
>>>> Hello.
>>>>
>>>> It seems like no problem with your configuration.
>>>>
>>>> Please check the below things.
>>>> - Check connection(port) between zeppelin and spark.
>>>>
>>>> - If you set the SPARK_HOME in conf/zeppelin-env.sh, zeppelin use the
>>>> SPARK_HOME/bin/spark-submit command.
>>>> So check spark-submit command exist.
>>>>
>>>> Let me know your check result and if you still have the problem,
>>>> tell me the zeppelin version you are using then I will test your
>>>> problem.
>>>>
>>>> Thanks.
>>>>
>>>> 2015-11-24 23:57 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
>>>>
>>>>> I config spark.home to
>>>>> /opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>>> I'm not sure about the configuration of spark.yarn.jar
>>>>>
>>>>> I only have this configuration in zeppelin-env.sh
>>>>> export MASTER=yarn-client
>>>>> export
>>>>> SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>>> export HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>>
>>>>>
>>>>> 2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>>>>
>>>>>> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to
>>>>>> connect. It starts correctly and I don't see any error in the logs but it
>>>>>> has a "disconnect" state in the web.
>>>>>>
>>>>>> I have tried with export MASTER=yarn-client and local[*]
>>>>>> I have edited the zeppelin-env.sh adding the export
>>>>>> HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>>>
>>>>>> Spark works fine with the spark-shell.
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by Hyung Sung Shim <hs...@nflabs.com>.
hello.
Is there zeppelin and spark and yarn in the same machine?
If is not you should open port they(zeppelin,spark,yarn,hdfs) are using.
2015년 11월 25일 수요일, Guillermo Ortiz<ko...@gmail.com>님이 작성한 메시지:
> The spark's version is 1.3.1 in this CDH.
>
> 2015-11-24 17:38 GMT+01:00 Guillermo Ortiz <konstt2000@gmail.com
> <javascript:_e(%7B%7D,'cvml','konstt2000@gmail.com');>>:
>
>> I'm using zeppelin 0.5.5 (binary installation)
>>
>> SPARK_HOME is correct /opt/cloudera/parcels/CDH/lib/spark/
>> and I checked /opt/cloudera/parcels/CDH/lib/spark/bin/spark-submit
>>
>> I don't know about checking connection between zeppelin and spark. Could
>> you be more specific? thanks.
>>
>> 2015-11-24 17:19 GMT+01:00 Hyung Sung Shim <hsshim@nflabs.com
>> <javascript:_e(%7B%7D,'cvml','hsshim@nflabs.com');>>:
>>
>>> Hello.
>>>
>>> It seems like no problem with your configuration.
>>>
>>> Please check the below things.
>>> - Check connection(port) between zeppelin and spark.
>>>
>>> - If you set the SPARK_HOME in conf/zeppelin-env.sh, zeppelin use the
>>> SPARK_HOME/bin/spark-submit command.
>>> So check spark-submit command exist.
>>>
>>> Let me know your check result and if you still have the problem,
>>> tell me the zeppelin version you are using then I will test your problem.
>>>
>>> Thanks.
>>>
>>> 2015-11-24 23:57 GMT+09:00 Guillermo Ortiz <konstt2000@gmail.com
>>> <javascript:_e(%7B%7D,'cvml','konstt2000@gmail.com');>>:
>>>
>>>> I config spark.home to
>>>> /opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>> I'm not sure about the configuration of spark.yarn.jar
>>>>
>>>> I only have this configuration in zeppelin-env.sh
>>>> export MASTER=yarn-client
>>>> export
>>>> SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>>> export HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>
>>>>
>>>> 2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <konstt2000@gmail.com
>>>> <javascript:_e(%7B%7D,'cvml','konstt2000@gmail.com');>>:
>>>>
>>>>> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to
>>>>> connect. It starts correctly and I don't see any error in the logs but it
>>>>> has a "disconnect" state in the web.
>>>>>
>>>>> I have tried with export MASTER=yarn-client and local[*]
>>>>> I have edited the zeppelin-env.sh adding the export
>>>>> HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>>
>>>>> Spark works fine with the spark-shell.
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by Guillermo Ortiz <ko...@gmail.com>.
The spark's version is 1.3.1 in this CDH.
2015-11-24 17:38 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
> I'm using zeppelin 0.5.5 (binary installation)
>
> SPARK_HOME is correct /opt/cloudera/parcels/CDH/lib/spark/
> and I checked /opt/cloudera/parcels/CDH/lib/spark/bin/spark-submit
>
> I don't know about checking connection between zeppelin and spark. Could
> you be more specific? thanks.
>
> 2015-11-24 17:19 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
>
>> Hello.
>>
>> It seems like no problem with your configuration.
>>
>> Please check the below things.
>> - Check connection(port) between zeppelin and spark.
>>
>> - If you set the SPARK_HOME in conf/zeppelin-env.sh, zeppelin use the
>> SPARK_HOME/bin/spark-submit command.
>> So check spark-submit command exist.
>>
>> Let me know your check result and if you still have the problem,
>> tell me the zeppelin version you are using then I will test your problem.
>>
>> Thanks.
>>
>> 2015-11-24 23:57 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
>>
>>> I config spark.home to
>>> /opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>> I'm not sure about the configuration of spark.yarn.jar
>>>
>>> I only have this configuration in zeppelin-env.sh
>>> export MASTER=yarn-client
>>> export
>>> SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>>> export HADOOP_CONF_DIR=/etc/hadoop/conf
>>>
>>>
>>> 2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>>
>>>> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to connect.
>>>> It starts correctly and I don't see any error in the logs but it has a
>>>> "disconnect" state in the web.
>>>>
>>>> I have tried with export MASTER=yarn-client and local[*]
>>>> I have edited the zeppelin-env.sh adding the export
>>>> HADOOP_CONF_DIR=/etc/hadoop/conf
>>>>
>>>> Spark works fine with the spark-shell.
>>>>
>>>>
>>>
>>
>
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by Guillermo Ortiz <ko...@gmail.com>.
I'm using zeppelin 0.5.5 (binary installation)
SPARK_HOME is correct /opt/cloudera/parcels/CDH/lib/spark/
and I checked /opt/cloudera/parcels/CDH/lib/spark/bin/spark-submit
I don't know about checking connection between zeppelin and spark. Could
you be more specific? thanks.
2015-11-24 17:19 GMT+01:00 Hyung Sung Shim <hs...@nflabs.com>:
> Hello.
>
> It seems like no problem with your configuration.
>
> Please check the below things.
> - Check connection(port) between zeppelin and spark.
>
> - If you set the SPARK_HOME in conf/zeppelin-env.sh, zeppelin use the
> SPARK_HOME/bin/spark-submit command.
> So check spark-submit command exist.
>
> Let me know your check result and if you still have the problem,
> tell me the zeppelin version you are using then I will test your problem.
>
> Thanks.
>
> 2015-11-24 23:57 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
>
>> I config spark.home to
>> /opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>> I'm not sure about the configuration of spark.yarn.jar
>>
>> I only have this configuration in zeppelin-env.sh
>> export MASTER=yarn-client
>> export
>> SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
>> export HADOOP_CONF_DIR=/etc/hadoop/conf
>>
>>
>> 2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>>
>>> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to connect.
>>> It starts correctly and I don't see any error in the logs but it has a
>>> "disconnect" state in the web.
>>>
>>> I have tried with export MASTER=yarn-client and local[*]
>>> I have edited the zeppelin-env.sh adding the export
>>> HADOOP_CONF_DIR=/etc/hadoop/conf
>>>
>>> Spark works fine with the spark-shell.
>>>
>>>
>>
>
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by Hyung Sung Shim <hs...@nflabs.com>.
Hello.
It seems like no problem with your configuration.
Please check the below things.
- Check connection(port) between zeppelin and spark.
- If you set the SPARK_HOME in conf/zeppelin-env.sh, zeppelin use the
SPARK_HOME/bin/spark-submit command.
So check spark-submit command exist.
Let me know your check result and if you still have the problem,
tell me the zeppelin version you are using then I will test your problem.
Thanks.
2015-11-24 23:57 GMT+09:00 Guillermo Ortiz <ko...@gmail.com>:
> I config spark.home to
> /opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
> I'm not sure about the configuration of spark.yarn.jar
>
> I only have this configuration in zeppelin-env.sh
> export MASTER=yarn-client
> export SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
> export HADOOP_CONF_DIR=/etc/hadoop/conf
>
>
> 2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
>
>> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to connect.
>> It starts correctly and I don't see any error in the logs but it has a
>> "disconnect" state in the web.
>>
>> I have tried with export MASTER=yarn-client and local[*]
>> I have edited the zeppelin-env.sh adding the export
>> HADOOP_CONF_DIR=/etc/hadoop/conf
>>
>> Spark works fine with the spark-shell.
>>
>>
>
Re: Zeppeling isn't connected in CDH 5.4.8
Posted by Guillermo Ortiz <ko...@gmail.com>.
I config spark.home to
/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
I'm not sure about the configuration of spark.yarn.jar
I only have this configuration in zeppelin-env.sh
export MASTER=yarn-client
export SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/lib/spark
export HADOOP_CONF_DIR=/etc/hadoop/conf
2015-11-24 15:17 GMT+01:00 Guillermo Ortiz <ko...@gmail.com>:
> I'm trying to install Zeppelin in CDH 5.4.8 and I don't get to connect. It
> starts correctly and I don't see any error in the logs but it has a
> "disconnect" state in the web.
>
> I have tried with export MASTER=yarn-client and local[*]
> I have edited the zeppelin-env.sh adding the export
> HADOOP_CONF_DIR=/etc/hadoop/conf
>
> Spark works fine with the spark-shell.
>
>