You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@zeppelin.apache.org by Francis Lau <fr...@smartsheet.com> on 2015/07/29 01:00:27 UTC

Anybody has Zeppelin working against AWS EMR 4.0?

Anyone has Zeppelin working against AWS EMR 4.0 with Spark?

The 4.0 version of EMR was just released last week:
http://aws.amazon.com/about-aws/whats-new/2015/07/amazon-emr-release-4-0-0-with-new-versions-of-apache-hadoop-hive-and-spark-now-available/

I found this bootstrap and I got a new cluster up and running without
errors: https://gist.github.com/andershammar/224e1077021d0ea376dd#comments

But the Zepp UI shows the "disconnected" red label and I also cannot create
a new notebook.

I am very new to Zeppelin so it may be a rookie issue :) i.e. configs or
connections.

Help?

-- 
*Francis *

Re: Anybody has Zeppelin working against AWS EMR 4.0?

Posted by Ranjit Manuel <ra...@gmail.com>.

Couple of things to check

1. Websocket port is available
2. Check logs for any errors
3.  Web browser you are using..this happened with me and found that it
works only with Mozilla Firefox
On Jul 29, 2015 4:31 AM, "Francis Lau" <fr...@smartsheet.com> wrote:

> Anyone has Zeppelin working against AWS EMR 4.0 with Spark?
>
> The 4.0 version of EMR was just released last week:
> http://aws.amazon.com/about-aws/whats-new/2015/07/amazon-emr-release-4-0-0-with-new-versions-of-apache-hadoop-hive-and-spark-now-available/
>
> I found this bootstrap and I got a new cluster up and running without
> errors: https://gist.github.com/andershammar/224e1077021d0ea376dd#comments
>
> But the Zepp UI shows the "disconnected" red label and I also cannot
> create a new notebook.
>
> I am very new to Zeppelin so it may be a rookie issue :) i.e. configs or
> connections.
>
> Help?
>
> --
> *Francis *
>

Re: Anybody has Zeppelin working against AWS EMR 4.0?

Posted by Francis Lau <fr...@smartsheet.com>.

Thanks Alexander.  I will try this tomorrow morning and report back. 

Francis



> On Jul 28, 2015, at 6:43 PM, Alexander Bezzubov <bz...@apache.org> wrote:
> 
> HI Francis,
> 
> thank you for your interest in using Zeppelin with AWS EMR, and please keep sharing it.
> 
> The reason you have "disconnected" state is that before https://github.com/apache/incubator-zeppelin/pull/170 as it is mentioned here https://github.com/apache/incubator-zeppelin#run Zeppelin neededs 2 open ports: 8080 for REST API and 8081 for websocket communication (both are configurable, but those are defaults) - and 'disconnected' usually means that wesocket one is not available.
> 
> Can you make sure you both are accessible on your setup (i.e using nc)? I.e the link you pointed have instructions to setup both port forwarded though SSH and that is essential.
> 
> Another option would be to build Zeppelin \w #140 patch and see if that solves the issue.
> 
> Please, let me know if that helps!
> 
> --
> BR,
> Alexander.
> 
>> On Wed, Jul 29, 2015 at 8:00 AM, Francis Lau <fr...@smartsheet.com> wrote:
>> Anyone has Zeppelin working against AWS EMR 4.0 with Spark? 
>> 
>> The 4.0 version of EMR was just released last week:  http://aws.amazon.com/about-aws/whats-new/2015/07/amazon-emr-release-4-0-0-with-new-versions-of-apache-hadoop-hive-and-spark-now-available/
>> 
>> I found this bootstrap and I got a new cluster up and running without errors: https://gist.github.com/andershammar/224e1077021d0ea376dd#comments
>> 
>> But the Zepp UI shows the "disconnected" red label and I also cannot create a new notebook. 
>> 
>> I am very new to Zeppelin so it may be a rookie issue :) i.e. configs or connections. 
>> 
>> Help?
>> 
>> -- 
>> Francis 
>

Re: Anybody has Zeppelin working against AWS EMR 4.0?

Posted by Alexander Bezzubov <bz...@apache.org>.

HI Francis,

thank you for your interest in using Zeppelin with AWS EMR, and please keep
sharing it.

The reason you have "disconnected" state is that before
https://github.com/apache/incubator-zeppelin/pull/170 as it is mentioned
here https://github.com/apache/incubator-zeppelin#run Zeppelin neededs 2
open ports: 8080 for REST API and 8081 for websocket communication (both
are configurable, but those are defaults) - and 'disconnected' usually
means that wesocket one is not available.

Can you make sure you both are accessible on your setup (i.e using nc)? I.e
the link you pointed have instructions to setup both port forwarded though
SSH and that is essential.

Another option would be to build Zeppelin \w #140 patch and see if that
solves the issue.

Please, let me know if that helps!

--
BR,
Alexander.

On Wed, Jul 29, 2015 at 8:00 AM, Francis Lau <fr...@smartsheet.com>
wrote:

> Anyone has Zeppelin working against AWS EMR 4.0 with Spark?
>
> The 4.0 version of EMR was just released last week:
> http://aws.amazon.com/about-aws/whats-new/2015/07/amazon-emr-release-4-0-0-with-new-versions-of-apache-hadoop-hive-and-spark-now-available/
>
> I found this bootstrap and I got a new cluster up and running without
> errors: https://gist.github.com/andershammar/224e1077021d0ea376dd#comments
>
> But the Zepp UI shows the "disconnected" red label and I also cannot
> create a new notebook.
>
> I am very new to Zeppelin so it may be a rookie issue :) i.e. configs or
> connections.
>
> Help?
>
> --
> *Francis *
>