You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Mark Mikolajczak - 07855 306 064 <ma...@flayranalytics.co.uk> on 2016/09/06 14:53:03 UTC

Running R on Zeppelin EMR Cluster

Hi All,

I am trying to setup the R interpreter to run in Zeppelin which is currently running on EMR. Zeppelin is working perfectly and I am able to write script in Scala and Python. When I use %r, %sparkR or %knitr I receive an error : "r interpreter not found"

The applications which I have running in my emr-4.7.2 cluster are: Hive 1.0.0, Zeppelin-Sandbox 0.5.6, Spark 1.6.2, Pig 0.14.0

Within the interpreter there is no mention of R so figure I am missing something but do not know what.

Any pointers greatly appreciated.

Re: Running R on Zeppelin EMR Cluster

Posted by Flayranalytics <ma...@flayranalytics.co.uk>.
Thanks for sharing. 

That is disappointing that R is not available on EMR. I will look out for updates. 

Regards,
Mark



> On 6 Sep 2016, at 17:42, Jonathan Kelly <jo...@gmail.com> wrote:
> 
> Mark,
> 
> I see in the couchbase-spark-connector Github project that they have already upgraded to Spark 2.0 (https://github.com/couchbase/couchbase-spark-connector/pull/9) but that this change has not yet been released into a new version. According to the discussion on that pull request, it sounds like they are hoping for a new version this month.
> 
> As for using the R interpreter on emr-5.0.0, unfortunately EMR does not yet (officially) support the R interpreter. I expect that we (I'm from EMR, btw) would be able to support it eventually, but I'm unable to give any ETA on that.
> 
> ~ Jonathan
> 
>> On Tue, Sep 6, 2016 at 8:34 AM Mark Mikolajczak - 07855 306 064 <ma...@flayranalytics.co.uk> wrote:
>> Thanks I was afraid that was the solution.
>> 
>> I am connecting to a Couchbase database and the connector only supports Spark 1.6 and by upgrading I will be using EMR-5.0.0 which seems  to only run Spark 2.0…
>>  
>> 
>>> On 6 Sep 2016, at 16:27, Hyung Sung Shim <hs...@nflabs.com> wrote:
>>> 
>>> and EMR-5.0.0 supports Zeppelin 0.6.1.
>>> 
>>> 
>>> 2016-09-07 0:24 GMT+09:00 Hyung Sung Shim <hs...@nflabs.com>:
>>>> Hi.
>>>> Unfortunately Zeppelin 0.5.6 does not support R interpreter.
>>>> Could you upgrade your Zeppelin to higher version? 
>>>> 
>>>> 2016-09-06 23:53 GMT+09:00 Mark Mikolajczak - 07855 306 064 <ma...@flayranalytics.co.uk>:
>>>>> Hi All,
>>>>> 
>>>>> I am trying to setup the R interpreter to run in Zeppelin which is currently running on EMR. Zeppelin is working perfectly and I am able to write script in Scala and Python. When I use %r, %sparkR or %knitr I receive an error : "r interpreter not found"
>>>>> 
>>>>> The applications which I have running in my emr-4.7.2 cluster are: Hive 1.0.0, Zeppelin-Sandbox 0.5.6, Spark 1.6.2, Pig 0.14.0
>>>>> 
>>>>> Within the interpreter there is no mention of R so figure I am missing something but do not know what.
>>>>> 
>>>>> Any pointers greatly appreciated.

Re: Running R on Zeppelin EMR Cluster

Posted by Jonathan Kelly <jo...@gmail.com>.
Mark,

I see in the couchbase-spark-connector Github project that they have
already upgraded to Spark 2.0 (
https://github.com/couchbase/couchbase-spark-connector/pull/9) but that
this change has not yet been released into a new version. According to the
discussion on that pull request, it sounds like they are hoping for a new
version this month.

As for using the R interpreter on emr-5.0.0, unfortunately EMR does not yet
(officially) support the R interpreter. I expect that we (I'm from EMR,
btw) would be able to support it eventually, but I'm unable to give any ETA
on that.

~ Jonathan

On Tue, Sep 6, 2016 at 8:34 AM Mark Mikolajczak - 07855 306 064 <
mark@flayranalytics.co.uk> wrote:

> Thanks I was afraid that was the solution.
>
> I am connecting to a Couchbase database and the connector only supports
> Spark 1.6 and by upgrading I will be using EMR-5.0.0 which seems  to only
> run Spark 2.0…
>
>
> On 6 Sep 2016, at 16:27, Hyung Sung Shim <hs...@nflabs.com> wrote:
>
> and EMR-5.0.0 supports Zeppelin 0.6.1.
>
>
> 2016-09-07 0:24 GMT+09:00 Hyung Sung Shim <hs...@nflabs.com>:
>
>> Hi.
>> Unfortunately Zeppelin 0.5.6 does not support R interpreter.
>> Could you upgrade your Zeppelin to higher version?
>>
>> 2016-09-06 23:53 GMT+09:00 Mark Mikolajczak - 07855 306 064 <
>> mark@flayranalytics.co.uk>:
>>
>>> Hi All,
>>>
>>> I am trying to setup the R interpreter to run in Zeppelin which is
>>> currently running on EMR. Zeppelin is working perfectly and I am able to
>>> write script in Scala and Python. When I use %r, %sparkR or %knitr I
>>> receive an error : "r interpreter not found"
>>>
>>> The applications which I have running in my emr-4.7.2 cluster are: Hive
>>> 1.0.0, Zeppelin-Sandbox 0.5.6, Spark 1.6.2, Pig 0.14.0
>>>
>>> Within the interpreter there is no mention of R so figure I am missing
>>> something but do not know what.
>>>
>>> Any pointers greatly appreciated.
>>>
>>
>>
>
>

Re: Running R on Zeppelin EMR Cluster

Posted by Mark Mikolajczak - 07855 306 064 <ma...@flayranalytics.co.uk>.
Thanks I was afraid that was the solution.

I am connecting to a Couchbase database and the connector only supports Spark 1.6 and by upgrading I will be using EMR-5.0.0 which seems  to only run Spark 2.0…
 

> On 6 Sep 2016, at 16:27, Hyung Sung Shim <hs...@nflabs.com> wrote:
> 
> and EMR-5.0.0 supports Zeppelin 0.6.1.
> 
> 
> 2016-09-07 0:24 GMT+09:00 Hyung Sung Shim <hsshim@nflabs.com <ma...@nflabs.com>>:
> Hi.
> Unfortunately Zeppelin 0.5.6 does not support R interpreter.
> Could you upgrade your Zeppelin to higher version? 
> 
> 2016-09-06 23:53 GMT+09:00 Mark Mikolajczak - 07855 306 064 <mark@flayranalytics.co.uk <ma...@flayranalytics.co.uk>>:
> Hi All,
> 
> I am trying to setup the R interpreter to run in Zeppelin which is currently running on EMR. Zeppelin is working perfectly and I am able to write script in Scala and Python. When I use %r, %sparkR or %knitr I receive an error : "r interpreter not found"
> 
> The applications which I have running in my emr-4.7.2 cluster are: Hive 1.0.0, Zeppelin-Sandbox 0.5.6, Spark 1.6.2, Pig 0.14.0
> 
> Within the interpreter there is no mention of R so figure I am missing something but do not know what.
> 
> Any pointers greatly appreciated.
> 
> 
> 


Re: Running R on Zeppelin EMR Cluster

Posted by Hyung Sung Shim <hs...@nflabs.com>.
and EMR-5.0.0 supports Zeppelin 0.6.1.


2016-09-07 0:24 GMT+09:00 Hyung Sung Shim <hs...@nflabs.com>:

> Hi.
> Unfortunately Zeppelin 0.5.6 does not support R interpreter.
> Could you upgrade your Zeppelin to higher version?
>
> 2016-09-06 23:53 GMT+09:00 Mark Mikolajczak - 07855 306 064 <
> mark@flayranalytics.co.uk>:
>
>> Hi All,
>>
>> I am trying to setup the R interpreter to run in Zeppelin which is
>> currently running on EMR. Zeppelin is working perfectly and I am able to
>> write script in Scala and Python. When I use %r, %sparkR or %knitr I
>> receive an error : "r interpreter not found"
>>
>> The applications which I have running in my emr-4.7.2 cluster are: Hive
>> 1.0.0, Zeppelin-Sandbox 0.5.6, Spark 1.6.2, Pig 0.14.0
>>
>> Within the interpreter there is no mention of R so figure I am missing
>> something but do not know what.
>>
>> Any pointers greatly appreciated.
>>
>
>

Re: Running R on Zeppelin EMR Cluster

Posted by Hyung Sung Shim <hs...@nflabs.com>.
Hi.
Unfortunately Zeppelin 0.5.6 does not support R interpreter.
Could you upgrade your Zeppelin to higher version?

2016-09-06 23:53 GMT+09:00 Mark Mikolajczak - 07855 306 064 <
mark@flayranalytics.co.uk>:

> Hi All,
>
> I am trying to setup the R interpreter to run in Zeppelin which is
> currently running on EMR. Zeppelin is working perfectly and I am able to
> write script in Scala and Python. When I use %r, %sparkR or %knitr I
> receive an error : "r interpreter not found"
>
> The applications which I have running in my emr-4.7.2 cluster are: Hive
> 1.0.0, Zeppelin-Sandbox 0.5.6, Spark 1.6.2, Pig 0.14.0
>
> Within the interpreter there is no mention of R so figure I am missing
> something but do not know what.
>
> Any pointers greatly appreciated.
>