You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Mich Talebzadeh <mi...@gmail.com> on 2016/02/29 19:57:01 UTC
Spark for client
Hi,
Is there such thing as Spark for client much like RDBMS client that have
cut down version of their big brother useful for client connectivity but
cannot be used as server.
Thanks
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
Re: Spark for client
Posted by Todd Nist <ts...@gmail.com>.
You could also look at Apache Toree, http://toree.apache.org/
, github : https://github.com/apache/incubator-toree. This use to be the
Spark Kernel from IBM but has been contributed to Apache.
Good overview here on its features,
http://www.spark.tc/how-to-enable-interactive-applications-against-apache-spark/.
Specifically this section on usage:
Usage
Using the kernel as the backbone of communication, we have enabled several
higher-level applications to interact with Apache Spark:
*->* Livesheets
<https://www.youtube.com/watch?v=2AX6g0tK-us&feature=youtu.be&t=37m42s>, a
line of business tool for data exploration
*->* A RESTful query engine
<https://www.youtube.com/watch?v=2AX6g0tK-us&feature=youtu.be&t=43m10s> running
on top of Spark SQL
*->* A demonstration of a PHP application utilizing Apache Spark
<https://www.youtube.com/watch?v=TD1J7MzYcFo&feature=youtu.be&t=33m19s> at
ZendCon 2014
*->* IPython notebook
<https://www.youtube.com/watch?v=2AX6g0tK-us&feature=youtu.be&t=37m42s> running
the Spark Kernel underneath
HTH.
Todd
On Tue, Mar 1, 2016 at 4:10 AM, Mich Talebzadeh <mi...@gmail.com>
wrote:
> Thanks Mohannad.
>
> Installed Anaconda 3 that contains Jupyter. Now I want to access Spark on
> Scala from Jupyter. What is the easiest way of doing it without using
> Python!
>
> Thanks
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
> On 1 March 2016 at 08:18, Mohannad Ali <ma...@gmail.com> wrote:
>
>> Jupyter (http://jupyter.org/) also supports Spark and generally it's a
>> beast allows you to do so much more.
>> On Mar 1, 2016 00:25, "Mich Talebzadeh" <mi...@gmail.com>
>> wrote:
>>
>>> Thank you very much both
>>>
>>> Zeppelin looks promising. Basically as I understand runs an agent on a
>>> given port (I chose 21999) on the host that Spark is installed. I created a
>>> notebook and running scripts through there. One thing for sure notebook
>>> just returns the results rather all other stuff that one does not need/.
>>>
>>> Cheers,
>>>
>>>
>>>
>>> Dr Mich Talebzadeh
>>>
>>>
>>>
>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>
>>>
>>>
>>> http://talebzadehmich.wordpress.com
>>>
>>>
>>>
>>> On 29 February 2016 at 19:22, Minudika Malshan <mi...@gmail.com>
>>> wrote:
>>>
>>>> +Adding resources
>>>> https://zeppelin.incubator.apache.org/docs/latest/interpreter/spark.html
>>>> https://zeppelin.incubator.apache.org
>>>>
>>>> Minudika Malshan
>>>> Undergraduate
>>>> Department of Computer Science and Engineering
>>>> University of Moratuwa.
>>>> *Mobile : +94715659887 <%2B94715659887>*
>>>> *LinkedIn* : https://lk.linkedin.com/in/minudika
>>>>
>>>>
>>>>
>>>> On Tue, Mar 1, 2016 at 12:51 AM, Minudika Malshan <
>>>> minudika001@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I think zeppelin spark interpreter will give a solution to your
>>>>> problem.
>>>>>
>>>>> Regards.
>>>>> Minudika
>>>>>
>>>>> Minudika Malshan
>>>>> Undergraduate
>>>>> Department of Computer Science and Engineering
>>>>> University of Moratuwa.
>>>>> *Mobile : +94715659887 <%2B94715659887>*
>>>>> *LinkedIn* : https://lk.linkedin.com/in/minudika
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Mar 1, 2016 at 12:35 AM, Sabarish Sasidharan <
>>>>> sabarish.sasidharan@manthan.com> wrote:
>>>>>
>>>>>> Zeppelin?
>>>>>>
>>>>>> Regards
>>>>>> Sab
>>>>>> On 01-Mar-2016 12:27 am, "Mich Talebzadeh" <mi...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Is there such thing as Spark for client much like RDBMS client that
>>>>>>> have cut down version of their big brother useful for client connectivity
>>>>>>> but cannot be used as server.
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>>
>>>>>>> Dr Mich Talebzadeh
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>>>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> http://talebzadehmich.wordpress.com
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>
Re: Spark for client
Posted by Mich Talebzadeh <mi...@gmail.com>.
Thanks Mohannad.
Installed Anaconda 3 that contains Jupyter. Now I want to access Spark on
Scala from Jupyter. What is the easiest way of doing it without using
Python!
Thanks
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
On 1 March 2016 at 08:18, Mohannad Ali <ma...@gmail.com> wrote:
> Jupyter (http://jupyter.org/) also supports Spark and generally it's a
> beast allows you to do so much more.
> On Mar 1, 2016 00:25, "Mich Talebzadeh" <mi...@gmail.com> wrote:
>
>> Thank you very much both
>>
>> Zeppelin looks promising. Basically as I understand runs an agent on a
>> given port (I chose 21999) on the host that Spark is installed. I created a
>> notebook and running scripts through there. One thing for sure notebook
>> just returns the results rather all other stuff that one does not need/.
>>
>> Cheers,
>>
>>
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>> On 29 February 2016 at 19:22, Minudika Malshan <mi...@gmail.com>
>> wrote:
>>
>>> +Adding resources
>>> https://zeppelin.incubator.apache.org/docs/latest/interpreter/spark.html
>>> https://zeppelin.incubator.apache.org
>>>
>>> Minudika Malshan
>>> Undergraduate
>>> Department of Computer Science and Engineering
>>> University of Moratuwa.
>>> *Mobile : +94715659887 <%2B94715659887>*
>>> *LinkedIn* : https://lk.linkedin.com/in/minudika
>>>
>>>
>>>
>>> On Tue, Mar 1, 2016 at 12:51 AM, Minudika Malshan <minudika001@gmail.com
>>> > wrote:
>>>
>>>> Hi,
>>>>
>>>> I think zeppelin spark interpreter will give a solution to your
>>>> problem.
>>>>
>>>> Regards.
>>>> Minudika
>>>>
>>>> Minudika Malshan
>>>> Undergraduate
>>>> Department of Computer Science and Engineering
>>>> University of Moratuwa.
>>>> *Mobile : +94715659887 <%2B94715659887>*
>>>> *LinkedIn* : https://lk.linkedin.com/in/minudika
>>>>
>>>>
>>>>
>>>> On Tue, Mar 1, 2016 at 12:35 AM, Sabarish Sasidharan <
>>>> sabarish.sasidharan@manthan.com> wrote:
>>>>
>>>>> Zeppelin?
>>>>>
>>>>> Regards
>>>>> Sab
>>>>> On 01-Mar-2016 12:27 am, "Mich Talebzadeh" <mi...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Is there such thing as Spark for client much like RDBMS client that
>>>>>> have cut down version of their big brother useful for client connectivity
>>>>>> but cannot be used as server.
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>>
>>>>>> Dr Mich Talebzadeh
>>>>>>
>>>>>>
>>>>>>
>>>>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>>>
>>>>>>
>>>>>>
>>>>>> http://talebzadehmich.wordpress.com
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
Re: Spark for client
Posted by Mohannad Ali <ma...@gmail.com>.
Jupyter (http://jupyter.org/) also supports Spark and generally it's a
beast allows you to do so much more.
On Mar 1, 2016 00:25, "Mich Talebzadeh" <mi...@gmail.com> wrote:
> Thank you very much both
>
> Zeppelin looks promising. Basically as I understand runs an agent on a
> given port (I chose 21999) on the host that Spark is installed. I created a
> notebook and running scripts through there. One thing for sure notebook
> just returns the results rather all other stuff that one does not need/.
>
> Cheers,
>
>
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
> On 29 February 2016 at 19:22, Minudika Malshan <mi...@gmail.com>
> wrote:
>
>> +Adding resources
>> https://zeppelin.incubator.apache.org/docs/latest/interpreter/spark.html
>> https://zeppelin.incubator.apache.org
>>
>> Minudika Malshan
>> Undergraduate
>> Department of Computer Science and Engineering
>> University of Moratuwa.
>> *Mobile : +94715659887 <%2B94715659887>*
>> *LinkedIn* : https://lk.linkedin.com/in/minudika
>>
>>
>>
>> On Tue, Mar 1, 2016 at 12:51 AM, Minudika Malshan <mi...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I think zeppelin spark interpreter will give a solution to your problem.
>>>
>>> Regards.
>>> Minudika
>>>
>>> Minudika Malshan
>>> Undergraduate
>>> Department of Computer Science and Engineering
>>> University of Moratuwa.
>>> *Mobile : +94715659887 <%2B94715659887>*
>>> *LinkedIn* : https://lk.linkedin.com/in/minudika
>>>
>>>
>>>
>>> On Tue, Mar 1, 2016 at 12:35 AM, Sabarish Sasidharan <
>>> sabarish.sasidharan@manthan.com> wrote:
>>>
>>>> Zeppelin?
>>>>
>>>> Regards
>>>> Sab
>>>> On 01-Mar-2016 12:27 am, "Mich Talebzadeh" <mi...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Is there such thing as Spark for client much like RDBMS client that
>>>>> have cut down version of their big brother useful for client connectivity
>>>>> but cannot be used as server.
>>>>>
>>>>> Thanks
>>>>>
>>>>>
>>>>> Dr Mich Talebzadeh
>>>>>
>>>>>
>>>>>
>>>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>>
>>>>>
>>>>>
>>>>> http://talebzadehmich.wordpress.com
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Spark for client
Posted by Mich Talebzadeh <mi...@gmail.com>.
Thank you very much both
Zeppelin looks promising. Basically as I understand runs an agent on a
given port (I chose 21999) on the host that Spark is installed. I created a
notebook and running scripts through there. One thing for sure notebook
just returns the results rather all other stuff that one does not need/.
Cheers,
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
On 29 February 2016 at 19:22, Minudika Malshan <mi...@gmail.com>
wrote:
> +Adding resources
> https://zeppelin.incubator.apache.org/docs/latest/interpreter/spark.html
> https://zeppelin.incubator.apache.org
>
> Minudika Malshan
> Undergraduate
> Department of Computer Science and Engineering
> University of Moratuwa.
> *Mobile : +94715659887 <%2B94715659887>*
> *LinkedIn* : https://lk.linkedin.com/in/minudika
>
>
>
> On Tue, Mar 1, 2016 at 12:51 AM, Minudika Malshan <mi...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I think zeppelin spark interpreter will give a solution to your problem.
>>
>> Regards.
>> Minudika
>>
>> Minudika Malshan
>> Undergraduate
>> Department of Computer Science and Engineering
>> University of Moratuwa.
>> *Mobile : +94715659887 <%2B94715659887>*
>> *LinkedIn* : https://lk.linkedin.com/in/minudika
>>
>>
>>
>> On Tue, Mar 1, 2016 at 12:35 AM, Sabarish Sasidharan <
>> sabarish.sasidharan@manthan.com> wrote:
>>
>>> Zeppelin?
>>>
>>> Regards
>>> Sab
>>> On 01-Mar-2016 12:27 am, "Mich Talebzadeh" <mi...@gmail.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> Is there such thing as Spark for client much like RDBMS client that
>>>> have cut down version of their big brother useful for client connectivity
>>>> but cannot be used as server.
>>>>
>>>> Thanks
>>>>
>>>>
>>>> Dr Mich Talebzadeh
>>>>
>>>>
>>>>
>>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>
>>>>
>>>>
>>>> http://talebzadehmich.wordpress.com
>>>>
>>>>
>>>>
>>>
>>
>
Re: Spark for client
Posted by Minudika Malshan <mi...@gmail.com>.
+Adding resources
https://zeppelin.incubator.apache.org/docs/latest/interpreter/spark.html
https://zeppelin.incubator.apache.org
Minudika Malshan
Undergraduate
Department of Computer Science and Engineering
University of Moratuwa.
*Mobile : +94715659887*
*LinkedIn* : https://lk.linkedin.com/in/minudika
On Tue, Mar 1, 2016 at 12:51 AM, Minudika Malshan <mi...@gmail.com>
wrote:
> Hi,
>
> I think zeppelin spark interpreter will give a solution to your problem.
>
> Regards.
> Minudika
>
> Minudika Malshan
> Undergraduate
> Department of Computer Science and Engineering
> University of Moratuwa.
> *Mobile : +94715659887 <%2B94715659887>*
> *LinkedIn* : https://lk.linkedin.com/in/minudika
>
>
>
> On Tue, Mar 1, 2016 at 12:35 AM, Sabarish Sasidharan <
> sabarish.sasidharan@manthan.com> wrote:
>
>> Zeppelin?
>>
>> Regards
>> Sab
>> On 01-Mar-2016 12:27 am, "Mich Talebzadeh" <mi...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> Is there such thing as Spark for client much like RDBMS client that have
>>> cut down version of their big brother useful for client connectivity but
>>> cannot be used as server.
>>>
>>> Thanks
>>>
>>>
>>> Dr Mich Talebzadeh
>>>
>>>
>>>
>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>
>>>
>>>
>>> http://talebzadehmich.wordpress.com
>>>
>>>
>>>
>>
>
Re: Spark for client
Posted by Minudika Malshan <mi...@gmail.com>.
Hi,
I think zeppelin spark interpreter will give a solution to your problem.
Regards.
Minudika
Minudika Malshan
Undergraduate
Department of Computer Science and Engineering
University of Moratuwa.
*Mobile : +94715659887*
*LinkedIn* : https://lk.linkedin.com/in/minudika
On Tue, Mar 1, 2016 at 12:35 AM, Sabarish Sasidharan <
sabarish.sasidharan@manthan.com> wrote:
> Zeppelin?
>
> Regards
> Sab
> On 01-Mar-2016 12:27 am, "Mich Talebzadeh" <mi...@gmail.com>
> wrote:
>
>> Hi,
>>
>> Is there such thing as Spark for client much like RDBMS client that have
>> cut down version of their big brother useful for client connectivity but
>> cannot be used as server.
>>
>> Thanks
>>
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>
Re: Spark for client
Posted by Sabarish Sasidharan <sa...@manthan.com>.
Zeppelin?
Regards
Sab
On 01-Mar-2016 12:27 am, "Mich Talebzadeh" <mi...@gmail.com>
wrote:
> Hi,
>
> Is there such thing as Spark for client much like RDBMS client that have
> cut down version of their big brother useful for client connectivity but
> cannot be used as server.
>
> Thanks
>
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>