You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by upendra 1991 <up...@yahoo.com.INVALID> on 2017/05/18 02:22:14 UTC
Jupyter spark Scala notebooks
What's the best way to use jupyter with Scala spark. I tried Apache toree and created a kernel but did not get it working. I believe there is a better way.
Please suggest any best practices.
Sent from Yahoo Mail on Android
Re: Jupyter spark Scala notebooks
Posted by Kun Liu <li...@gmail.com>.
What is the problem here?
To use Toree there are some step ups.
Best,
On Wed, May 17, 2017 at 7:22 PM, upendra 1991 <upendra1991@yahoo.com.invalid
> wrote:
> What's the best way to use jupyter with Scala spark. I tried Apache toree
> and created a kernel but did not get it working. I believe there is a
> better way.
>
> Please suggest any best practices.
>
> Sent from Yahoo Mail on Android
> <https://overview.mail.yahoo.com/mobile/?.src=Android>
>
Re: Jupyter spark Scala notebooks
Posted by Mark Vervuurt <m....@gmail.com>.
Hi Upendra,
I got toree to work and I described it in the following JIRA issue.
See the last comment of the issue.
https://issues.apache.org/jira/browse/TOREE-336 <https://issues.apache.org/jira/browse/TOREE-336>
Mark
> On 18 May 2017, at 04:22, upendra 1991 <up...@yahoo.com.INVALID> wrote:
>
> What's the best way to use jupyter with Scala spark. I tried Apache toree and created a kernel but did not get it working. I believe there is a better way.
>
> Please suggest any best practices.
>
> Sent from Yahoo Mail on Android <https://overview.mail.yahoo.com/mobile/?.src=Android>
Re: Jupyter spark Scala notebooks
Posted by ka...@gmail.com.
Which of these notebooks can help populate real time graphs through web socket or some sort of push mechanism?
Sent from my iPhone
> On May 17, 2017, at 8:50 PM, Stephen Boesch <ja...@gmail.com> wrote:
>
> Jupyter with toree works well for my team. Jupyter is well more refined vs zeppelin as far as notebook features and usability: shortcuts, editing,etc. The caveat is it is better to run a separate server instanace for python/pyspark vs scala/spark
>
> 2017-05-17 19:27 GMT-07:00 Richard Moorhead <ri...@c2fo.com>:
>> Take a look at Apache Zeppelin; it has both python and scala interpreters.
>> https://zeppelin.apache.org/
>>
>> Apache Zeppelin
>> zeppelin.apache.org
>> Apache Zeppelin. A web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL ...
>>
>>
>>
>>
>> . . . . . . . . . . . . . . . . . . . . . . . . . . .
>>
>> Richard Moorhead
>> Software Engineer
>> richard.moorhead@c2fo.com
>> C2FO: The World's Market for Working Capital®
>>
>> The information contained in this message and any attachment may be privileged, confidential, and protected from disclosure. If you are not the intended recipient, or an employee, or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting from your computer.
>>
>>
>> From: upendra 1991 <up...@yahoo.com.INVALID>
>> Sent: Wednesday, May 17, 2017 9:22:14 PM
>> To: user@spark.apache.org
>> Subject: Jupyter spark Scala notebooks
>>
>> What's the best way to use jupyter with Scala spark. I tried Apache toree and created a kernel but did not get it working. I believe there is a better way.
>>
>> Please suggest any best practices.
>>
>> Sent from Yahoo Mail on Android
>
Re: Jupyter spark Scala notebooks
Posted by Stephen Boesch <ja...@gmail.com>.
Jupyter with toree works well for my team. Jupyter is well more refined vs
zeppelin as far as notebook features and usability: shortcuts, editing,etc.
The caveat is it is better to run a separate server instanace for
python/pyspark vs scala/spark
2017-05-17 19:27 GMT-07:00 Richard Moorhead <ri...@c2fo.com>:
> Take a look at Apache Zeppelin; it has both python and scala interpreters.
> https://zeppelin.apache.org/
> Apache Zeppelin <https://zeppelin.apache.org/>
> zeppelin.apache.org
> Apache Zeppelin. A web-based notebook that enables interactive data
> analytics. You can make beautiful data-driven, interactive and
> collaborative documents with SQL ...
>
>
>
>
> . . . . . . . . . . . . . . . . . . . . . . . . . . .
>
> Richard Moorhead
> Software Engineer
> richard.moorhead@c2fo.com <ri...@gmail.com>
>
> C2FO: The World's Market for Working Capital®
>
>
> <https://www.linkedin.com/company/c2fo?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A125658601427902817660%2CVSRPtargetId%3A1555109%2CVSRPcmpt%3Aprimary>
> <https://www.youtube.com/c/C2FOMarket> <https://twitter.com/C2FO>
> <https://plus.google.com/+C2foMarket/posts>
> <https://www.facebook.com/C2FOMarketplace>
> <https://c2fo.com/media-coverage/c2fo-included-forbes-fintech-50>
>
> The information contained in this message and any attachment may be
> privileged, confidential, and protected from disclosure. If you are not the
> intended recipient, or an employee, or agent responsible for delivering
> this message to the intended recipient, you are hereby notified that any
> dissemination, distribution, or copying of this communication is strictly
> prohibited. If you have received this communication in error, please notify
> us immediately by replying to the message and deleting from your computer.
>
> ------------------------------
> *From:* upendra 1991 <up...@yahoo.com.INVALID>
> *Sent:* Wednesday, May 17, 2017 9:22:14 PM
> *To:* user@spark.apache.org
> *Subject:* Jupyter spark Scala notebooks
>
> What's the best way to use jupyter with Scala spark. I tried Apache toree
> and created a kernel but did not get it working. I believe there is a
> better way.
>
> Please suggest any best practices.
>
> Sent from Yahoo Mail on Android
> <https://overview.mail.yahoo.com/mobile/?.src=Android>
>
Re: Jupyter spark Scala notebooks
Posted by Richard Moorhead <ri...@c2fo.com>.
Take a look at Apache Zeppelin; it has both python and scala interpreters.
https://zeppelin.apache.org/
Apache Zeppelin<https://zeppelin.apache.org/>
zeppelin.apache.org
Apache Zeppelin. A web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL ...
. . . . . . . . . . . . . . . . . . . . . . . . . . .
Richard Moorhead
Software Engineer
richard.moorhead@c2fo.com<ma...@gmail.com>
C2FO: The World's Market for Working Capital®
[http://c2fo.com/wp-content/uploads/sites/1/2016/03/LinkedIN.png] <https://www.linkedin.com/company/c2fo?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A125658601427902817660%2CVSRPtargetId%3A1555109%2CVSRPcmpt%3Aprimary> [http://c2fo.com/wp-content/uploads/sites/1/2016/03/YouTube.png] <https://www.youtube.com/c/C2FOMarket> [http://c2fo.com/wp-content/uploads/sites/1/2016/03/Twitter.png] <https://twitter.com/C2FO> [http://c2fo.com/wp-content/uploads/sites/1/2016/03/Googleplus.png] <https://plus.google.com/+C2foMarket/posts> [http://c2fo.com/wp-content/uploads/sites/1/2016/03/Facebook.png] <https://www.facebook.com/C2FOMarketplace> [http://c2fo.com/wp-content/uploads/sites/1/2016/03/Forbes-Fintech-50.png] <https://c2fo.com/media-coverage/c2fo-included-forbes-fintech-50>
The information contained in this message and any attachment may be privileged, confidential, and protected from disclosure. If you are not the intended recipient, or an employee, or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting from your computer.
________________________________
From: upendra 1991 <up...@yahoo.com.INVALID>
Sent: Wednesday, May 17, 2017 9:22:14 PM
To: user@spark.apache.org
Subject: Jupyter spark Scala notebooks
What's the best way to use jupyter with Scala spark. I tried Apache toree and created a kernel but did not get it working. I believe there is a better way.
Please suggest any best practices.
Sent from Yahoo Mail on Android<https://overview.mail.yahoo.com/mobile/?.src=Android>