You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Reynold Xin <rx...@databricks.com> on 2015/04/01 09:11:19 UTC
Spark 2.0: Rearchitecting Spark for Mobile, Local, Social
Hi Spark devs,
I've spent the last few months investigating the feasibility of
re-architecting Spark for mobile platforms, considering the growing
population of Android/iOS users. I'm happy to share with you my findings at
https://issues.apache.org/jira/browse/SPARK-6646
The tl;dr is that we should support running Spark on Android/iOS, and the
best way to do this at the moment is to use Scala.js to compile Spark code
into JavaScript, and then run it in Safari or Chrome (and even node.js
potentially for servers).
If you are on your phones right now and prefer reading a blog post rather
than a PDF file, you can read more about the design doc at
https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html
This is done in collaboration with TD, Xiangrui, Patrick. Look forward to
your feedback!
Re: Spark 2.0: Rearchitecting Spark for Mobile, Local, Social
Posted by Burak Yavuz <br...@gmail.com>.
This is awesome! I can write the apps for it, to make the Web UI more
functional!
On Wed, Apr 1, 2015 at 12:37 AM, Tathagata Das <ta...@gmail.com>
wrote:
> This is a significant effort that Reynold has undertaken, and I am super
> glad to see that it's finally taking a concrete form. Would love to see
> what the community thinks about the idea.
>
> TD
>
> On Wed, Apr 1, 2015 at 3:11 AM, Reynold Xin <rx...@databricks.com> wrote:
>
> > Hi Spark devs,
> >
> > I've spent the last few months investigating the feasibility of
> > re-architecting Spark for mobile platforms, considering the growing
> > population of Android/iOS users. I'm happy to share with you my findings
> at
> > https://issues.apache.org/jira/browse/SPARK-6646
> >
> > The tl;dr is that we should support running Spark on Android/iOS, and the
> > best way to do this at the moment is to use Scala.js to compile Spark
> code
> > into JavaScript, and then run it in Safari or Chrome (and even node.js
> > potentially for servers).
> >
> > If you are on your phones right now and prefer reading a blog post rather
> > than a PDF file, you can read more about the design doc at
> >
> >
> https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html
> >
> >
> > This is done in collaboration with TD, Xiangrui, Patrick. Look forward to
> > your feedback!
> >
>
Re: Spark 2.0: Rearchitecting Spark for Mobile, Local, Social
Posted by Tathagata Das <ta...@gmail.com>.
This is a significant effort that Reynold has undertaken, and I am super
glad to see that it's finally taking a concrete form. Would love to see
what the community thinks about the idea.
TD
On Wed, Apr 1, 2015 at 3:11 AM, Reynold Xin <rx...@databricks.com> wrote:
> Hi Spark devs,
>
> I've spent the last few months investigating the feasibility of
> re-architecting Spark for mobile platforms, considering the growing
> population of Android/iOS users. I'm happy to share with you my findings at
> https://issues.apache.org/jira/browse/SPARK-6646
>
> The tl;dr is that we should support running Spark on Android/iOS, and the
> best way to do this at the moment is to use Scala.js to compile Spark code
> into JavaScript, and then run it in Safari or Chrome (and even node.js
> potentially for servers).
>
> If you are on your phones right now and prefer reading a blog post rather
> than a PDF file, you can read more about the design doc at
>
> https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html
>
>
> This is done in collaboration with TD, Xiangrui, Patrick. Look forward to
> your feedback!
>
Re: Spark 2.0: Rearchitecting Spark for Mobile, Local, Social
Posted by Kushal Datta <ku...@gmail.com>.
Reynold, what's the idea behind using LLVM?
On Wed, Apr 1, 2015 at 12:31 AM, Akhil Das <ak...@sigmoidanalytics.com>
wrote:
> Nice try :)
>
> Thanks
> Best Regards
>
> On Wed, Apr 1, 2015 at 12:41 PM, Reynold Xin <rx...@databricks.com> wrote:
>
> > Hi Spark devs,
> >
> > I've spent the last few months investigating the feasibility of
> > re-architecting Spark for mobile platforms, considering the growing
> > population of Android/iOS users. I'm happy to share with you my findings
> at
> > https://issues.apache.org/jira/browse/SPARK-6646
> >
> > The tl;dr is that we should support running Spark on Android/iOS, and the
> > best way to do this at the moment is to use Scala.js to compile Spark
> code
> > into JavaScript, and then run it in Safari or Chrome (and even node.js
> > potentially for servers).
> >
> > If you are on your phones right now and prefer reading a blog post rather
> > than a PDF file, you can read more about the design doc at
> >
> >
> https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html
> >
> >
> > This is done in collaboration with TD, Xiangrui, Patrick. Look forward to
> > your feedback!
> >
>
Re: Spark 2.0: Rearchitecting Spark for Mobile, Local, Social
Posted by Akhil Das <ak...@sigmoidanalytics.com>.
Nice try :)
Thanks
Best Regards
On Wed, Apr 1, 2015 at 12:41 PM, Reynold Xin <rx...@databricks.com> wrote:
> Hi Spark devs,
>
> I've spent the last few months investigating the feasibility of
> re-architecting Spark for mobile platforms, considering the growing
> population of Android/iOS users. I'm happy to share with you my findings at
> https://issues.apache.org/jira/browse/SPARK-6646
>
> The tl;dr is that we should support running Spark on Android/iOS, and the
> best way to do this at the moment is to use Scala.js to compile Spark code
> into JavaScript, and then run it in Safari or Chrome (and even node.js
> potentially for servers).
>
> If you are on your phones right now and prefer reading a blog post rather
> than a PDF file, you can read more about the design doc at
>
> https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html
>
>
> This is done in collaboration with TD, Xiangrui, Patrick. Look forward to
> your feedback!
>