You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Nirav Patel <np...@xactlycorp.com> on 2017/06/30 01:50:19 UTC

Project tungsten phase2 - SIMD and columnar in-memory storage

I read following future optimizations in Tungsten on databricks site.
https://databricks.com/blog/2015/04/28/project-tungsten-bringing-spark-closer-to-bare-metal.html

"There are also a handful of longer term possibilities for Tungsten. In
particular, we plan to investigate compilation to LLVM or OpenCL, so Spark
applications can leverage SSE/SIMD instructions out of modern CPUs and the
wide parallelism in GPUs to speed up operations in machine learning and
graph computation."

Are these optimization part of spark 2.x or on roadmap?

Thanks

-- 


[image: What's New with Xactly] <http://www.xactlycorp.com/email-click/>

<https://www.nyse.com/quote/XNYS:XTLY>  [image: LinkedIn] 
<https://www.linkedin.com/company/xactly-corporation>  [image: Twitter] 
<https://twitter.com/Xactly>  [image: Facebook] 
<https://www.facebook.com/XactlyCorp>  [image: YouTube] 
<http://www.youtube.com/xactlycorporation>