You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Majid Azimi <az...@yahoo.com> on 2014/07/30 20:15:49 UTC

Do I need to know Scala to take full advantage of spark?

Hi guys

I'm very new in spark land comming from old school MapReduce world. I 
have no idea about scala. Does Java/Python API can compete with native 
Scala API? Is Spark heavily scala centric and binding for other 
languages are only for starting up and testing and serious work in spark 
will require scala knowledge?

Re: Do I need to know Scala to take full advantage of spark?

Posted by Matei Zaharia <ma...@gmail.com>.

Java is very close to Scala across the board, the only thing missing in it right now is GraphX (which is still alpha). Python is missing GraphX, streaming and a few of the ML algorithms, though most of them are there. So it should be fine to start with  any of them. See http://spark.apache.org/docs/latest/programming-guide.html for how to use the API in each language.

On July 30, 2014 at 11:16:22 AM, Majid Azimi (azimi.majid@yahoo.com) wrote:

Hi guys  

I'm very new in spark land comming from old school MapReduce world. I  
have no idea about scala. Does Java/Python API can compete with native  
Scala API? Is Spark heavily scala centric and binding for other  
languages are only for starting up and testing and serious work in spark  
will require scala knowledge?