You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Justin Steigel <js...@gmail.com> on 2015/06/24 21:30:46 UTC

Spark Python process

I have a spark job that's running on a 10 node cluster and the python
process on all the nodes is pegged at 100%.

I was wondering what parts of a spark script are run in the python process
and which get passed to the Java processes?  Is there any documentation on
this?

Thanks,
Justin