You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Andrey Dudin <du...@gmail.com> on 2019/03/01 13:24:38 UTC

spark.python.worker.memory VS spark.executor.pyspark.memory

Hello all.

What is the difference between spark.python.worker.memory and
spark.executor.pyspark.memory?

Re: spark.python.worker.memory VS spark.executor.pyspark.memory

Posted by Xiao Li <li...@databricks.com>.

Check the discussion in
https://github.com/apache/spark/pull/21977#issuecomment-455577998 ?

Xiao

On Fri, Mar 1, 2019 at 5:25 AM Andrey Dudin <du...@gmail.com> wrote:

> Hello all.
>
> What is the difference between spark.python.worker.memory and
> spark.executor.pyspark.memory?
>
>
>

-- 
[image:
https://databricks.com/sparkaisummit/north-america?utm_source=email&utm_medium=signature]