You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Hichame El Khalfi <hi...@elkhalfi.com> on 2018/08/09 17:25:44 UTC

Kryoserializer with pyspark

Hello there !!!

Is there any benefit from tuning `spark.kryoserializer.buffer` and `spark.kryoserializer.buffer.max` if we just use pyspark wth no Java or Scala classes ?

Thanks for your help,

Hichame