You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Aakash Basu <aa...@gmail.com> on 2018/06/20 06:18:16 UTC

G1GC vs ParallelGC

Hi guys,

I just wanted to know, why my ParallelGC (*--conf
"spark.executor.extraJavaOptions=-XX:+UseParallelGC"*) in a very long Spark
ML Pipeline works faster than when I set G1GC (*--conf
"spark.executor.extraJavaOptions=-XX:+UseG1GC"*), even though the Spark
community suggests G1GC to be much better than the ParallelGC.

Any pointers?

Thanks,
Aakash.

Re: G1GC vs ParallelGC

Posted by vaquar khan <va...@gmail.com>.

https://databricks.com/blog/2015/05/28/tuning-java-garbage-collection-for-spark-applications.html

Regards,
Vaquar khan

On Wed, Jun 20, 2018, 1:18 AM Aakash Basu <aa...@gmail.com>
wrote:

> Hi guys,
>
> I just wanted to know, why my ParallelGC (*--conf
> "spark.executor.extraJavaOptions=-XX:+UseParallelGC"*) in a very long
> Spark ML Pipeline works faster than when I set G1GC (*--conf
> "spark.executor.extraJavaOptions=-XX:+UseG1GC"*), even though the Spark
> community suggests G1GC to be much better than the ParallelGC.
>
> Any pointers?
>
> Thanks,
> Aakash.
>