You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by N Sa <ne...@gmail.com> on 2017/08/01 04:29:29 UTC
Heap Settings for History Server
Hi folks,
I couldn't find much literature on this so I figured I could ask here.
Does anyone have experience in tuning the memory settings and interval
times of the Spark History Server?
Let's say I have 500 applications at 0.5 G each with a
*spark.history.fs.update.interval* of 400s.
Is there a direct memory correlation that can help me set an optimum value?
Looking for some advice if anyone has tuned the History Server to render
large amounts of applications.
Thanks.
--
Regards,
Neelesh S. Salian