You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Amit Sharma <re...@gmail.com> on 2019/12/08 22:42:45 UTC

No of cores per executor.

I have set  5 cores per executor. Is there any formula to determine best
combination of executor and cores and memory per core for better
performance. Also when I am running local spark instance in my web jar
getting better speed than running in cluster.



Thanks
Amit

Re: No of cores per executor.

Posted by Samik Raychaudhuri <sa...@gmail.com>.

Hi,
Take a look at this video: 
[https://www.youtube.com/watch?v=daXEp4HmS-E]. Pretty dense, but might 
answer some of your questions.
Thanks.
-Samik

On 09-Dec-19 4:12 AM, Amit Sharma wrote:
> I have set  5 cores per executor. Is there any formula to determine 
> best combination of executor and cores and memory per core for better 
> performance. Also when I am running local spark instance in my web jar 
> getting better speed than running in cluster.
>
>
>
> Thanks
> Amit