Taskmanager with multiple slots vs running multiple taskmanagers with 1 slot each

["au.fp2018" <au...@gmail.com>]

Hi All,

As the subject indicates, what is the general consensus and best practices
around running 1 taskmanger with multiple slots vs running multiple
taskmanager each with 1 slot?

What is your reason for you picking one over the other?

Thanks,
Andre




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Taskmanager with multiple slots vs running multiple taskmanagers with 1 slot each

[Kostas Kloudas <k....@data-artisans.com>]

Hi Andre,

I cannot speak on behalf of everyone but I would recommend 1 TM with multiple slots.
This way you pay the “fixed costs” of running a TM (like allocating memory for network buffers,
launching thread pools, exchanging heartbeat messages etc) only once.

On the flip-side, this means that you have less isolation among the tasks running on the different 
slots, as one misbehaving task can bring down the TM. But flink will take care of restarting the 
running tasks on another TM.

I hope this helps,
Kostas

> On May 8, 2018, at 12:17 AM, au.fp2018 <au...@gmail.com> wrote:
> 
> Hi All,
> 
> As the subject indicates, what is the general consensus and best practices
> around running 1 taskmanger with multiple slots vs running multiple
> taskmanager each with 1 slot?
> 
> What is your reason for you picking one over the other?
> 
> Thanks,
> Andre
> 
> 
> 
> 
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/