You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Ishwara Varnasi <iv...@gmail.com> on 2018/02/07 04:06:24 UTC

Maximizing resource allocation in EMR (EC2)

Hello, my question is regarding running Flink (streaming) on EMR. How do I
maximize resource allocation? For example, how do I allocate optimal number
of yarn job managers, slots, heap sizes etc given EC2 instance types I'll
be using in EMR? I see that (by trial/error) I'm able to allocate just two
third of available memory to yarn. Thanks for any suggestions.
thanks
Ishwara Varnasi