You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by arpit srivastava <ar...@gmail.com> on 2016/05/30 19:44:47 UTC

Flink Yarn Cluster specifying Job Manager IP

Hi,

I have yarn cluster with 7 nodes.

Five nodes  -16gb ram
One node - 8gb ram
One yarn resourcemanager - 8gb

I want to specifically use 8gb machine (not resourcemanager) to act as job
manager and other five nodes as task managers.

Is there a way to do that ?

Re: Flink Yarn Cluster specifying Job Manager IP

Posted by arpit srivastava <ar...@gmail.com>.
Will try and come back with feedback if its possible.

Thanks,
Arpit

On Tue, May 31, 2016 at 12:00 PM, Alexis Gendronneau <
a.gendronneau@gmail.com> wrote:

> Hi Arpit,
>
> I'm not sure of what you tries to do, but if you want yarn to execute a
> type of job on particular nodes, you may find a way using node labels :
>
> https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html
>
> I'm not sure you'll be able to specify that the jobmanager has to be run
> on a specific node, but your flink cluster would run on the 5 or 6 nodes
> you'll provide for your dedicated queue.
> If you manage to do so could you send some feedback about how you did it ?
>
> Regards
>
> 2016-05-30 21:44 GMT+02:00 arpit srivastava <ar...@gmail.com>:
>
>> Hi,
>>
>> I have yarn cluster with 7 nodes.
>>
>> Five nodes  -16gb ram
>> One node - 8gb ram
>> One yarn resourcemanager - 8gb
>>
>> I want to specifically use 8gb machine (not resourcemanager) to act as
>> job manager and other five nodes as task managers.
>>
>> Is there a way to do that ?
>>
>
>
>
> --
> Alexis Gendronneau
>
> alexis.gendronneau@corp.ovh.com
> a.gendronneau@gmail.com
>

Re: Flink Yarn Cluster specifying Job Manager IP

Posted by Alexis Gendronneau <a....@gmail.com>.
Hi Arpit,

I'm not sure of what you tries to do, but if you want yarn to execute a
type of job on particular nodes, you may find a way using node labels :
https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html

I'm not sure you'll be able to specify that the jobmanager has to be run on
a specific node, but your flink cluster would run on the 5 or 6 nodes
you'll provide for your dedicated queue.
If you manage to do so could you send some feedback about how you did it ?

Regards

2016-05-30 21:44 GMT+02:00 arpit srivastava <ar...@gmail.com>:

> Hi,
>
> I have yarn cluster with 7 nodes.
>
> Five nodes  -16gb ram
> One node - 8gb ram
> One yarn resourcemanager - 8gb
>
> I want to specifically use 8gb machine (not resourcemanager) to act as job
> manager and other five nodes as task managers.
>
> Is there a way to do that ?
>



-- 
Alexis Gendronneau

alexis.gendronneau@corp.ovh.com
a.gendronneau@gmail.com