You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "zhangrucong1982 (JIRA)" <ji...@apache.org> on 2017/04/25 01:46:04 UTC

[jira] [Created] (FLINK-6374) In yarn cluster model, the -ys parameter is not take effect.

zhangrucong1982 created FLINK-6374:
--------------------------------------

             Summary: In yarn cluster model, the -ys parameter is not take effect.
                 Key: FLINK-6374
                 URL: https://issues.apache.org/jira/browse/FLINK-6374
             Project: Flink
          Issue Type: Bug
            Reporter: zhangrucong1982


I use the flink version of 1.2.0. I deploy the Flink cluster on the yarn. I have three nodes. Every node has 32GB memory and 16 slots. And the flink
key configuration is :yarn.containers.vcores: 16.
I use two yarn deployment models, but the result is not same.The details are the following:
1、First  I use the flink yarn session model:
1) I start the flink yarn cluster with the command:./yarn-session.sh -n 2 -s 1 -d . 
2)Then I submit a streaming job with the command :  ./flink run -p 3 ../examples/streaming/WindowJoin.jar ;
3) the streaming job deploy failure. The reason is:"Not enough free slots available to run the job. You can decrease the operator parallelism or increase the number of slots per TaskManager in the configuration."
2、The I use the yarn cluster model:
1) I start the yarn cluster and submit a streaming job with command " ./flink run -m yarn-cluster -yn 2 -ys 1 -p 3 ../examples/streaming/WindowJoin.jar "
but, the streaming job is runing;
2) I look at the code, if there is a -p parameter in the command, the -ys parameter is not take effect.

what is the design for -ys parameter?  I think the result of yarn session is reasonable, the yarn cluster is not reasonable. How do you think?





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)