You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "xuekang (JIRA)" <ji...@apache.org> on 2019/08/14 04:23:00 UTC

[jira] [Created] (FLINK-13707) Make max parallelism configurable

xuekang created FLINK-13707:
-------------------------------

             Summary: Make  max parallelism configurable
                 Key: FLINK-13707
                 URL: https://issues.apache.org/jira/browse/FLINK-13707
             Project: Flink
          Issue Type: New Feature
          Components: API / DataStream
            Reporter: xuekang


For now, if a user set parallelism larger than 128, and does not set max parallelism explicitly, the system will compute a max parallelism, which is 1.5 * parallelism.  When the job changes the parallelism and recover from a savepoint, there may be some problem when restoring states from the savepoint, as the number of key groups changed.

To avoid this problem, and trying not to modify the code of existing jobs,  we want to configure the default max parallelism in flink-conf.yaml, but it is not configurable now.

Should we make it configurable? Any comments would be appreciated.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)