You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Xintong Song (Jira)" <ji...@apache.org> on 2021/02/24 09:35:00 UTC

[jira] [Created] (FLINK-21480) Respect external resources from resource requirements

Xintong Song created FLINK-21480:
------------------------------------

             Summary: Respect external resources from resource requirements
                 Key: FLINK-21480
                 URL: https://issues.apache.org/jira/browse/FLINK-21480
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
            Reporter: Xintong Song
            Assignee: Yangze Guo


Currently, K8s/Yarn RM reads external resources from configurations and request workers accordingly. That means, all workers will have the same set of external resources.

With the fine-grained resource management allowing TMs with different resources, and applying a strictly matching between requested and registered slot profiles, we need to make sure:
 * Allocate workers respecting external resources specified in the slot resource requirements.
 * Registered / offered slots should contain the same set of external resources as requested.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)