You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Maximilian Michels (JIRA)" <ji...@apache.org> on 2015/12/17 15:21:46 UTC

[jira] [Closed] (FLINK-3134) Make YarnJobManager's allocate call asynchronous

     [ https://issues.apache.org/jira/browse/FLINK-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maximilian Michels closed FLINK-3134.
-------------------------------------
    Resolution: Implemented

4e52fe4304566e5239996b3d48290e0c1f0772e8

> Make YarnJobManager's allocate call asynchronous
> ------------------------------------------------
>
>                 Key: FLINK-3134
>                 URL: https://issues.apache.org/jira/browse/FLINK-3134
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN Client
>    Affects Versions: 0.10.0, 1.0.0, 0.10.1
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>             Fix For: 1.0.0
>
>
> The {{allocate()}} call is used in the {{YarnJobManager}} to send a heartbeat to the YARN resource manager. This call may block the JobManager actor system for arbitrary time, e.g. if retry handlers are set up within the call to allocate.
> I propose to use the {{AMRMClientAsync}}'s callback methods to send heartbeats and update the container information. The API is available for our supported Hadoop versions (2.3.0 and above).
> https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/yarn/client/api/async/AMRMClientAsync.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)