You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Zhijie Shen (JIRA)" <ji...@apache.org> on 2014/03/28 01:51:17 UTC

[jira] [Commented] (SAMZA-58) Use YARN's *Async API

    [ https://issues.apache.org/jira/browse/SAMZA-58?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950221#comment-13950221 ] 

Zhijie Shen commented on SAMZA-58:
----------------------------------

AMRMClientAsync can be used to talk to RM, and YarnAppMaster seems not to need to do while loop to invoke allocate, and the following logic can be moved to CallbackHandler's implementation. Similarly we can use NMClientAsync to replace NMClient. I'd like to work on this issue.

> Use YARN's *Async API
> ---------------------
>
>                 Key: SAMZA-58
>                 URL: https://issues.apache.org/jira/browse/SAMZA-58
>             Project: Samza
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 0.6.0
>            Reporter: Chris Riccomini
>
> YARN 2.2.0 has a nice Async API for clients and AMs. This API didn't exist when we did the initial YARN integration for Samza. We should upgrade Samza to use these new APIs.
> The API is loosely based off Samza's own AM code, so we can probably strip out a lot of it (YarnAppMaster, mainly), and switch everything over to the call-back based API.
> For details, see:
> https://issues.apache.org/jira/browse/YARN-417
> This new API is used in DistributedShell now, so we can use that for testing.



--
This message was sent by Atlassian JIRA
(v6.2#6252)