You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Sergiy Matusevych (JIRA)" <ji...@apache.org> on 2017/04/13 22:09:41 UTC

[jira] [Commented] (REEF-1776) Use YARN proxy user to register REEF Driver in Unmanaged AM mode

    [ https://issues.apache.org/jira/browse/REEF-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968311#comment-15968311 ] 

Sergiy Matusevych commented on REEF-1776:
-----------------------------------------

We don't need that feature now, but it may come in handy later -
 either as a nice API to use or as a reference piece of code.

[YARN-5531: UnmanagedAM pool manager for federating application across clusters|https://issues.apache.org/jira/browse/YARN-5531]

> Use YARN proxy user to register REEF Driver in Unmanaged AM mode
> ----------------------------------------------------------------
>
>                 Key: REEF-1776
>                 URL: https://issues.apache.org/jira/browse/REEF-1776
>             Project: REEF
>          Issue Type: Bug
>          Components: REEF Client, REEF Driver, REEF-Runtime-YARN
>            Reporter: Sergiy Matusevych
>            Assignee: Sergiy Matusevych
>              Labels: yarn, yarn-client
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> When launching REEF application in Unmanaged AM mode from another YARN application, two Drivers access the same global object {{UserGroupInformation}} from YARN API. That issue prevents us from running REEF applications on YARN in REEF-on-REEF or REEF-on-Spark settings. We have to implement a mechanism to create proxy YARN users and register Unmanaged AM Drivers in that proxy user context and update the API so that REEF client can pass the user credentials into the driver setup.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)