[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

["Bikas Saha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098802#comment-14098802 ] 

Bikas Saha commented on TEZ-1338:
---------------------------------

FrameworkClient should probably have a refcounter to ensure that stop() takes effect only after all users have called stop(). Each new user can call start() to ensure that it acquires a reference. The first start() can start the real connection. We probably have this issue in the current patch but because localclient.stop() is empty it does not matter.
I think if we make the above fix, then both local and non-local clients could be shared between TezClient and DAGClient. The local vs non-local check would not be necessary. Later we can make an extension that allows the last refcounted user to actually shutdown the session. This way we dont need to keep tezclient alive until all the processing is complete. Only the DAGClient needs to stay alive - which seems natural.

> Support submission of multiple applications with LocalRunner from within the same JVM
> -------------------------------------------------------------------------------------
>
>                 Key: TEZ-1338
>                 URL: https://issues.apache.org/jira/browse/TEZ-1338
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>            Priority: Critical
>         Attachments: TEZ-1338.1.txt
>
>
> A single DAGAM is currently setup, which is used for all clients. In non-session mode this AM would end up in a final state and will not accept another submission.



--
This message was sent by Atlassian JIRA
(v6.2#6252)