You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Zihan Li (Jira)" <ji...@apache.org> on 2021/07/30 00:08:00 UTC

[jira] [Created] (GOBBLIN-1500) Support gobblin on yarn to be able to run on clusters with robin enabled

Zihan Li created GOBBLIN-1500:
---------------------------------

             Summary: Support gobblin on yarn to be able to run on clusters with robin enabled
                 Key: GOBBLIN-1500
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1500
             Project: Apache Gobblin
          Issue Type: New Feature
            Reporter: Zihan Li


Previously we always check with one default yarn client, but if the cluster is enabled with Robin and can connect to different RM, it will ends up we cannot find existing application and submit duplicate tasks. So now we need to check against different potential yarn cluster, and also make sure when submitting yarn application, we only have one RM token.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)