[jira] [Created] (SLIDER-1119) Strip off Zookeeper dependency if Yarn Registry is not enabled

["shanyu zhao (JIRA)" <ji...@apache.org>]

shanyu zhao created SLIDER-1119:
-----------------------------------

             Summary: Strip off Zookeeper dependency if Yarn Registry is not enabled
                 Key: SLIDER-1119
                 URL: https://issues.apache.org/jira/browse/SLIDER-1119
             Project: Slider
          Issue Type: Bug
    Affects Versions: Slider 0.90.2
            Reporter: shanyu zhao


In some Hadoop cluster where Yarn registry is not enabled, we should not use it in Slider. To check if Yarn registry is enabled or not, we can check an existing hadoop configuration (hadoop.registry.rm.enabled).

Today the main use of Yarn registry is to securely publish Slider AM operation URL, so that Slider agent can connect to Slider AM. Without Yarn registry, we can directly pass in the AM operation URL as a command line parameter to containers when launching the container.

Now admittedly without Yarn registry we lose Slider AM HA. This is because when AM restarts, there is no way to tell containers where to find the new AM. In this case AM would restart those containers. This may not be desirable for some usage but is fine with some other usage scenarios.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)