[jira] [Commented] (AMBARI-21945) Refresh Include/Exclude breaks parallel operations and can't be turned off

["Hadoop QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AMBARI-21945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164571#comment-16164571 ] 

Hadoop QA commented on AMBARI-21945:
------------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12886854/AMBARI-21945.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified test files.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in ambari-server:

                  org.apache.ambari.server.security.authorization.AmbariLdapAuthenticationProviderForDNWithSpaceTest

Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/12205//console

This message is automatically generated.

> Refresh Include/Exclude breaks parallel operations and can't be turned off
> --------------------------------------------------------------------------
>
>                 Key: AMBARI-21945
>                 URL: https://issues.apache.org/jira/browse/AMBARI-21945
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.5.2
>            Reporter: Dmytro Sen
>            Assignee: Dmytro Sen
>             Fix For: 2.6.0
>
>         Attachments: AMBARI-21945.patch
>
>
> Each time a new server is registered, there is an operation to refresh HDFS and YARN exclude file and now the operations (install components + start components) in Ambari can not be executed in parallel b/c refresh exclude file is an atomic process. Each server's operations of install and start components processes have to await previous one's refresh node to be finished. This means adding servers through blueprint is extremely slow now when many servers are being launched at the similar time.
> Also the refresh exclude file for each servers are still being executed even when 'manage.include.files' flags are turned off in yarn-site and hdfs-site. Previously in 2.5.1 we mange refresh files after adding / removing each batch of the servers, now seems this is impossible in 2.5.2.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)