You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmitro Lisnichenko <dl...@hortonworks.com> on 2015/09/23 18:06:12 UTC

Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/
-----------------------------------------------------------

Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.


Bugs: AMBARI-13207
    https://issues.apache.org/jira/browse/AMBARI-13207


Repository: ambari


Description
-------

Multiple service checks failed during RU.


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
  ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
  ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
  ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 

Diff: https://reviews.apache.org/r/38677/diff/


Testing
-------

Still running manual check of RU on live cluster using the same HDP build versions as at initial test case


Thanks,

Dmitro Lisnichenko


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/#review100219
-----------------------------------------------------------


UPD: service checks pass successfully

- Dmitro Lisnichenko


On Sept. 23, 2015, 4:06 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38677/
> -----------------------------------------------------------
> 
> (Updated Sept. 23, 2015, 4:06 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.
> 
> 
> Bugs: AMBARI-13207
>     https://issues.apache.org/jira/browse/AMBARI-13207
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Multiple service checks failed during RU.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 
> 
> Diff: https://reviews.apache.org/r/38677/diff/
> 
> 
> Testing
> -------
> 
> Still running manual check of RU on live cluster using the same HDP build versions as at initial test case
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Sumit Mohanty <sm...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/#review100244
-----------------------------------------------------------

Ship it!


Ship It!

- Sumit Mohanty


On Sept. 23, 2015, 5:44 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38677/
> -----------------------------------------------------------
> 
> (Updated Sept. 23, 2015, 5:44 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.
> 
> 
> Bugs: AMBARI-13207
>     https://issues.apache.org/jira/browse/AMBARI-13207
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Multiple service checks failed during RU.
> 
> Root cause is two properties that should not be present in YARN config
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 
> 
> Diff: https://reviews.apache.org/r/38677/diff/
> 
> 
> Testing
> -------
> 
> Still running manual check of RU on live cluster using the same HDP build versions as at initial test case
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.

> On Sept. 23, 2015, 5:53 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml, lines 667-670
> > <https://reviews.apache.org/r/38677/diff/1/?file=1083179#file1083179line667>
> >
> >     According to the YARN team:
> >     "yarn.scheduler.capacity.root.accessible-node-labels.default.maximum-capacity should also be removed only if the value is set to -1."
> >     
> >     So, if the value was non-negative, then it should be preserved. 
> >     
> >     Do you have an updated conversation that contradicts this?

discussed on skype


- Dmitro


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/#review100245
-----------------------------------------------------------


On Sept. 23, 2015, 5:44 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38677/
> -----------------------------------------------------------
> 
> (Updated Sept. 23, 2015, 5:44 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.
> 
> 
> Bugs: AMBARI-13207
>     https://issues.apache.org/jira/browse/AMBARI-13207
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Multiple service checks failed during RU.
> 
> Root cause is two properties that should not be present in YARN config
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 
> 
> Diff: https://reviews.apache.org/r/38677/diff/
> 
> 
> Testing
> -------
> 
> Still running manual check of RU on live cluster using the same HDP build versions as at initial test case
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/#review100245
-----------------------------------------------------------



ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml (lines 664 - 666)
<https://reviews.apache.org/r/38677/#comment157406>

    According to the YARN team:
    "yarn.scheduler.capacity.root.accessible-node-labels.default.maximum-capacity should also be removed only if the value is set to -1."
    
    So, if the value was non-negative, then it should be preserved. 
    
    Do you have an updated conversation that contradicts this?


- Jonathan Hurley


On Sept. 23, 2015, 1:44 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38677/
> -----------------------------------------------------------
> 
> (Updated Sept. 23, 2015, 1:44 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.
> 
> 
> Bugs: AMBARI-13207
>     https://issues.apache.org/jira/browse/AMBARI-13207
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Multiple service checks failed during RU.
> 
> Root cause is two properties that should not be present in YARN config
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 
> 
> Diff: https://reviews.apache.org/r/38677/diff/
> 
> 
> Testing
> -------
> 
> Still running manual check of RU on live cluster using the same HDP build versions as at initial test case
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/#review100241
-----------------------------------------------------------


Are you sure that removing these is appropriate?  When these properties were missing, I recall having all kinds of issues with YARN jobs running.  They would get stuck at PENDING and never get dispatched.

- Nate Cole


On Sept. 23, 2015, 1:44 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38677/
> -----------------------------------------------------------
> 
> (Updated Sept. 23, 2015, 1:44 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.
> 
> 
> Bugs: AMBARI-13207
>     https://issues.apache.org/jira/browse/AMBARI-13207
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Multiple service checks failed during RU.
> 
> Root cause is two properties that should not be present in YARN config
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 
> 
> Diff: https://reviews.apache.org/r/38677/diff/
> 
> 
> Testing
> -------
> 
> Still running manual check of RU on live cluster using the same HDP build versions as at initial test case
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/#review100254
-----------------------------------------------------------

Ship it!


Ship It!

- Nate Cole


On Sept. 23, 2015, 1:44 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38677/
> -----------------------------------------------------------
> 
> (Updated Sept. 23, 2015, 1:44 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.
> 
> 
> Bugs: AMBARI-13207
>     https://issues.apache.org/jira/browse/AMBARI-13207
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Multiple service checks failed during RU.
> 
> Root cause is two properties that should not be present in YARN config
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 
> 
> Diff: https://reviews.apache.org/r/38677/diff/
> 
> 
> Testing
> -------
> 
> Still running manual check of RU on live cluster using the same HDP build versions as at initial test case
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Mahadev Konar <ma...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/#review100242
-----------------------------------------------------------

Ship it!


Ship It!

- Mahadev Konar


On Sept. 23, 2015, 5:44 p.m., Dmitro Lisnichenko wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38677/
> -----------------------------------------------------------
> 
> (Updated Sept. 23, 2015, 5:44 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.
> 
> 
> Bugs: AMBARI-13207
>     https://issues.apache.org/jira/browse/AMBARI-13207
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Multiple service checks failed during RU.
> 
> Root cause is two properties that should not be present in YARN config
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
>   ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
>   ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 
> 
> Diff: https://reviews.apache.org/r/38677/diff/
> 
> 
> Testing
> -------
> 
> Still running manual check of RU on live cluster using the same HDP build versions as at initial test case
> 
> 
> Thanks,
> 
> Dmitro Lisnichenko
> 
>


Re: Review Request 38677: RU multiple service checks failed (possibly, Illegal capacity of 0.0 for children)

Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38677/
-----------------------------------------------------------

(Updated Sept. 23, 2015, 5:44 p.m.)


Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan Hurley, and Nate Cole.


Bugs: AMBARI-13207
    https://issues.apache.org/jira/browse/AMBARI-13207


Repository: ambari


Description (updated)
-------

Multiple service checks failed during RU.

Root cause is two properties that should not be present in YARN config


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml 62d26a2 
  ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/services/YARN/configuration/capacity-scheduler.xml 1642746 
  ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.3.json 9d2fcd1 
  ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.2_to_2.3.json 6b8809a 

Diff: https://reviews.apache.org/r/38677/diff/


Testing
-------

Still running manual check of RU on live cluster using the same HDP build versions as at initial test case


Thanks,

Dmitro Lisnichenko