You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2015/09/19 15:47:47 UTC

Review Request 38525: Master heap setting in distributed mode should be limited

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38525/
-----------------------------------------------------------

Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.


Bugs: AMBARI-13161
    https://issues.apache.org/jira/browse/AMBARI-13161


Repository: ambari


Description
-------

stack advisor allocated 713m to Master and 1024m to RS, in distributed mode. For small clusters we should default to 512m Master, RS should get as much memory as possible.
In distributed mode we should WARN if no DN is local and set dfs.client.read.shortcircuit = true in ams-hbase-site if local DN is present


Diffs
-----

  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-env.xml 68b99ca 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-site.xml b286cac 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/ams_service.py 8b2fa95 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/hbase.py b3af9d1 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py b2332b0 
  ambari-server/src/test/python/stacks/2.0.6/AMBARI_METRICS/test_metrics_collector.py 7d33a3d 
  ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 5a5c2f0 
  ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 5bb99ae 

Diff: https://reviews.apache.org/r/38525/diff/


Testing
-------

----------------------------------------------------------------------
Ran 241 tests in 8.023s

OK
----------------------------------------------------------------------
Total run:785
Total errors:0
Total failures:0
OK


Thanks,

Dmytro Sen


Re: Review Request 38525: Master heap setting in distributed mode should be limited

Posted by Alexandr Antonenko <hi...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38525/#review99682
-----------------------------------------------------------

Ship it!


Ship It!

- Alexandr Antonenko


On Sept. 19, 2015, 3:01 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38525/
> -----------------------------------------------------------
> 
> (Updated Sept. 19, 2015, 3:01 p.m.)
> 
> 
> Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.
> 
> 
> Bugs: AMBARI-13161
>     https://issues.apache.org/jira/browse/AMBARI-13161
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> stack advisor allocated 713m to Master and 1024m to RS, in distributed mode. For small clusters we should default to 512m Master, RS should get as much memory as possible.
> In distributed mode we should WARN if no DN is local and set dfs.client.read.shortcircuit = true in ams-hbase-site if local DN is present
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-env.xml 68b99ca 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-site.xml b286cac 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/ams_service.py 8b2fa95 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/hbase.py b3af9d1 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py b2332b0 
>   ambari-server/src/test/python/stacks/2.0.6/AMBARI_METRICS/test_metrics_collector.py 7d33a3d 
>   ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 5a5c2f0 
>   ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 5bb99ae 
> 
> Diff: https://reviews.apache.org/r/38525/diff/
> 
> 
> Testing
> -------
> 
> ----------------------------------------------------------------------
> Ran 241 tests in 8.023s
> 
> OK
> ----------------------------------------------------------------------
> Total run:785
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Re: Review Request 38525: Master heap setting in distributed mode should be limited

Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38525/
-----------------------------------------------------------

(Updated Сен. 19, 2015, 3:01 п.п.)


Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.


Bugs: AMBARI-13161
    https://issues.apache.org/jira/browse/AMBARI-13161


Repository: ambari


Description
-------

stack advisor allocated 713m to Master and 1024m to RS, in distributed mode. For small clusters we should default to 512m Master, RS should get as much memory as possible.
In distributed mode we should WARN if no DN is local and set dfs.client.read.shortcircuit = true in ams-hbase-site if local DN is present


Diffs (updated)
-----

  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-env.xml 68b99ca 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-site.xml b286cac 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/ams_service.py 8b2fa95 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/hbase.py b3af9d1 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py b2332b0 
  ambari-server/src/test/python/stacks/2.0.6/AMBARI_METRICS/test_metrics_collector.py 7d33a3d 
  ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 5a5c2f0 
  ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 5bb99ae 

Diff: https://reviews.apache.org/r/38525/diff/


Testing
-------

----------------------------------------------------------------------
Ran 241 tests in 8.023s

OK
----------------------------------------------------------------------
Total run:785
Total errors:0
Total failures:0
OK


Thanks,

Dmytro Sen


Re: Review Request 38525: Master heap setting in distributed mode should be limited

Posted by Dmytro Grinenko <ha...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38525/#review99673
-----------------------------------------------------------

Ship it!


Ship It!

- Dmytro Grinenko


On Sept. 19, 2015, 1:47 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38525/
> -----------------------------------------------------------
> 
> (Updated Sept. 19, 2015, 1:47 p.m.)
> 
> 
> Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.
> 
> 
> Bugs: AMBARI-13161
>     https://issues.apache.org/jira/browse/AMBARI-13161
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> stack advisor allocated 713m to Master and 1024m to RS, in distributed mode. For small clusters we should default to 512m Master, RS should get as much memory as possible.
> In distributed mode we should WARN if no DN is local and set dfs.client.read.shortcircuit = true in ams-hbase-site if local DN is present
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-env.xml 68b99ca 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-site.xml b286cac 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/ams_service.py 8b2fa95 
>   ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/hbase.py b3af9d1 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py b2332b0 
>   ambari-server/src/test/python/stacks/2.0.6/AMBARI_METRICS/test_metrics_collector.py 7d33a3d 
>   ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 5a5c2f0 
>   ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 5bb99ae 
> 
> Diff: https://reviews.apache.org/r/38525/diff/
> 
> 
> Testing
> -------
> 
> ----------------------------------------------------------------------
> Ran 241 tests in 8.023s
> 
> OK
> ----------------------------------------------------------------------
> Total run:785
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>