You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2015/03/10 16:39:57 UTC

Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/
-----------------------------------------------------------

Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.


Bugs: AMBARI-10008
    https://issues.apache.org/jira/browse/AMBARI-10008


Repository: ambari


Description
-------

[root@perf1]# free -m
             total       used       free     shared    buffers     cached
Mem:          3578       2666        912          0         13        795
-/+ buffers/cache:       1857       1721
Swap:            0          0          0
[root@perf1]# ps aux | grep ams
ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 

Diff: https://reviews.apache.org/r/31891/diff/


Testing
-------


Thanks,

Dmytro Sen


Re: Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/#review75900
-----------------------------------------------------------

Ship it!


Ship It!

- Sid Wagle


On March 10, 2015, 4:38 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31891/
> -----------------------------------------------------------
> 
> (Updated March 10, 2015, 4:38 p.m.)
> 
> 
> Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.
> 
> 
> Bugs: AMBARI-10008
>     https://issues.apache.org/jira/browse/AMBARI-10008
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> [root@perf1]# free -m
>              total       used       free     shared    buffers     cached
> Mem:          3578       2666        912          0         13        795
> -/+ buffers/cache:       1857       1721
> Swap:            0          0          0
> [root@perf1]# ps aux | grep ams
> ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
> ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 
> 
> Diff: https://reviews.apache.org/r/31891/diff/
> 
> 
> Testing
> -------
> 
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Ambari Main ....................................... SUCCESS [3.541s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.041s]
> [INFO] Ambari Web ........................................ SUCCESS [35.723s]
> [INFO] Ambari Views ...................................... SUCCESS [2.120s]
> [INFO] Ambari Admin View ................................. SUCCESS [10.148s]
> [INFO] Ambari Metrics Common ............................. SUCCESS [1.664s]
> [INFO] Ambari Server ..................................... SUCCESS [1:13:52.611s]
> [INFO] Ambari Agent ...................................... SUCCESS [8.675s]
> [INFO] Ambari Client ..................................... SUCCESS [0.045s]
> [INFO] Ambari Python Client .............................. SUCCESS [0.276s]
> [INFO] Ambari Groovy Client .............................. SUCCESS [10.842s]
> [INFO] Ambari Shell ...................................... SUCCESS [0.034s]
> [INFO] Ambari Python Shell ............................... SUCCESS [0.045s]
> [INFO] Ambari Groovy Shell ............................... SUCCESS [6.861s]
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Re: Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/
-----------------------------------------------------------

(Updated Март 10, 2015, 4:38 п.п.)


Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.


Bugs: AMBARI-10008
    https://issues.apache.org/jira/browse/AMBARI-10008


Repository: ambari


Description
-------

[root@perf1]# free -m
             total       used       free     shared    buffers     cached
Mem:          3578       2666        912          0         13        795
-/+ buffers/cache:       1857       1721
Swap:            0          0          0
[root@perf1]# ps aux | grep ams
ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start


Diffs (updated)
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 

Diff: https://reviews.apache.org/r/31891/diff/


Testing
-------

[INFO] Reactor Summary:
[INFO] 
[INFO] Ambari Main ....................................... SUCCESS [3.541s]
[INFO] Apache Ambari Project POM ......................... SUCCESS [0.041s]
[INFO] Ambari Web ........................................ SUCCESS [35.723s]
[INFO] Ambari Views ...................................... SUCCESS [2.120s]
[INFO] Ambari Admin View ................................. SUCCESS [10.148s]
[INFO] Ambari Metrics Common ............................. SUCCESS [1.664s]
[INFO] Ambari Server ..................................... SUCCESS [1:13:52.611s]
[INFO] Ambari Agent ...................................... SUCCESS [8.675s]
[INFO] Ambari Client ..................................... SUCCESS [0.045s]
[INFO] Ambari Python Client .............................. SUCCESS [0.276s]
[INFO] Ambari Groovy Client .............................. SUCCESS [10.842s]
[INFO] Ambari Shell ...................................... SUCCESS [0.034s]
[INFO] Ambari Python Shell ............................... SUCCESS [0.045s]
[INFO] Ambari Groovy Shell ............................... SUCCESS [6.861s]


Thanks,

Dmytro Sen


Re: Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/
-----------------------------------------------------------

(Updated Март 10, 2015, 4:36 п.п.)


Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.


Bugs: AMBARI-10008
    https://issues.apache.org/jira/browse/AMBARI-10008


Repository: ambari


Description
-------

[root@perf1]# free -m
             total       used       free     shared    buffers     cached
Mem:          3578       2666        912          0         13        795
-/+ buffers/cache:       1857       1721
Swap:            0          0          0
[root@perf1]# ps aux | grep ams
ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start


Diffs (updated)
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 

Diff: https://reviews.apache.org/r/31891/diff/


Testing
-------

[INFO] Reactor Summary:
[INFO] 
[INFO] Ambari Main ....................................... SUCCESS [3.541s]
[INFO] Apache Ambari Project POM ......................... SUCCESS [0.041s]
[INFO] Ambari Web ........................................ SUCCESS [35.723s]
[INFO] Ambari Views ...................................... SUCCESS [2.120s]
[INFO] Ambari Admin View ................................. SUCCESS [10.148s]
[INFO] Ambari Metrics Common ............................. SUCCESS [1.664s]
[INFO] Ambari Server ..................................... SUCCESS [1:13:52.611s]
[INFO] Ambari Agent ...................................... SUCCESS [8.675s]
[INFO] Ambari Client ..................................... SUCCESS [0.045s]
[INFO] Ambari Python Client .............................. SUCCESS [0.276s]
[INFO] Ambari Groovy Client .............................. SUCCESS [10.842s]
[INFO] Ambari Shell ...................................... SUCCESS [0.034s]
[INFO] Ambari Python Shell ............................... SUCCESS [0.045s]
[INFO] Ambari Groovy Shell ............................... SUCCESS [6.861s]


Thanks,

Dmytro Sen


Re: Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

Posted by Jeff Sposetti <je...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/#review75888
-----------------------------------------------------------



ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py
<https://reviews.apache.org/r/31891/#comment123213>

    Host {0} is used by multiple master components ({1}). It is recommended to use a separate host for the Ambari Metrics Collector component and ensure the host has sufficient memory available.


- Jeff Sposetti


On March 10, 2015, 4:32 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31891/
> -----------------------------------------------------------
> 
> (Updated March 10, 2015, 4:32 p.m.)
> 
> 
> Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.
> 
> 
> Bugs: AMBARI-10008
>     https://issues.apache.org/jira/browse/AMBARI-10008
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> [root@perf1]# free -m
>              total       used       free     shared    buffers     cached
> Mem:          3578       2666        912          0         13        795
> -/+ buffers/cache:       1857       1721
> Swap:            0          0          0
> [root@perf1]# ps aux | grep ams
> ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
> ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 
> 
> Diff: https://reviews.apache.org/r/31891/diff/
> 
> 
> Testing
> -------
> 
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Ambari Main ....................................... SUCCESS [3.541s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.041s]
> [INFO] Ambari Web ........................................ SUCCESS [35.723s]
> [INFO] Ambari Views ...................................... SUCCESS [2.120s]
> [INFO] Ambari Admin View ................................. SUCCESS [10.148s]
> [INFO] Ambari Metrics Common ............................. SUCCESS [1.664s]
> [INFO] Ambari Server ..................................... SUCCESS [1:13:52.611s]
> [INFO] Ambari Agent ...................................... SUCCESS [8.675s]
> [INFO] Ambari Client ..................................... SUCCESS [0.045s]
> [INFO] Ambari Python Client .............................. SUCCESS [0.276s]
> [INFO] Ambari Groovy Client .............................. SUCCESS [10.842s]
> [INFO] Ambari Shell ...................................... SUCCESS [0.034s]
> [INFO] Ambari Python Shell ............................... SUCCESS [0.045s]
> [INFO] Ambari Groovy Shell ............................... SUCCESS [6.861s]
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Re: Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

Posted by Jeff Sposetti <je...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/#review75887
-----------------------------------------------------------



ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py
<https://reviews.apache.org/r/31891/#comment123212>

    Change the message to this:
    
    Host {0} is hosting multiple master components ({1}). It is recommended to use a separate host for the Ambari Metrics Collector component and ensure the host has sufficient memory available.


- Jeff Sposetti


On March 10, 2015, 4:32 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31891/
> -----------------------------------------------------------
> 
> (Updated March 10, 2015, 4:32 p.m.)
> 
> 
> Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.
> 
> 
> Bugs: AMBARI-10008
>     https://issues.apache.org/jira/browse/AMBARI-10008
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> [root@perf1]# free -m
>              total       used       free     shared    buffers     cached
> Mem:          3578       2666        912          0         13        795
> -/+ buffers/cache:       1857       1721
> Swap:            0          0          0
> [root@perf1]# ps aux | grep ams
> ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
> ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 
> 
> Diff: https://reviews.apache.org/r/31891/diff/
> 
> 
> Testing
> -------
> 
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Ambari Main ....................................... SUCCESS [3.541s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.041s]
> [INFO] Ambari Web ........................................ SUCCESS [35.723s]
> [INFO] Ambari Views ...................................... SUCCESS [2.120s]
> [INFO] Ambari Admin View ................................. SUCCESS [10.148s]
> [INFO] Ambari Metrics Common ............................. SUCCESS [1.664s]
> [INFO] Ambari Server ..................................... SUCCESS [1:13:52.611s]
> [INFO] Ambari Agent ...................................... SUCCESS [8.675s]
> [INFO] Ambari Client ..................................... SUCCESS [0.045s]
> [INFO] Ambari Python Client .............................. SUCCESS [0.276s]
> [INFO] Ambari Groovy Client .............................. SUCCESS [10.842s]
> [INFO] Ambari Shell ...................................... SUCCESS [0.034s]
> [INFO] Ambari Python Shell ............................... SUCCESS [0.045s]
> [INFO] Ambari Groovy Shell ............................... SUCCESS [6.861s]
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>


Re: Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/
-----------------------------------------------------------

(Updated Март 10, 2015, 4:32 п.п.)


Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.


Bugs: AMBARI-10008
    https://issues.apache.org/jira/browse/AMBARI-10008


Repository: ambari


Description
-------

[root@perf1]# free -m
             total       used       free     shared    buffers     cached
Mem:          3578       2666        912          0         13        795
-/+ buffers/cache:       1857       1721
Swap:            0          0          0
[root@perf1]# ps aux | grep ams
ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start


Diffs (updated)
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 

Diff: https://reviews.apache.org/r/31891/diff/


Testing (updated)
-------

[INFO] Reactor Summary:
[INFO] 
[INFO] Ambari Main ....................................... SUCCESS [3.541s]
[INFO] Apache Ambari Project POM ......................... SUCCESS [0.041s]
[INFO] Ambari Web ........................................ SUCCESS [35.723s]
[INFO] Ambari Views ...................................... SUCCESS [2.120s]
[INFO] Ambari Admin View ................................. SUCCESS [10.148s]
[INFO] Ambari Metrics Common ............................. SUCCESS [1.664s]
[INFO] Ambari Server ..................................... SUCCESS [1:13:52.611s]
[INFO] Ambari Agent ...................................... SUCCESS [8.675s]
[INFO] Ambari Client ..................................... SUCCESS [0.045s]
[INFO] Ambari Python Client .............................. SUCCESS [0.276s]
[INFO] Ambari Groovy Client .............................. SUCCESS [10.842s]
[INFO] Ambari Shell ...................................... SUCCESS [0.034s]
[INFO] Ambari Python Shell ............................... SUCCESS [0.045s]
[INFO] Ambari Groovy Shell ............................... SUCCESS [6.861s]


Thanks,

Dmytro Sen


Re: Review Request 31891: AMS-HBase crashes due to memory setting greater than physical memory available

Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31891/#review75886
-----------------------------------------------------------



ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py
<https://reviews.apache.org/r/31891/#comment123210>

    1. The warning looks very dangerous, lets tone it down to: It is recommended to host Ambari Metrics with to ensure there is enough RAM avaialble for embedded HBase.
    2. We should throw this warning after checking memory so if ther is 64 GB avaialble memory and there is 1 or 2 masters, we can ignore the warning. How about for now lets say more than 2 masters and if memory is less that 32 GB, throw warning?


- Sid Wagle


On March 10, 2015, 3:39 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31891/
> -----------------------------------------------------------
> 
> (Updated March 10, 2015, 3:39 p.m.)
> 
> 
> Review request for Ambari, Myroslav Papirkovskyy and Sid Wagle.
> 
> 
> Bugs: AMBARI-10008
>     https://issues.apache.org/jira/browse/AMBARI-10008
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> [root@perf1]# free -m
>              total       used       free     shared    buffers     cached
> Mem:          3578       2666        912          0         13        795
> -/+ buffers/cache:       1857       1721
> Swap:            0          0          0
> [root@perf1]# ps aux | grep ams
> ams      31255  0.0  0.0 106096  1456 ?        S    00:34   0:00 bash /usr/lib/ams-hbase/bin/hbase-daemon.sh --config /etc/ams-hbase/conf internal_start master
> ams      31268 32.6 18.0 13601208 662980 ?     Sl   00:34   1:24 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Xmx12288m -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/ambari-metrics-collector/hs_err_pid%p.log -Djava.io.tmpdir=/grid/0/var/lib/ambari-metrics-collector/hbase-tmp -Djava.library.path=/usr/lib/ams-hbase/lib/hadoop-native/ -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/ambari-metrics-collector/gc.log-201503040034 -Xmx12288m -Dhbase.log.dir=/var/log/ambari-metrics-collector -Dhbase.log.file=hbase-ams-master-perf-400-3mar-b-ams-1.log -Dhbase.home.dir=/usr/lib/ams-hbase/bin/.. -Dhbase.id.str=ams -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 08d3ef5 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py a7eb98c 
> 
> Diff: https://reviews.apache.org/r/31891/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>