You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Sid Wagle <sw...@hortonworks.com> on 2017/08/07 21:03:25 UTC

Review Request 61481: HDFS namenode rpc and connection load metrics are not showing

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61481/
-----------------------------------------------------------

Review request for Ambari, Alejandro Fernandez, Aravindan Vijayan, Dmytro Sen, and Sumit Mohanty.


Bugs: AMBARI-21644
    https://issues.apache.org/jira/browse/AMBARI-21644


Repository: ambari


Description
-------

After upgrading from IOP 4.2 to HDP 2.6 with Ambari 2.5.2, there are two metrics widget don't show the right results.
Namenode RPC and Namenode Connection Load graph don't show any data. This might be caused by different implementation to fetch metrics data for those two graphs in IOP.


Diffs
-----

  ambari-server/src/main/resources/stacks/BigInsights/4.0/hooks/before-START/templates/hadoop-metrics2.properties.j2 31bf1c6 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/widgets.json 85082d0 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py c2714e2 


Diff: https://reviews.apache.org/r/61481/diff/1/


Testing
-------

Unit test pass.
Manual verification in progress.


Thanks,

Sid Wagle


Re: Review Request 61481: HDFS namenode rpc and connection load metrics are not showing

Posted by Aravindan Vijayan <av...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61481/#review182339
-----------------------------------------------------------


Ship it!




Ship It!

- Aravindan Vijayan


On Aug. 7, 2017, 10:47 p.m., Sid Wagle wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/61481/
> -----------------------------------------------------------
> 
> (Updated Aug. 7, 2017, 10:47 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Aravindan Vijayan, Dmytro Sen, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-21644
>     https://issues.apache.org/jira/browse/AMBARI-21644
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> After upgrading from IOP 4.2 to HDP 2.6 with Ambari 2.5.2, there are two metrics widget don't show the right results.
> Namenode RPC and Namenode Connection Load graph don't show any data. This might be caused by different implementation to fetch metrics data for those two graphs in IOP.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/alerts.json 90401e6 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-env.xml 45f9880 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-env.xml eaafc6b 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-ini.xml 3c87ab1 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-env.xml 00d396c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-log4j.xml 4eea14f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-policy.xml 13726a2 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-security-site.xml 64799c1 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-site.xml bf62b8e 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-log4j.xml 3735e6c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-logsearch-conf.xml 72d44db 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-site.xml b9f534e 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-client.xml cac39de 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-server.xml 5d2745f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/kerberos.json 03c3f93 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metainfo.xml 5002459 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metrics.json c12e09a 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/alerts/alert_ambari_metrics_monitor.py fa44a7f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/hbaseSmokeVerify.sh 5c320c0 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/AMBARI_METRICS.txt 6693503 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/FLUME.txt b3bfec3 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HBASE.txt 0067403 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HDFS.txt 84576e9 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HOST.txt 4b759c6 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/KAFKA.txt 1e2017c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/STORM.txt 04bca00 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/YARN.txt ce04228 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/__init__.py 5561e10 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams.py 7b1a824 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams_service.py 0726802 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/functions.py 140c24c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase.py 16d741f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_master.py b769a0d 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_regionserver.py cf0efef 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_service.py 5f03ca0 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_collector.py cf498ec 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_monitor.py f6cce8f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params.py b0a2b75 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_linux.py 838e987 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_windows.py acb5bba 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_check.py f19c823 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_mapping.py 2eeb427 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/split_points.py fa4deaf 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status.py 59466ad 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status_params.py d446baa 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams.conf.j2 c5fbc9b 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_collector_jaas.conf.j2 f7f00eb 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_zookeeper_jaas.conf.j2 1929548 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hadoop-metrics2-hbase.properties.j2 a65ea88 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_client_jaas.conf.j2 38f9721 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_grant_permissions.j2 c29c674 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_master_jaas.conf.j2 a93c36c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_regionserver_jaas.conf.j2 7097481 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_groups.conf.j2 aa03d195 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_monitor.ini.j2 fc86a58 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/regionservers.j2 81d060b 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/smoketest_metrics.json.j2 2ee0efa 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/widgets.json 85082d0 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py c2714e2 
> 
> 
> Diff: https://reviews.apache.org/r/61481/diff/4/
> 
> 
> Testing
> -------
> 
> Unit test pass.
> Manual verification in progress.
> 
> 
> Thanks,
> 
> Sid Wagle
> 
>


Re: Review Request 61481: HDFS namenode rpc and connection load metrics are not showing

Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61481/
-----------------------------------------------------------

(Updated Aug. 7, 2017, 10:47 p.m.)


Review request for Ambari, Alejandro Fernandez, Aravindan Vijayan, Dmytro Sen, and Sumit Mohanty.


Changes
-------

Addressed comment for branch will do a separate change from trunk.


Bugs: AMBARI-21644
    https://issues.apache.org/jira/browse/AMBARI-21644


Repository: ambari


Description
-------

After upgrading from IOP 4.2 to HDP 2.6 with Ambari 2.5.2, there are two metrics widget don't show the right results.
Namenode RPC and Namenode Connection Load graph don't show any data. This might be caused by different implementation to fetch metrics data for those two graphs in IOP.


Diffs (updated)
-----

  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/alerts.json 90401e6 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-env.xml 45f9880 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-env.xml eaafc6b 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-ini.xml 3c87ab1 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-env.xml 00d396c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-log4j.xml 4eea14f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-policy.xml 13726a2 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-security-site.xml 64799c1 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-site.xml bf62b8e 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-log4j.xml 3735e6c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-logsearch-conf.xml 72d44db 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-site.xml b9f534e 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-client.xml cac39de 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-server.xml 5d2745f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/kerberos.json 03c3f93 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metainfo.xml 5002459 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metrics.json c12e09a 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/alerts/alert_ambari_metrics_monitor.py fa44a7f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/hbaseSmokeVerify.sh 5c320c0 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/AMBARI_METRICS.txt 6693503 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/FLUME.txt b3bfec3 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HBASE.txt 0067403 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HDFS.txt 84576e9 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HOST.txt 4b759c6 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/KAFKA.txt 1e2017c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/STORM.txt 04bca00 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/YARN.txt ce04228 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/__init__.py 5561e10 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams.py 7b1a824 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams_service.py 0726802 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/functions.py 140c24c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase.py 16d741f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_master.py b769a0d 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_regionserver.py cf0efef 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_service.py 5f03ca0 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_collector.py cf498ec 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_monitor.py f6cce8f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params.py b0a2b75 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_linux.py 838e987 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_windows.py acb5bba 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_check.py f19c823 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_mapping.py 2eeb427 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/split_points.py fa4deaf 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status.py 59466ad 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status_params.py d446baa 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams.conf.j2 c5fbc9b 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_collector_jaas.conf.j2 f7f00eb 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_zookeeper_jaas.conf.j2 1929548 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hadoop-metrics2-hbase.properties.j2 a65ea88 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_client_jaas.conf.j2 38f9721 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_grant_permissions.j2 c29c674 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_master_jaas.conf.j2 a93c36c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_regionserver_jaas.conf.j2 7097481 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_groups.conf.j2 aa03d195 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_monitor.ini.j2 fc86a58 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/regionservers.j2 81d060b 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/smoketest_metrics.json.j2 2ee0efa 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/widgets.json 85082d0 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py c2714e2 


Diff: https://reviews.apache.org/r/61481/diff/4/

Changes: https://reviews.apache.org/r/61481/diff/3-4/


Testing
-------

Unit test pass.
Manual verification in progress.


Thanks,

Sid Wagle


Re: Review Request 61481: HDFS namenode rpc and connection load metrics are not showing

Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61481/
-----------------------------------------------------------

(Updated Aug. 7, 2017, 10:42 p.m.)


Review request for Ambari, Alejandro Fernandez, Aravindan Vijayan, Dmytro Sen, and Sumit Mohanty.


Changes
-------

Fixed BI 4.2 AMBARI_METRICS by poiniting it to common-services.


Bugs: AMBARI-21644
    https://issues.apache.org/jira/browse/AMBARI-21644


Repository: ambari


Description
-------

After upgrading from IOP 4.2 to HDP 2.6 with Ambari 2.5.2, there are two metrics widget don't show the right results.
Namenode RPC and Namenode Connection Load graph don't show any data. This might be caused by different implementation to fetch metrics data for those two graphs in IOP.


Diffs (updated)
-----

  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/alerts.json 90401e6 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-env.xml 45f9880 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-env.xml eaafc6b 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-ini.xml 3c87ab1 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-env.xml 00d396c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-log4j.xml 4eea14f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-policy.xml 13726a2 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-security-site.xml 64799c1 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-site.xml bf62b8e 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-log4j.xml 3735e6c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-logsearch-conf.xml 72d44db 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-site.xml b9f534e 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-client.xml cac39de 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-server.xml 5d2745f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/kerberos.json 03c3f93 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metainfo.xml 5002459 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metrics.json c12e09a 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/alerts/alert_ambari_metrics_monitor.py fa44a7f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/hbaseSmokeVerify.sh 5c320c0 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/AMBARI_METRICS.txt 6693503 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/FLUME.txt b3bfec3 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HBASE.txt 0067403 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HDFS.txt 84576e9 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HOST.txt 4b759c6 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/KAFKA.txt 1e2017c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/STORM.txt 04bca00 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/YARN.txt ce04228 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/__init__.py 5561e10 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams.py 7b1a824 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams_service.py 0726802 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/functions.py 140c24c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase.py 16d741f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_master.py b769a0d 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_regionserver.py cf0efef 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_service.py 5f03ca0 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_collector.py cf498ec 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_monitor.py f6cce8f 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params.py b0a2b75 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_linux.py 838e987 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_windows.py acb5bba 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_check.py f19c823 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_mapping.py 2eeb427 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/split_points.py fa4deaf 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status.py 59466ad 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status_params.py d446baa 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams.conf.j2 c5fbc9b 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_collector_jaas.conf.j2 f7f00eb 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_zookeeper_jaas.conf.j2 1929548 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hadoop-metrics2-hbase.properties.j2 a65ea88 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_client_jaas.conf.j2 38f9721 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_grant_permissions.j2 c29c674 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_master_jaas.conf.j2 a93c36c 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_regionserver_jaas.conf.j2 7097481 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_groups.conf.j2 aa03d195 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_monitor.ini.j2 fc86a58 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/regionservers.j2 81d060b 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/smoketest_metrics.json.j2 2ee0efa 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/widgets.json 85082d0 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py c2714e2 


Diff: https://reviews.apache.org/r/61481/diff/3/

Changes: https://reviews.apache.org/r/61481/diff/2-3/


Testing
-------

Unit test pass.
Manual verification in progress.


Thanks,

Sid Wagle


Re: Review Request 61481: HDFS namenode rpc and connection load metrics are not showing

Posted by Sid Wagle <sw...@hortonworks.com>.

> On Aug. 7, 2017, 9:13 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
> > Line 334 (original), 334 (patched)
> > <https://reviews.apache.org/r/61481/diff/2/?file=1791055#file1791055line334>
> >
> >     Also change in the hooks for HDP 3.0

Attaching separate batch for trunk.


- Sid


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61481/#review182326
-----------------------------------------------------------


On Aug. 7, 2017, 10:47 p.m., Sid Wagle wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/61481/
> -----------------------------------------------------------
> 
> (Updated Aug. 7, 2017, 10:47 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Aravindan Vijayan, Dmytro Sen, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-21644
>     https://issues.apache.org/jira/browse/AMBARI-21644
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> After upgrading from IOP 4.2 to HDP 2.6 with Ambari 2.5.2, there are two metrics widget don't show the right results.
> Namenode RPC and Namenode Connection Load graph don't show any data. This might be caused by different implementation to fetch metrics data for those two graphs in IOP.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/alerts.json 90401e6 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-env.xml 45f9880 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-env.xml eaafc6b 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-grafana-ini.xml 3c87ab1 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-env.xml 00d396c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-log4j.xml 4eea14f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-policy.xml 13726a2 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-security-site.xml 64799c1 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-hbase-site.xml bf62b8e 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-log4j.xml 3735e6c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-logsearch-conf.xml 72d44db 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-site.xml b9f534e 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-client.xml cac39de 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/configuration/ams-ssl-server.xml 5d2745f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/kerberos.json 03c3f93 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metainfo.xml 5002459 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/metrics.json c12e09a 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/alerts/alert_ambari_metrics_monitor.py fa44a7f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/hbaseSmokeVerify.sh 5c320c0 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/AMBARI_METRICS.txt 6693503 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/FLUME.txt b3bfec3 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HBASE.txt 0067403 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HDFS.txt 84576e9 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/HOST.txt 4b759c6 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/KAFKA.txt 1e2017c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/STORM.txt 04bca00 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/files/service-metrics/YARN.txt ce04228 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/__init__.py 5561e10 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams.py 7b1a824 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/ams_service.py 0726802 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/functions.py 140c24c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase.py 16d741f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_master.py b769a0d 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_regionserver.py cf0efef 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/hbase_service.py 5f03ca0 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_collector.py cf498ec 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/metrics_monitor.py f6cce8f 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params.py b0a2b75 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_linux.py 838e987 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/params_windows.py acb5bba 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_check.py f19c823 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/service_mapping.py 2eeb427 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/split_points.py fa4deaf 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status.py 59466ad 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/scripts/status_params.py d446baa 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams.conf.j2 c5fbc9b 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_collector_jaas.conf.j2 f7f00eb 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/ams_zookeeper_jaas.conf.j2 1929548 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hadoop-metrics2-hbase.properties.j2 a65ea88 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_client_jaas.conf.j2 38f9721 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_grant_permissions.j2 c29c674 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_master_jaas.conf.j2 a93c36c 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/hbase_regionserver_jaas.conf.j2 7097481 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_groups.conf.j2 aa03d195 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/metric_monitor.ini.j2 fc86a58 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/regionservers.j2 81d060b 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/AMBARI_METRICS/package/templates/smoketest_metrics.json.j2 2ee0efa 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/widgets.json 85082d0 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py c2714e2 
> 
> 
> Diff: https://reviews.apache.org/r/61481/diff/4/
> 
> 
> Testing
> -------
> 
> Unit test pass.
> Manual verification in progress.
> 
> 
> Thanks,
> 
> Sid Wagle
> 
>


Re: Review Request 61481: HDFS namenode rpc and connection load metrics are not showing

Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61481/#review182326
-----------------------------------------------------------


Fix it, then Ship it!





ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
Line 334 (original), 334 (patched)
<https://reviews.apache.org/r/61481/#comment258204>

    Also change in the hooks for HDP 3.0


- Alejandro Fernandez


On Aug. 7, 2017, 9:10 p.m., Sid Wagle wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/61481/
> -----------------------------------------------------------
> 
> (Updated Aug. 7, 2017, 9:10 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Aravindan Vijayan, Dmytro Sen, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-21644
>     https://issues.apache.org/jira/browse/AMBARI-21644
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> After upgrading from IOP 4.2 to HDP 2.6 with Ambari 2.5.2, there are two metrics widget don't show the right results.
> Namenode RPC and Namenode Connection Load graph don't show any data. This might be caused by different implementation to fetch metrics data for those two graphs in IOP.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/BigInsights/4.0/hooks/before-START/templates/hadoop-metrics2.properties.j2 31bf1c6 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/widgets.json 85082d0 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py c2714e2 
> 
> 
> Diff: https://reviews.apache.org/r/61481/diff/2/
> 
> 
> Testing
> -------
> 
> Unit test pass.
> Manual verification in progress.
> 
> 
> Thanks,
> 
> Sid Wagle
> 
>


Re: Review Request 61481: HDFS namenode rpc and connection load metrics are not showing

Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61481/
-----------------------------------------------------------

(Updated Aug. 7, 2017, 9:10 p.m.)


Review request for Ambari, Alejandro Fernandez, Aravindan Vijayan, Dmytro Sen, and Sumit Mohanty.


Changes
-------

fix for ValueError


Bugs: AMBARI-21644
    https://issues.apache.org/jira/browse/AMBARI-21644


Repository: ambari


Description
-------

After upgrading from IOP 4.2 to HDP 2.6 with Ambari 2.5.2, there are two metrics widget don't show the right results.
Namenode RPC and Namenode Connection Load graph don't show any data. This might be caused by different implementation to fetch metrics data for those two graphs in IOP.


Diffs (updated)
-----

  ambari-server/src/main/resources/stacks/BigInsights/4.0/hooks/before-START/templates/hadoop-metrics2.properties.j2 31bf1c6 
  ambari-server/src/main/resources/stacks/BigInsights/4.2/services/HDFS/widgets.json 85082d0 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py c2714e2 


Diff: https://reviews.apache.org/r/61481/diff/2/

Changes: https://reviews.apache.org/r/61481/diff/1-2/


Testing
-------

Unit test pass.
Manual verification in progress.


Thanks,

Sid Wagle