You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Dmytro Sen (JIRA)" <ji...@apache.org> on 2016/07/27 11:44:20 UTC

[jira] [Updated] (AMBARI-17914) Request for HBase metrics making a call to Namenode and Nimbus for that metric

     [ https://issues.apache.org/jira/browse/AMBARI-17914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dmytro Sen updated AMBARI-17914:
--------------------------------
    Attachment: AMBARI-17914.patch

> Request for HBase metrics making a call to Namenode and Nimbus for that metric
> ------------------------------------------------------------------------------
>
>                 Key: AMBARI-17914
>                 URL: https://issues.apache.org/jira/browse/AMBARI-17914
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics, ambari-server
>    Affects Versions: 2.4.0
>            Reporter: Dmytro Sen
>            Assignee: Dmytro Sen
>            Priority: Critical
>             Fix For: 2.4.0
>
>         Attachments: AMBARI-17914.patch
>
>
> While investigating a slow API call on perf cluster found that we are requesting wrong metrics from AMS which wastes a network round trip and will not have any data.
> API call:
> {code}
> http://server1:8080/api/v1/clusters/cl1/components/?ServiceComponentInfo/component_name=APP_TIMELINE_SERVER|ServiceComponentInfo/category=MASTER&fields=ServiceComponentInfo/service_name,host_components/HostRoles/display_name,host_components/HostRoles/host_name,host_components/HostRoles/state,host_components/HostRoles/maintenance_state,host_components/HostRoles/stale_configs,host_components/HostRoles/ha_state,host_components/HostRoles/desired_admin_state,,host_components/metrics/jvm/memHeapUsedM,host_components/metrics/jvm/HeapMemoryMax,host_components/metrics/jvm/HeapMemoryUsed,host_components/metrics/jvm/memHeapCommittedM,host_components/metrics/mapred/jobtracker/trackers_decommissioned,host_components/metrics/cpu/cpu_wio,host_components/metrics/rpc/client/RpcQueueTime_avg_time,host_components/metrics/dfs/FSNamesystem/*,host_components/metrics/dfs/namenode/Version,host_components/metrics/dfs/namenode/LiveNodes,host_components/metrics/dfs/namenode/DeadNodes,host_components/metrics/dfs/namenode/DecomNodes,host_components/metrics/dfs/namenode/TotalFiles,host_components/metrics/dfs/namenode/UpgradeFinalized,host_components/metrics/dfs/namenode/Safemode,host_components/metrics/runtime/StartTime,host_components/metrics/hbase/master/IsActiveMaster,host_components/metrics/hbase/master/MasterStartTime,host_components/metrics/hbase/master/MasterActiveTime,host_components/metrics/hbase/master/AverageLoad,host_components/metrics/master/AssignmentManger/ritCount,host_components/metrics/yarn/Queue,host_components/metrics/yarn/ClusterMetrics/NumActiveNMs,host_components/metrics/yarn/ClusterMetrics/NumLostNMs,host_components/metrics/yarn/ClusterMetrics/NumUnhealthyNMs,host_components/metrics/yarn/ClusterMetrics/NumRebootedNMs,host_components/metrics/yarn/ClusterMetrics/NumDecommissionedNMs&minimal_response=true&_=1469047954755
> {code}
> Ambari UI makes this call every 10 seconds and hence this is relevant change.
> AMS calls:
> {code}
> 21 Jul 2016 23:43:20,840 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-1&appId=HOST
> 21 Jul 2016 23:43:20,869 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-1&appId=NAMENODE
> 21 Jul 2016 23:43:20,890 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-3&appId=HOST
> 21 Jul 2016 23:43:20,931 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-3&appId=NIMBUS
> 21 Jul 2016 23:43:20,948 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-1&appId=HOST
> 21 Jul 2016 23:43:21,076 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-1&appId=AMS-HBASE
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)