You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Dmytro Sen (JIRA)" <ji...@apache.org> on 2016/07/28 16:10:20 UTC
[jira] [Commented] (AMBARI-17914) Request for HBase metrics making
a call to Namenode and Nimbus for that metric
[ https://issues.apache.org/jira/browse/AMBARI-17914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397738#comment-15397738 ]
Dmytro Sen commented on AMBARI-17914:
-------------------------------------
Tests passed locally
{code}
[INFO] Reactor Summary:
[INFO]
[INFO] Ambari Views ...................................... SUCCESS [4.095s]
[INFO] Ambari Metrics Common ............................. SUCCESS [10.100s]
[INFO] Ambari Server ..................................... SUCCESS [57:54.894s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
{code}
> Request for HBase metrics making a call to Namenode and Nimbus for that metric
> ------------------------------------------------------------------------------
>
> Key: AMBARI-17914
> URL: https://issues.apache.org/jira/browse/AMBARI-17914
> Project: Ambari
> Issue Type: Bug
> Components: ambari-metrics, ambari-server
> Affects Versions: 2.4.0
> Reporter: Dmytro Sen
> Assignee: Dmytro Sen
> Priority: Critical
> Fix For: 2.4.0
>
> Attachments: AMBARI-17914.patch
>
>
> While investigating a slow API call on perf cluster found that we are requesting wrong metrics from AMS which wastes a network round trip and will not have any data.
> API call:
> {code}
> http://server1:8080/api/v1/clusters/cl1/components/?ServiceComponentInfo/component_name=APP_TIMELINE_SERVER|ServiceComponentInfo/category=MASTER&fields=ServiceComponentInfo/service_name,host_components/HostRoles/display_name,host_components/HostRoles/host_name,host_components/HostRoles/state,host_components/HostRoles/maintenance_state,host_components/HostRoles/stale_configs,host_components/HostRoles/ha_state,host_components/HostRoles/desired_admin_state,,host_components/metrics/jvm/memHeapUsedM,host_components/metrics/jvm/HeapMemoryMax,host_components/metrics/jvm/HeapMemoryUsed,host_components/metrics/jvm/memHeapCommittedM,host_components/metrics/mapred/jobtracker/trackers_decommissioned,host_components/metrics/cpu/cpu_wio,host_components/metrics/rpc/client/RpcQueueTime_avg_time,host_components/metrics/dfs/FSNamesystem/*,host_components/metrics/dfs/namenode/Version,host_components/metrics/dfs/namenode/LiveNodes,host_components/metrics/dfs/namenode/DeadNodes,host_components/metrics/dfs/namenode/DecomNodes,host_components/metrics/dfs/namenode/TotalFiles,host_components/metrics/dfs/namenode/UpgradeFinalized,host_components/metrics/dfs/namenode/Safemode,host_components/metrics/runtime/StartTime,host_components/metrics/hbase/master/IsActiveMaster,host_components/metrics/hbase/master/MasterStartTime,host_components/metrics/hbase/master/MasterActiveTime,host_components/metrics/hbase/master/AverageLoad,host_components/metrics/master/AssignmentManger/ritCount,host_components/metrics/yarn/Queue,host_components/metrics/yarn/ClusterMetrics/NumActiveNMs,host_components/metrics/yarn/ClusterMetrics/NumLostNMs,host_components/metrics/yarn/ClusterMetrics/NumUnhealthyNMs,host_components/metrics/yarn/ClusterMetrics/NumRebootedNMs,host_components/metrics/yarn/ClusterMetrics/NumDecommissionedNMs&minimal_response=true&_=1469047954755
> {code}
> Ambari UI makes this call every 10 seconds and hence this is relevant change.
> AMS calls:
> {code}
> 21 Jul 2016 23:43:20,840 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-1&appId=HOST
> 21 Jul 2016 23:43:20,869 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-1&appId=NAMENODE
> 21 Jul 2016 23:43:20,890 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-3&appId=HOST
> 21 Jul 2016 23:43:20,931 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-3&appId=NIMBUS
> 21 Jul 2016 23:43:20,948 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=cpu_wio&hostname=storm-metric-test-1&appId=HOST
> 21 Jul 2016 23:43:21,076 DEBUG [ambari-client-thread-27] MetricsRequestHelper:72 - Metrics request url = http://storm-metric-test-1:6188/ws/v1/timeline/metrics?metricNames=master.Server.averageLoad&hostname=storm-metric-test-1&appId=AMS-HBASE
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)