You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/11/20 07:52:38 UTC
issue about rpc activity metrics
hi,all:
i get rpc metrics from NN 50070 port ,and i try search the code to
see how these metrics is caculated,
i try to use grep,but get nothing ,why?
[root@CH124 hadoop-2.0.0-cdh4.3.0]# grep -R 'DeleteNumOps' *
{
"name" : "Hadoop:service=NameNode,name=RpcDetailedActivityForPort8020",
"modelerType" : "RpcDetailedActivityForPort8020",
"tag.port" : "8020",
"tag.Context" : "rpcdetailed",
"tag.Hostname" : "CHBM220",
"SendHeartbeatNumOps" : 106434,
"SendHeartbeatAvgTime" : 0.05366726296958853,
"VersionRequestNumOps" : 9,
"VersionRequestAvgTime" : 0.7777777777777777,
"RegisterDatanodeNumOps" : 9,
"RegisterDatanodeAvgTime" : 2.2222222222222223,
"BlockReportNumOps" : 24,
"BlockReportAvgTime" : 3.0,
"GetServiceStatusNumOps" : 63811,
"GetServiceStatusAvgTime" : 0.05970149253731349,
"MonitorHealthNumOps" : 63811,
"MonitorHealthAvgTime" : 0.0686567164179105,
"TransitionToStandbyNumOps" : 3,
"TransitionToStandbyAvgTime" : 27.333333333333336,
"TransitionToActiveNumOps" : 1,
"TransitionToActiveAvgTime" : 8026.0,
"RollEditLogNumOps" : 210,
"RollEditLogAvgTime" : 306.7428571428572,
"GetListingNumOps" : 516,
"GetListingAvgTime" : 0.18798449612403115,
"GetFileInfoNumOps" : 507,
"GetFileInfoAvgTime" : 0.12228796844181453,
"CreateNumOps" : 4,
"CreateAvgTime" : 53.5,
"CompleteNumOps" : 4,
"CompleteAvgTime" : 45.0,
"SetOwnerNumOps" : 4,
"SetOwnerAvgTime" : 43.0,
"DeleteNumOps" : 4,
"DeleteAvgTime" : 44.75
}
Re: issue about rpc activity metrics
Posted by Andrew Wang <an...@cloudera.com>.
The metrics system generates a number of different entries per in-code
metrics object. For instance, the "SendHeartbeat" MutableRate will
generate both "NumOps" and "AvgTime". Look in NameNodeMetrics.java for
where these are updated.
Best,
Andrew
On Tue, Nov 19, 2013 at 10:52 PM, ch huang <ju...@gmail.com> wrote:
> hi,all:
> i get rpc metrics from NN 50070 port ,and i try search the code to
> see how these metrics is caculated,
> i try to use grep,but get nothing ,why?
> [root@CH124 hadoop-2.0.0-cdh4.3.0]# grep -R 'DeleteNumOps' *
> {
> "name" : "Hadoop:service=NameNode,name=RpcDetailedActivityForPort8020",
> "modelerType" : "RpcDetailedActivityForPort8020",
> "tag.port" : "8020",
> "tag.Context" : "rpcdetailed",
> "tag.Hostname" : "CHBM220",
> "SendHeartbeatNumOps" : 106434,
> "SendHeartbeatAvgTime" : 0.05366726296958853,
> "VersionRequestNumOps" : 9,
> "VersionRequestAvgTime" : 0.7777777777777777,
> "RegisterDatanodeNumOps" : 9,
> "RegisterDatanodeAvgTime" : 2.2222222222222223,
> "BlockReportNumOps" : 24,
> "BlockReportAvgTime" : 3.0,
> "GetServiceStatusNumOps" : 63811,
> "GetServiceStatusAvgTime" : 0.05970149253731349,
> "MonitorHealthNumOps" : 63811,
> "MonitorHealthAvgTime" : 0.0686567164179105,
> "TransitionToStandbyNumOps" : 3,
> "TransitionToStandbyAvgTime" : 27.333333333333336,
> "TransitionToActiveNumOps" : 1,
> "TransitionToActiveAvgTime" : 8026.0,
> "RollEditLogNumOps" : 210,
> "RollEditLogAvgTime" : 306.7428571428572,
> "GetListingNumOps" : 516,
> "GetListingAvgTime" : 0.18798449612403115,
> "GetFileInfoNumOps" : 507,
> "GetFileInfoAvgTime" : 0.12228796844181453,
> "CreateNumOps" : 4,
> "CreateAvgTime" : 53.5,
> "CompleteNumOps" : 4,
> "CompleteAvgTime" : 45.0,
> "SetOwnerNumOps" : 4,
> "SetOwnerAvgTime" : 43.0,
> "DeleteNumOps" : 4,
> "DeleteAvgTime" : 44.75
> }
>