You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by lei liu <li...@gmail.com> on 2013/08/06 08:17:07 UTC
throughput metrics in hadoop-2.0.5
I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
content.
*.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
*.sink.ganglia.period=10
*.sink.ganglia.supportsparse=true
namenode.sink.ganglia.servers=10.232.98.74:8649
datanode.sink.ganglia.servers=10.232.98.74:8649
I write one programme that call
FSDataOutputStream<eclipse-javadoc:%E2%98%82=hadoop-hdfs/C:%5C/Users%5C/musa.ll%5C/.m2%5C/repository%5C/org%5C/apache%5C/hadoop%5C/hadoop-common%5C/2.0.0-cdh4.3.0%5C/hadoop-common-2.0.0-cdh4.3.0.jar%3Corg.apache.hadoop.fs%28FSDataOutputStream.class%E2%98%83FSDataOutputStream>.hsync()
method once per second.
There is "@Metric MutableCounterLong fsyncCount" metrics in
DataNodeMetrics, the MutableCounterLong class continuously increase the
value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
but the value in ganglia is below:
[image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
I want to know the ganglia how to display the value of MutableCounterLong
class?
Thanks,
LiuLei
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zero per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> Is the the value of MutableCounterLong class set to zreo per 10 seconds?
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
>> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
>> , 1" in ganglia.
>>
>> How does ganglia to display the value of MutableCounterLong class? Is
>> that "fsyncCount.value" or "fsyncCount.value/10"?
>>
>>
>>
>>
>> 2013/8/6 lei liu <li...@gmail.com>
>>
>>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>>> content.
>>>
>>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>>> *.sink.ganglia.period=10
>>> *.sink.ganglia.supportsparse=true
>>> namenode.sink.ganglia.servers=10.232.98.74:8649
>>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>>
>>> I write one programme that call FSDataOutputStream.hsync() method once
>>> per second.
>>>
>>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>>> but the value in ganglia is below:
>>>
>>>
>>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>>
>>>
>>> I want to know the ganglia how to display the value of
>>> MutableCounterLong class?
>>>
>>> Thanks,
>>>
>>> LiuLei
>>>
>>
>>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zero per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> Is the the value of MutableCounterLong class set to zreo per 10 seconds?
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
>> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
>> , 1" in ganglia.
>>
>> How does ganglia to display the value of MutableCounterLong class? Is
>> that "fsyncCount.value" or "fsyncCount.value/10"?
>>
>>
>>
>>
>> 2013/8/6 lei liu <li...@gmail.com>
>>
>>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>>> content.
>>>
>>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>>> *.sink.ganglia.period=10
>>> *.sink.ganglia.supportsparse=true
>>> namenode.sink.ganglia.servers=10.232.98.74:8649
>>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>>
>>> I write one programme that call FSDataOutputStream.hsync() method once
>>> per second.
>>>
>>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>>> but the value in ganglia is below:
>>>
>>>
>>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>>
>>>
>>> I want to know the ganglia how to display the value of
>>> MutableCounterLong class?
>>>
>>> Thanks,
>>>
>>> LiuLei
>>>
>>
>>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zero per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> Is the the value of MutableCounterLong class set to zreo per 10 seconds?
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
>> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
>> , 1" in ganglia.
>>
>> How does ganglia to display the value of MutableCounterLong class? Is
>> that "fsyncCount.value" or "fsyncCount.value/10"?
>>
>>
>>
>>
>> 2013/8/6 lei liu <li...@gmail.com>
>>
>>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>>> content.
>>>
>>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>>> *.sink.ganglia.period=10
>>> *.sink.ganglia.supportsparse=true
>>> namenode.sink.ganglia.servers=10.232.98.74:8649
>>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>>
>>> I write one programme that call FSDataOutputStream.hsync() method once
>>> per second.
>>>
>>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>>> but the value in ganglia is below:
>>>
>>>
>>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>>
>>>
>>> I want to know the ganglia how to display the value of
>>> MutableCounterLong class?
>>>
>>> Thanks,
>>>
>>> LiuLei
>>>
>>
>>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zero per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> Is the the value of MutableCounterLong class set to zreo per 10 seconds?
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
>> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
>> , 1" in ganglia.
>>
>> How does ganglia to display the value of MutableCounterLong class? Is
>> that "fsyncCount.value" or "fsyncCount.value/10"?
>>
>>
>>
>>
>> 2013/8/6 lei liu <li...@gmail.com>
>>
>>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>>> content.
>>>
>>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>>> *.sink.ganglia.period=10
>>> *.sink.ganglia.supportsparse=true
>>> namenode.sink.ganglia.servers=10.232.98.74:8649
>>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>>
>>> I write one programme that call FSDataOutputStream.hsync() method once
>>> per second.
>>>
>>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>>> but the value in ganglia is below:
>>>
>>>
>>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>>
>>>
>>> I want to know the ganglia how to display the value of
>>> MutableCounterLong class?
>>>
>>> Thanks,
>>>
>>> LiuLei
>>>
>>
>>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zreo per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
> , 1" in ganglia.
>
> How does ganglia to display the value of MutableCounterLong class? Is
> that "fsyncCount.value" or "fsyncCount.value/10"?
>
>
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>> content.
>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>> *.sink.ganglia.period=10
>> *.sink.ganglia.supportsparse=true
>> namenode.sink.ganglia.servers=10.232.98.74:8649
>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>
>> I write one programme that call FSDataOutputStream.hsync() method once
>> per second.
>>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>> but the value in ganglia is below:
>>
>>
>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>
>>
>> I want to know the ganglia how to display the value of MutableCounterLong
>> class?
>>
>> Thanks,
>>
>> LiuLei
>>
>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zreo per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
> , 1" in ganglia.
>
> How does ganglia to display the value of MutableCounterLong class? Is
> that "fsyncCount.value" or "fsyncCount.value/10"?
>
>
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>> content.
>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>> *.sink.ganglia.period=10
>> *.sink.ganglia.supportsparse=true
>> namenode.sink.ganglia.servers=10.232.98.74:8649
>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>
>> I write one programme that call FSDataOutputStream.hsync() method once
>> per second.
>>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>> but the value in ganglia is below:
>>
>>
>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>
>>
>> I want to know the ganglia how to display the value of MutableCounterLong
>> class?
>>
>> Thanks,
>>
>> LiuLei
>>
>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zreo per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
> , 1" in ganglia.
>
> How does ganglia to display the value of MutableCounterLong class? Is
> that "fsyncCount.value" or "fsyncCount.value/10"?
>
>
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>> content.
>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>> *.sink.ganglia.period=10
>> *.sink.ganglia.supportsparse=true
>> namenode.sink.ganglia.servers=10.232.98.74:8649
>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>
>> I write one programme that call FSDataOutputStream.hsync() method once
>> per second.
>>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>> but the value in ganglia is below:
>>
>>
>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>
>>
>> I want to know the ganglia how to display the value of MutableCounterLong
>> class?
>>
>> Thanks,
>>
>> LiuLei
>>
>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
Is the the value of MutableCounterLong class set to zreo per 10 seconds?
2013/8/6 lei liu <li...@gmail.com>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
> on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
> , 1" in ganglia.
>
> How does ganglia to display the value of MutableCounterLong class? Is
> that "fsyncCount.value" or "fsyncCount.value/10"?
>
>
>
>
> 2013/8/6 lei liu <li...@gmail.com>
>
>> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
>> content.
>> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
>> *.sink.ganglia.period=10
>> *.sink.ganglia.supportsparse=true
>> namenode.sink.ganglia.servers=10.232.98.74:8649
>> datanode.sink.ganglia.servers=10.232.98.74:8649
>>
>> I write one programme that call FSDataOutputStream.hsync() method once
>> per second.
>>
>> There is "@Metric MutableCounterLong fsyncCount" metrics in
>> DataNodeMetrics, the MutableCounterLong class continuously increase the
>> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
>> but the value in ganglia is below:
>>
>>
>> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>>
>>
>> I want to know the ganglia how to display the value of MutableCounterLong
>> class?
>>
>> Thanks,
>>
>> LiuLei
>>
>
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
There is "@Metric MutableCounterLong fsyncCount" metrics in
DataNodeMetrics, the MutableCounterLong class continuously increase the
value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
, 1" in ganglia.
How does ganglia to display the value of MutableCounterLong class? Is
that "fsyncCount.value" or "fsyncCount.value/10"?
2013/8/6 lei liu <li...@gmail.com>
> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
> content.
> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
> *.sink.ganglia.period=10
> *.sink.ganglia.supportsparse=true
> namenode.sink.ganglia.servers=10.232.98.74:8649
> datanode.sink.ganglia.servers=10.232.98.74:8649
>
> I write one programme that call FSDataOutputStream.hsync() method once
> per second.
>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
> but the value in ganglia is below:
>
>
> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>
>
> I want to know the ganglia how to display the value of MutableCounterLong
> class?
>
> Thanks,
>
> LiuLei
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
There is "@Metric MutableCounterLong fsyncCount" metrics in
DataNodeMetrics, the MutableCounterLong class continuously increase the
value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
, 1" in ganglia.
How does ganglia to display the value of MutableCounterLong class? Is
that "fsyncCount.value" or "fsyncCount.value/10"?
2013/8/6 lei liu <li...@gmail.com>
> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
> content.
> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
> *.sink.ganglia.period=10
> *.sink.ganglia.supportsparse=true
> namenode.sink.ganglia.servers=10.232.98.74:8649
> datanode.sink.ganglia.servers=10.232.98.74:8649
>
> I write one programme that call FSDataOutputStream.hsync() method once
> per second.
>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
> but the value in ganglia is below:
>
>
> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>
>
> I want to know the ganglia how to display the value of MutableCounterLong
> class?
>
> Thanks,
>
> LiuLei
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
There is "@Metric MutableCounterLong fsyncCount" metrics in
DataNodeMetrics, the MutableCounterLong class continuously increase the
value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
, 1" in ganglia.
How does ganglia to display the value of MutableCounterLong class? Is
that "fsyncCount.value" or "fsyncCount.value/10"?
2013/8/6 lei liu <li...@gmail.com>
> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
> content.
> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
> *.sink.ganglia.period=10
> *.sink.ganglia.supportsparse=true
> namenode.sink.ganglia.servers=10.232.98.74:8649
> datanode.sink.ganglia.servers=10.232.98.74:8649
>
> I write one programme that call FSDataOutputStream.hsync() method once
> per second.
>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
> but the value in ganglia is below:
>
>
> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>
>
> I want to know the ganglia how to display the value of MutableCounterLong
> class?
>
> Thanks,
>
> LiuLei
>
Re: throughput metrics in hadoop-2.0.5
Posted by lei liu <li...@gmail.com>.
There is "@Metric MutableCounterLong fsyncCount" metrics in
DataNodeMetrics, the MutableCounterLong class continuously increase the
value, so I think the value in ganglia should be "10, 20 ,30, 40" and so
on. but the value the value is fsyncCount.value/10, that is in "1 ,1 , 1
, 1" in ganglia.
How does ganglia to display the value of MutableCounterLong class? Is
that "fsyncCount.value" or "fsyncCount.value/10"?
2013/8/6 lei liu <li...@gmail.com>
> I use hadoop-2.0.5 and config hadoop-metrics2.properties file with below
> content.
> *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31
> *.sink.ganglia.period=10
> *.sink.ganglia.supportsparse=true
> namenode.sink.ganglia.servers=10.232.98.74:8649
> datanode.sink.ganglia.servers=10.232.98.74:8649
>
> I write one programme that call FSDataOutputStream.hsync() method once
> per second.
>
> There is "@Metric MutableCounterLong fsyncCount" metrics in
> DataNodeMetrics, the MutableCounterLong class continuously increase the
> value, so I think the value in ganglia should be 10, 20 ,30, 40 and so on.
> but the value in ganglia is below:
>
>
> [image: dw62.kgb.sqa.cm4 dfs.datanode.FsyncCount]
>
>
> I want to know the ganglia how to display the value of MutableCounterLong
> class?
>
> Thanks,
>
> LiuLei
>