You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Artem Baranchuk <ab...@hortonworks.com> on 2014/03/07 02:17:47 UTC
Review Request 18880: Namenode JMX metrics category changed from
FSNamesystemMetrics to FSNamesystem in Hadoop 2
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18880/
-----------------------------------------------------------
Review request for Ambari and Tom Beerbower.
Bugs: AMBARI-4980
https://issues.apache.org/jira/browse/AMBARI-4980
Repository: ambari
Description
-------
Namenode JMX metrics category changed from FSNamesystemMetrics to FSNamesystem in Hadoop 2
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/HDFS/metrics.json f33a0c0
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/metrics.json f33a0c0
ambari-server/src/test/resources/stacks/HDP/2.0.5/services/HDFS/metrics.json 79e1fb7
ambari-server/src/test/resources/stacks/HDP/2.0.7/services/HDFS/metrics.json f33a0c0
contrib/ambari-scom/ambari-scom-server/src/main/resources/jmx_properties.json e08edd5
Diff: https://reviews.apache.org/r/18880/diff/
Testing
-------
Before applying the patch:
{
"href" : "http://192.168.56.101:8080/api/v1/clusters/c1/services/HDFS/components/NAMENODE?fields=metrics/dfs",
"ServiceComponentInfo" : {
"cluster_name" : "c1",
"component_name" : "NAMENODE",
"service_name" : "HDFS"
},
"metrics" : {
"dfs" : {
"namenode" : {
"DeadNodes" : "{}",
"DecomNodes" : "{}",
"DeleteFileOps" : 0.0111111111111,
"FilesAppended" : 0.0,
"FilesDeleted" : 0.0388888888889,
"FilesRenamed" : 0.328888888889,
"Free" : 44889354240,
"LiveNodes" : "{\"dev01.hortonworks.com\":{\"numBlocks\":457,\"usedSpace\":389750784,\"lastContact\":2,\"capacity\":51770945536,\"nonDfsUsedSpace\":6491840512,\"adminState\":\"In Service\",\"version\":\"2.2.0.2.0.6.0-101\"}}",
"NameDirStatuses" : "{\"failed\":{},\"active\":{\"/hadoop/hdfs/namenode\":\"IMAGE_AND_EDITS\"}}",
"NonDfsUsedSpace" : 6491840512,
"PercentRemaining" : 86.70762,
"PercentUsed" : 0.7528369,
"Safemode" : "",
"Threads" : 120,
"Total" : 51770945536,
"TotalBlocks" : 459,
"TotalFiles" : 600,
"UpgradeFinalized" : true,
"Used" : 389750784,
"Version" : "2.2.0.2.0.6.0-101, rb07b2906c36defd389c8b5bd22bebc1bead8115b",
"fsImageLoadTime" : 2718.0
}
}
}
}
After applying the patch:
{
"href" : "http://192.168.56.101:8080/api/v1/clusters/c1/services/HDFS/components/NAMENODE?fields=metrics/dfs",
"ServiceComponentInfo" : {
"cluster_name" : "c1",
"component_name" : "NAMENODE",
"service_name" : "HDFS"
},
"metrics" : {
"dfs" : {
"FSNamesystem" : {
"BlockCapacity" : 2097152,
"BlocksTotal" : 461,
"CapacityRemaining" : 44888518656,
"CapacityRemainingGB" : 42.0,
"CapacityTotal" : 51770945536,
"CapacityTotalGB" : 48.0,
"CapacityUsed" : 389767168,
"CapacityUsedGB" : 0.0,
"CorruptBlocks" : 0,
"ExcessBlocks" : 0,
"FilesTotal" : 604,
"MissingBlocks" : 0,
"PendingDeletionBlocks" : 0,
"PendingReplicationBlocks" : 0,
"ScheduledReplicationBlocks" : 0,
"TotalLoad" : 6,
"UnderReplicatedBlocks" : 459
},
"namenode" : {
"DeadNodes" : "{}",
"DecomNodes" : "{}",
"Free" : 44888518656,
"LiveNodes" : "{\"dev01.hortonworks.com\":{\"numBlocks\":459,\"usedSpace\":389767168,\"lastContact\":1,\"capacity\":51770945536,\"nonDfsUsedSpace\":6492659712,\"adminState\":\"In Service\",\"version\":\"2.2.0.2.0.6.0-101\"}}",
"NameDirStatuses" : "{\"failed\":{},\"active\":{\"/hadoop/hdfs/namenode\":\"IMAGE_AND_EDITS\"}}",
"NonDfsUsedSpace" : 6492659712,
"PercentRemaining" : 86.706,
"PercentUsed" : 0.75286853,
"Safemode" : "",
"Threads" : 120,
"Total" : 51770945536,
"TotalBlocks" : 461,
"TotalFiles" : 604,
"UpgradeFinalized" : true,
"Used" : 389767168,
"Version" : "2.2.0.2.0.6.0-101, rb07b2906c36defd389c8b5bd22bebc1bead8115b"
}
}
}
}
Test result after applying the patch:
Results :
Tests run: 1477, Failures: 0, Errors: 0, Skipped: 9
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:16:24.791s
[INFO] Finished at: Thu Mar 06 17:13:55 PST 2014
[INFO] Final Memory: 43M/172M
[INFO] ------------------------------------------------------------------------
Thanks,
Artem Baranchuk
Re: Review Request 18880: Namenode JMX metrics category changed from
FSNamesystemMetrics to FSNamesystem in Hadoop 2
Posted by Tom Beerbower <tb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18880/#review36479
-----------------------------------------------------------
Ship it!
Ship It!
- Tom Beerbower
On March 7, 2014, 1:17 a.m., Artem Baranchuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/18880/
> -----------------------------------------------------------
>
> (Updated March 7, 2014, 1:17 a.m.)
>
>
> Review request for Ambari and Tom Beerbower.
>
>
> Bugs: AMBARI-4980
> https://issues.apache.org/jira/browse/AMBARI-4980
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Namenode JMX metrics category changed from FSNamesystemMetrics to FSNamesystem in Hadoop 2
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/HDFS/metrics.json f33a0c0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/metrics.json f33a0c0
> ambari-server/src/test/resources/stacks/HDP/2.0.5/services/HDFS/metrics.json 79e1fb7
> ambari-server/src/test/resources/stacks/HDP/2.0.7/services/HDFS/metrics.json f33a0c0
> contrib/ambari-scom/ambari-scom-server/src/main/resources/jmx_properties.json e08edd5
>
> Diff: https://reviews.apache.org/r/18880/diff/
>
>
> Testing
> -------
>
> Before applying the patch:
>
> {
> "href" : "http://192.168.56.101:8080/api/v1/clusters/c1/services/HDFS/components/NAMENODE?fields=metrics/dfs",
> "ServiceComponentInfo" : {
> "cluster_name" : "c1",
> "component_name" : "NAMENODE",
> "service_name" : "HDFS"
> },
> "metrics" : {
> "dfs" : {
> "namenode" : {
> "DeadNodes" : "{}",
> "DecomNodes" : "{}",
> "DeleteFileOps" : 0.0111111111111,
> "FilesAppended" : 0.0,
> "FilesDeleted" : 0.0388888888889,
> "FilesRenamed" : 0.328888888889,
> "Free" : 44889354240,
> "LiveNodes" : "{\"dev01.hortonworks.com\":{\"numBlocks\":457,\"usedSpace\":389750784,\"lastContact\":2,\"capacity\":51770945536,\"nonDfsUsedSpace\":6491840512,\"adminState\":\"In Service\",\"version\":\"2.2.0.2.0.6.0-101\"}}",
> "NameDirStatuses" : "{\"failed\":{},\"active\":{\"/hadoop/hdfs/namenode\":\"IMAGE_AND_EDITS\"}}",
> "NonDfsUsedSpace" : 6491840512,
> "PercentRemaining" : 86.70762,
> "PercentUsed" : 0.7528369,
> "Safemode" : "",
> "Threads" : 120,
> "Total" : 51770945536,
> "TotalBlocks" : 459,
> "TotalFiles" : 600,
> "UpgradeFinalized" : true,
> "Used" : 389750784,
> "Version" : "2.2.0.2.0.6.0-101, rb07b2906c36defd389c8b5bd22bebc1bead8115b",
> "fsImageLoadTime" : 2718.0
> }
> }
> }
> }
>
>
> After applying the patch:
>
> {
> "href" : "http://192.168.56.101:8080/api/v1/clusters/c1/services/HDFS/components/NAMENODE?fields=metrics/dfs",
> "ServiceComponentInfo" : {
> "cluster_name" : "c1",
> "component_name" : "NAMENODE",
> "service_name" : "HDFS"
> },
> "metrics" : {
> "dfs" : {
> "FSNamesystem" : {
> "BlockCapacity" : 2097152,
> "BlocksTotal" : 461,
> "CapacityRemaining" : 44888518656,
> "CapacityRemainingGB" : 42.0,
> "CapacityTotal" : 51770945536,
> "CapacityTotalGB" : 48.0,
> "CapacityUsed" : 389767168,
> "CapacityUsedGB" : 0.0,
> "CorruptBlocks" : 0,
> "ExcessBlocks" : 0,
> "FilesTotal" : 604,
> "MissingBlocks" : 0,
> "PendingDeletionBlocks" : 0,
> "PendingReplicationBlocks" : 0,
> "ScheduledReplicationBlocks" : 0,
> "TotalLoad" : 6,
> "UnderReplicatedBlocks" : 459
> },
> "namenode" : {
> "DeadNodes" : "{}",
> "DecomNodes" : "{}",
> "Free" : 44888518656,
> "LiveNodes" : "{\"dev01.hortonworks.com\":{\"numBlocks\":459,\"usedSpace\":389767168,\"lastContact\":1,\"capacity\":51770945536,\"nonDfsUsedSpace\":6492659712,\"adminState\":\"In Service\",\"version\":\"2.2.0.2.0.6.0-101\"}}",
> "NameDirStatuses" : "{\"failed\":{},\"active\":{\"/hadoop/hdfs/namenode\":\"IMAGE_AND_EDITS\"}}",
> "NonDfsUsedSpace" : 6492659712,
> "PercentRemaining" : 86.706,
> "PercentUsed" : 0.75286853,
> "Safemode" : "",
> "Threads" : 120,
> "Total" : 51770945536,
> "TotalBlocks" : 461,
> "TotalFiles" : 604,
> "UpgradeFinalized" : true,
> "Used" : 389767168,
> "Version" : "2.2.0.2.0.6.0-101, rb07b2906c36defd389c8b5bd22bebc1bead8115b"
> }
> }
> }
> }
>
>
> Test result after applying the patch:
>
> Results :
>
> Tests run: 1477, Failures: 0, Errors: 0, Skipped: 9
>
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 1:16:24.791s
> [INFO] Finished at: Thu Mar 06 17:13:55 PST 2014
> [INFO] Final Memory: 43M/172M
> [INFO] ------------------------------------------------------------------------
>
>
> Thanks,
>
> Artem Baranchuk
>
>