You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Artem Baranchuk <ab...@hortonworks.com> on 2014/04/02 19:00:44 UTC
Review Request 19945: FilesCreated is missing in NameNode dfs metrics.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19945/
-----------------------------------------------------------
Review request for Ambari and Tom Beerbower.
Bugs: AMBARI-5324
https://issues.apache.org/jira/browse/AMBARI-5324
Repository: ambari
Description
-------
FilesCreated is missing in NameNode dfs metrics.
Diffs
-----
contrib/ambari-scom/ambari-scom-server/src/main/resources/sqlserver_properties.json 5422867
Diff: https://reviews.apache.org/r/19945/diff/
Testing
-------
Tested manually.
API response:
{
"href" : "http://winhdp-1:8080/api/v1/clusters/ambari/services/HDFS/components/NAMENODE?fields=metrics/dfs",
"ServiceComponentInfo" : {
"cluster_name" : "ambari",
"component_name" : "NAMENODE",
"service_name" : "HDFS"
},
"metrics" : {
"dfs" : {
"FSNamesystem" : {
"BlockCapacity" : 2097152,
"BlocksTotal" : 0,
"CapacityRemaining" : 130285973504,
"CapacityRemainingGB" : 121.0,
"CapacityTotal" : 159618428928,
"CapacityTotalGB" : 149.0,
"CapacityUsed" : 131,
"CapacityUsedGB" : 0.0,
"CorruptBlocks" : 0,
"ExcessBlocks" : 0,
"FilesTotal" : 5,
"MissingBlocks" : 0,
"PendingDeletionBlocks" : 0,
"PendingReplicationBlocks" : 0,
"ScheduledReplicationBlocks" : 0,
"TotalLoad" : 1,
"UnderReplicatedBlocks" : 0
},
"namenode" : {
"DeadNodes" : "{}",
"DecomNodes" : "{}",
"DeleteFileOps" : 0,
"FilesAppended" : 0,
"FilesCreated" : 0,
"FilesDeleted" : 0,
"FilesRenamed" : 0,
"Free" : 130284171264,
"JournalTransactionsBatchedInSync" : 0,
"LiveNodes" : "{\"WINHDP-1.ambari.scom\":{\"numBlocks\":0,\"usedSpace\":131,\"lastContact\":2,\"capacity\":159618428928,\"nonDfsUsedSpace\":29334257533,\"adminState\":\"In Service\",\"version\":\"2.2.0.2.0.6.0-0009\"}}",
"NameDirStatuses" : "{\"failed\":{},\"active\":{\"C:\\\\hadoop\\\\data\\\\hdfs\\\\nn\":\"IMAGE_AND_EDITS\"}}",
"NonDfsUsedSpace" : 29334257533,
"PercentRemaining" : 81.62226,
"PercentUsed" : 8.207072E-8,
"Safemode" : "",
"SafemodeTime" : 7088,
"Threads" : 64,
"Total" : 159618428928,
"TotalBlocks" : 0,
"TotalFiles" : 5,
"UpgradeFinalized" : true,
"Used" : 131,
"Version" : "2.2.0.2.0.6.0-0009, rb845729d6990bc11889a5bdefaf6d2221ef9e6d1",
"fsImageLoadTime" : 3223
}
}
}
}
Test results:
Results :
Tests run: 74, Failures: 0, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.235s
[INFO] Finished at: Wed Apr 02 19:50:34 EEST 2014
[INFO] Final Memory: 11M/306M
[INFO] ------------------------------------------------------------------------
Thanks,
Artem Baranchuk
Re: Review Request 19945: FilesCreated is missing in NameNode dfs metrics.
Posted by Tom Beerbower <tb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19945/#review39295
-----------------------------------------------------------
Ship it!
Ship It!
- Tom Beerbower
On April 2, 2014, 5 p.m., Artem Baranchuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19945/
> -----------------------------------------------------------
>
> (Updated April 2, 2014, 5 p.m.)
>
>
> Review request for Ambari and Tom Beerbower.
>
>
> Bugs: AMBARI-5324
> https://issues.apache.org/jira/browse/AMBARI-5324
>
>
> Repository: ambari
>
>
> Description
> -------
>
> FilesCreated is missing in NameNode dfs metrics.
>
>
> Diffs
> -----
>
> contrib/ambari-scom/ambari-scom-server/src/main/resources/sqlserver_properties.json 5422867
>
> Diff: https://reviews.apache.org/r/19945/diff/
>
>
> Testing
> -------
>
> Tested manually.
> API response:
>
> {
> "href" : "http://winhdp-1:8080/api/v1/clusters/ambari/services/HDFS/components/NAMENODE?fields=metrics/dfs",
> "ServiceComponentInfo" : {
> "cluster_name" : "ambari",
> "component_name" : "NAMENODE",
> "service_name" : "HDFS"
> },
> "metrics" : {
> "dfs" : {
> "FSNamesystem" : {
> "BlockCapacity" : 2097152,
> "BlocksTotal" : 0,
> "CapacityRemaining" : 130285973504,
> "CapacityRemainingGB" : 121.0,
> "CapacityTotal" : 159618428928,
> "CapacityTotalGB" : 149.0,
> "CapacityUsed" : 131,
> "CapacityUsedGB" : 0.0,
> "CorruptBlocks" : 0,
> "ExcessBlocks" : 0,
> "FilesTotal" : 5,
> "MissingBlocks" : 0,
> "PendingDeletionBlocks" : 0,
> "PendingReplicationBlocks" : 0,
> "ScheduledReplicationBlocks" : 0,
> "TotalLoad" : 1,
> "UnderReplicatedBlocks" : 0
> },
> "namenode" : {
> "DeadNodes" : "{}",
> "DecomNodes" : "{}",
> "DeleteFileOps" : 0,
> "FilesAppended" : 0,
> "FilesCreated" : 0,
> "FilesDeleted" : 0,
> "FilesRenamed" : 0,
> "Free" : 130284171264,
> "JournalTransactionsBatchedInSync" : 0,
> "LiveNodes" : "{\"WINHDP-1.ambari.scom\":{\"numBlocks\":0,\"usedSpace\":131,\"lastContact\":2,\"capacity\":159618428928,\"nonDfsUsedSpace\":29334257533,\"adminState\":\"In Service\",\"version\":\"2.2.0.2.0.6.0-0009\"}}",
> "NameDirStatuses" : "{\"failed\":{},\"active\":{\"C:\\\\hadoop\\\\data\\\\hdfs\\\\nn\":\"IMAGE_AND_EDITS\"}}",
> "NonDfsUsedSpace" : 29334257533,
> "PercentRemaining" : 81.62226,
> "PercentUsed" : 8.207072E-8,
> "Safemode" : "",
> "SafemodeTime" : 7088,
> "Threads" : 64,
> "Total" : 159618428928,
> "TotalBlocks" : 0,
> "TotalFiles" : 5,
> "UpgradeFinalized" : true,
> "Used" : 131,
> "Version" : "2.2.0.2.0.6.0-0009, rb845729d6990bc11889a5bdefaf6d2221ef9e6d1",
> "fsImageLoadTime" : 3223
> }
> }
> }
> }
>
>
> Test results:
>
> Results :
>
> Tests run: 74, Failures: 0, Errors: 0, Skipped: 0
>
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 6.235s
> [INFO] Finished at: Wed Apr 02 19:50:34 EEST 2014
> [INFO] Final Memory: 11M/306M
> [INFO] ------------------------------------------------------------------------
>
>
> Thanks,
>
> Artem Baranchuk
>
>
Re: Review Request 19945: FilesCreated is missing in NameNode dfs metrics.
Posted by Artem Baranchuk <ab...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19945/
-----------------------------------------------------------
(Updated April 2, 2014, 5 p.m.)
Review request for Ambari and Tom Beerbower.
Bugs: AMBARI-5324
https://issues.apache.org/jira/browse/AMBARI-5324
Repository: ambari
Description
-------
FilesCreated is missing in NameNode dfs metrics.
Diffs
-----
contrib/ambari-scom/ambari-scom-server/src/main/resources/sqlserver_properties.json 5422867
Diff: https://reviews.apache.org/r/19945/diff/
Testing
-------
Tested manually.
API response:
{
"href" : "http://winhdp-1:8080/api/v1/clusters/ambari/services/HDFS/components/NAMENODE?fields=metrics/dfs",
"ServiceComponentInfo" : {
"cluster_name" : "ambari",
"component_name" : "NAMENODE",
"service_name" : "HDFS"
},
"metrics" : {
"dfs" : {
"FSNamesystem" : {
"BlockCapacity" : 2097152,
"BlocksTotal" : 0,
"CapacityRemaining" : 130285973504,
"CapacityRemainingGB" : 121.0,
"CapacityTotal" : 159618428928,
"CapacityTotalGB" : 149.0,
"CapacityUsed" : 131,
"CapacityUsedGB" : 0.0,
"CorruptBlocks" : 0,
"ExcessBlocks" : 0,
"FilesTotal" : 5,
"MissingBlocks" : 0,
"PendingDeletionBlocks" : 0,
"PendingReplicationBlocks" : 0,
"ScheduledReplicationBlocks" : 0,
"TotalLoad" : 1,
"UnderReplicatedBlocks" : 0
},
"namenode" : {
"DeadNodes" : "{}",
"DecomNodes" : "{}",
"DeleteFileOps" : 0,
"FilesAppended" : 0,
"FilesCreated" : 0,
"FilesDeleted" : 0,
"FilesRenamed" : 0,
"Free" : 130284171264,
"JournalTransactionsBatchedInSync" : 0,
"LiveNodes" : "{\"WINHDP-1.ambari.scom\":{\"numBlocks\":0,\"usedSpace\":131,\"lastContact\":2,\"capacity\":159618428928,\"nonDfsUsedSpace\":29334257533,\"adminState\":\"In Service\",\"version\":\"2.2.0.2.0.6.0-0009\"}}",
"NameDirStatuses" : "{\"failed\":{},\"active\":{\"C:\\\\hadoop\\\\data\\\\hdfs\\\\nn\":\"IMAGE_AND_EDITS\"}}",
"NonDfsUsedSpace" : 29334257533,
"PercentRemaining" : 81.62226,
"PercentUsed" : 8.207072E-8,
"Safemode" : "",
"SafemodeTime" : 7088,
"Threads" : 64,
"Total" : 159618428928,
"TotalBlocks" : 0,
"TotalFiles" : 5,
"UpgradeFinalized" : true,
"Used" : 131,
"Version" : "2.2.0.2.0.6.0-0009, rb845729d6990bc11889a5bdefaf6d2221ef9e6d1",
"fsImageLoadTime" : 3223
}
}
}
}
Test results:
Results :
Tests run: 74, Failures: 0, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.235s
[INFO] Finished at: Wed Apr 02 19:50:34 EEST 2014
[INFO] Final Memory: 11M/306M
[INFO] ------------------------------------------------------------------------
Thanks,
Artem Baranchuk