You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2015/02/13 04:38:11 UTC

[jira] [Commented] (AMBARI-9611) RU - Finalize Fails When Ganglia Is Installed, change versionAdvertised to default to false

    [ https://issues.apache.org/jira/browse/AMBARI-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319528#comment-14319528 ] 

Hadoop QA commented on AMBARI-9611:
-----------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12698570/AMBARI-9611.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:red}-1 tests included{color}.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in ambari-server:

                  org.apache.ambari.server.controller.internal.UpgradeResourceProviderTest

Test results: https://builds.apache.org/job/Ambari-trunk-test-patch/1667//testReport/
Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/1667//console

This message is automatically generated.

> RU - Finalize Fails When Ganglia Is Installed, change versionAdvertised to default to false
> -------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-9611
>                 URL: https://issues.apache.org/jira/browse/AMBARI-9611
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.0.0
>            Reporter: Alejandro Fernandez
>            Assignee: Alejandro Fernandez
>             Fix For: 2.0.0
>
>         Attachments: AMBARI-9611.patch
>
>
> Install the following services in a new cluster: HDFS, YARN, MapR, Tez, Hive, HBase, Pig, Scoop, Oozie, ZK, Falcon, Storm, Flume, Knox, Slider, Kafka, Ganglia.
> Notice that Ganglia is installed instead of AMS. This simulates an upgrade environment from Ambari 1.7.0 to 2.0.0 where Ganglia was kept (which is a valid use case).
> Perform an upgrade - it gets to Finalize but then fails. The suspect here was Ganglia. I then removed Ganglia via the API and retried Finalize, but the Finalize task was frozen. No output in the logs.
> {noformat:title=Upgrade Tasks After Finalize Retry (last is stuck)}
> {
>   "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/?fields=upgrade_groups/upgrade_items/UpgradeItem/status,upgrade_groups/upgrade_items/UpgradeItem/context,upgrade_groups/UpgradeGroup/title",
>   "Upgrade" : {
>     "cluster_name" : "c1",
>     "request_id" : 53
>   },
>   "upgrade_groups" : [
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1",
>       "UpgradeGroup" : {
>         "group_id" : 1,
>         "request_id" : 53,
>         "title" : "Prepare Backups"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/1",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Pre Upgrade HDFS",
>             "group_id" : 1,
>             "request_id" : 53,
>             "stage_id" : 1,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/2",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Pre Upgrade HBASE",
>             "group_id" : 1,
>             "request_id" : 53,
>             "stage_id" : 2,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/3",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Pre Upgrade HIVE",
>             "group_id" : 1,
>             "request_id" : 53,
>             "stage_id" : 3,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/4",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Pre Upgrade OOZIE",
>             "group_id" : 1,
>             "request_id" : 53,
>             "stage_id" : 4,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2",
>       "UpgradeGroup" : {
>         "group_id" : 2,
>         "request_id" : 53,
>         "title" : "ZooKeeper"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/5",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting ZooKeeper Server on c6403.ambari.apache.org",
>             "group_id" : 2,
>             "request_id" : 53,
>             "stage_id" : 5,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/6",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting ZooKeeper Server on c6401.ambari.apache.org",
>             "group_id" : 2,
>             "request_id" : 53,
>             "stage_id" : 6,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/7",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting ZooKeeper Server on c6402.ambari.apache.org",
>             "group_id" : 2,
>             "request_id" : 53,
>             "stage_id" : 7,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/8",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check ZooKeeper",
>             "group_id" : 2,
>             "request_id" : 53,
>             "stage_id" : 8,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3",
>       "UpgradeGroup" : {
>         "group_id" : 3,
>         "request_id" : 53,
>         "title" : "Core Masters"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/9",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting JournalNode on c6403.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 9,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/10",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting JournalNode on c6401.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 10,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/11",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting JournalNode on c6402.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 11,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/12",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting NameNode on c6401.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 12,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/13",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting NameNode on c6402.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 13,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/14",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting History Server on c6402.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 14,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/15",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting App Timeline Server on c6402.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 15,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/16",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting ResourceManager on c6402.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 16,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/17",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HBase Master on c6401.ambari.apache.org",
>             "group_id" : 3,
>             "request_id" : 53,
>             "stage_id" : 17,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4",
>       "UpgradeGroup" : {
>         "group_id" : 4,
>         "request_id" : 53,
>         "title" : "All Service Checks"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/18",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HBase",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 18,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/19",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check MapReduce2",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 19,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/20",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HDFS",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 20,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/21",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check YARN",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 21,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/22",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check KAFKA",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 22,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/23",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check FALCON",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 23,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/24",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HIVE",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 24,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/25",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check ZooKeeper",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 25,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/26",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check STORM",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 26,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/27",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check OOZIE",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 27,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/28",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check KNOX",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 28,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/29",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check FLUME",
>             "group_id" : 4,
>             "request_id" : 53,
>             "stage_id" : 29,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5",
>       "UpgradeGroup" : {
>         "group_id" : 5,
>         "request_id" : 53,
>         "title" : "Core Slaves"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/30",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting DataNode on c6403.ambari.apache.org",
>             "group_id" : 5,
>             "request_id" : 53,
>             "stage_id" : 30,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/31",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting NodeManager on c6403.ambari.apache.org",
>             "group_id" : 5,
>             "request_id" : 53,
>             "stage_id" : 31,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/32",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting RegionServer on c6401.ambari.apache.org",
>             "group_id" : 5,
>             "request_id" : 53,
>             "stage_id" : 32,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/33",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Verification Required",
>             "group_id" : 5,
>             "request_id" : 53,
>             "stage_id" : 33,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6",
>       "UpgradeGroup" : {
>         "group_id" : 6,
>         "request_id" : 53,
>         "title" : "All Service Checks"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/34",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HBase",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 34,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/35",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HDFS",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 35,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/36",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check YARN",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 36,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/37",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check KAFKA",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 37,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/38",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check MapReduce2",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 38,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/39",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check FALCON",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 39,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/40",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HIVE",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 40,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/41",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check ZooKeeper",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 41,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/42",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check STORM",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 42,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/43",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check OOZIE",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 43,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/44",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check KNOX",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 44,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/45",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check FLUME",
>             "group_id" : 6,
>             "request_id" : 53,
>             "stage_id" : 45,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7",
>       "UpgradeGroup" : {
>         "group_id" : 7,
>         "request_id" : 53,
>         "title" : "Hive"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/46",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Preparing Hive Metastore on c6402.ambari.apache.org",
>             "group_id" : 7,
>             "request_id" : 53,
>             "stage_id" : 46,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/47",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Hive Metastore on c6402.ambari.apache.org",
>             "group_id" : 7,
>             "request_id" : 53,
>             "stage_id" : 47,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/48",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "HiveServer Port Availability",
>             "group_id" : 7,
>             "request_id" : 53,
>             "stage_id" : 48,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/49",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Updating Config hive-site",
>             "group_id" : 7,
>             "request_id" : 53,
>             "stage_id" : 49,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/50",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HiveServer2 on c6402.ambari.apache.org",
>             "group_id" : 7,
>             "request_id" : 53,
>             "stage_id" : 50,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/51",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting WebHCat Server on c6402.ambari.apache.org",
>             "group_id" : 7,
>             "request_id" : 53,
>             "stage_id" : 51,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/52",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Hive",
>             "group_id" : 7,
>             "request_id" : 53,
>             "stage_id" : 52,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8",
>       "UpgradeGroup" : {
>         "group_id" : 8,
>         "request_id" : 53,
>         "title" : "Oozie"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/53",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Oozie Server on c6402.ambari.apache.org",
>             "group_id" : 8,
>             "request_id" : 53,
>             "stage_id" : 53,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/54",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Oozie Client on c6403.ambari.apache.org",
>             "group_id" : 8,
>             "request_id" : 53,
>             "stage_id" : 54,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/55",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Oozie Client on c6401.ambari.apache.org",
>             "group_id" : 8,
>             "request_id" : 53,
>             "stage_id" : 55,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/56",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Oozie Client on c6402.ambari.apache.org",
>             "group_id" : 8,
>             "request_id" : 53,
>             "stage_id" : 56,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/57",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Oozie",
>             "group_id" : 8,
>             "request_id" : 53,
>             "stage_id" : 57,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9",
>       "UpgradeGroup" : {
>         "group_id" : 9,
>         "request_id" : 53,
>         "title" : "Falcon"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9/upgrade_items/58",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Falcon Server on c6402.ambari.apache.org",
>             "group_id" : 9,
>             "request_id" : 53,
>             "stage_id" : 58,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9/upgrade_items/59",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Falcon Client on c6403.ambari.apache.org",
>             "group_id" : 9,
>             "request_id" : 53,
>             "stage_id" : 59,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9/upgrade_items/60",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Falcon",
>             "group_id" : 9,
>             "request_id" : 53,
>             "stage_id" : 60,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10",
>       "UpgradeGroup" : {
>         "group_id" : 10,
>         "request_id" : 53,
>         "title" : "Client Components"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/61",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting ZooKeeper Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 61,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/62",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting ZooKeeper Client on c6401.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 62,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/63",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting ZooKeeper Client on c6402.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 63,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/64",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HDFS Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 64,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/65",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HDFS Client on c6401.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 65,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/66",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HDFS Client on c6402.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 66,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/67",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting YARN Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 67,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/68",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting YARN Client on c6401.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 68,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/69",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting YARN Client on c6402.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 69,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/70",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting MapReduce2 Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 70,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/71",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting MapReduce2 Client on c6401.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 71,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/72",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting MapReduce2 Client on c6402.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 72,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/73",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Tez Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 73,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/74",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Tez Client on c6401.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 74,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/75",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Tez Client on c6402.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 75,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/76",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HBase Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 76,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/77",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Pig on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 77,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/78",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Pig on c6402.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 78,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/79",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Sqoop on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 79,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/80",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Hive Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 80,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/81",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Hive Client on c6401.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 81,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/82",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HCat Client on c6403.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 82,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/83",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting HCat Client on c6401.ambari.apache.org",
>             "group_id" : 10,
>             "request_id" : 53,
>             "stage_id" : 83,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11",
>       "UpgradeGroup" : {
>         "group_id" : 11,
>         "request_id" : 53,
>         "title" : "All Service Checks"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/84",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HBase",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 84,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/85",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check HDFS",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 85,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/86",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check YARN",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 86,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/87",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check KAFKA",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 87,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/88",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check MapReduce2",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 88,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/89",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Falcon",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 89,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/90",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Hive",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 90,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/91",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check ZooKeeper",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 91,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/92",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check STORM",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 92,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/93",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Oozie",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 93,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/94",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check KNOX",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 94,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/95",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check FLUME",
>             "group_id" : 11,
>             "request_id" : 53,
>             "stage_id" : 95,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/12",
>       "UpgradeGroup" : {
>         "group_id" : 12,
>         "request_id" : 53,
>         "title" : "Kafka"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/12/upgrade_items/96",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Kafka Broker on c6401.ambari.apache.org",
>             "group_id" : 12,
>             "request_id" : 53,
>             "stage_id" : 96,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/12/upgrade_items/97",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Kafka",
>             "group_id" : 12,
>             "request_id" : 53,
>             "stage_id" : 97,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/13",
>       "UpgradeGroup" : {
>         "group_id" : 13,
>         "request_id" : 53,
>         "title" : "Knox"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/13/upgrade_items/98",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Knox Gateway on c6401.ambari.apache.org",
>             "group_id" : 13,
>             "request_id" : 53,
>             "stage_id" : 98,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/13/upgrade_items/99",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Knox",
>             "group_id" : 13,
>             "request_id" : 53,
>             "stage_id" : 99,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14",
>       "UpgradeGroup" : {
>         "group_id" : 14,
>         "request_id" : 53,
>         "title" : "Storm"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/100",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Preparing Nimbus on c6401.ambari.apache.org",
>             "group_id" : 14,
>             "request_id" : 53,
>             "stage_id" : 100,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/101",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Nimbus on c6401.ambari.apache.org",
>             "group_id" : 14,
>             "request_id" : 53,
>             "stage_id" : 101,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/102",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Supervisor on c6401.ambari.apache.org",
>             "group_id" : 14,
>             "request_id" : 53,
>             "stage_id" : 102,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/103",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Storm UI Server on c6401.ambari.apache.org",
>             "group_id" : 14,
>             "request_id" : 53,
>             "stage_id" : 103,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/104",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting DRPC Server on c6401.ambari.apache.org",
>             "group_id" : 14,
>             "request_id" : 53,
>             "stage_id" : 104,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/105",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Completing DRPC Server on c6401.ambari.apache.org",
>             "group_id" : 14,
>             "request_id" : 53,
>             "stage_id" : 105,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/106",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Storm",
>             "group_id" : 14,
>             "request_id" : 53,
>             "stage_id" : 106,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/15",
>       "UpgradeGroup" : {
>         "group_id" : 15,
>         "request_id" : 53,
>         "title" : "Slider"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/15/upgrade_items/107",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Slider on c6403.ambari.apache.org",
>             "group_id" : 15,
>             "request_id" : 53,
>             "stage_id" : 107,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/16",
>       "UpgradeGroup" : {
>         "group_id" : 16,
>         "request_id" : 53,
>         "title" : "Flume"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/16/upgrade_items/108",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Restarting Flume on c6403.ambari.apache.org",
>             "group_id" : 16,
>             "request_id" : 53,
>             "stage_id" : 108,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/16/upgrade_items/109",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Service Check Flume",
>             "group_id" : 16,
>             "request_id" : 53,
>             "stage_id" : 109,
>             "status" : "COMPLETED"
>           }
>         }
>       ]
>     },
>     {
>       "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17",
>       "UpgradeGroup" : {
>         "group_id" : 17,
>         "request_id" : 53,
>         "title" : "Finalize Upgrade"
>       },
>       "upgrade_items" : [
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/110",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Confirm Finalize",
>             "group_id" : 17,
>             "request_id" : 53,
>             "stage_id" : 110,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/111",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Execute HDFS Finalize",
>             "group_id" : 17,
>             "request_id" : 53,
>             "stage_id" : 111,
>             "status" : "COMPLETED"
>           }
>         },
>         {
>           "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/112",
>           "UpgradeItem" : {
>             "cluster_name" : "c1",
>             "context" : "Save Cluster State",
>             "group_id" : 17,
>             "request_id" : 53,
>             "stage_id" : 112,
>             "status" : "IN_PROGRESS"
>           }
>         }
>       ]
>     }
>   ]
> }
> {noformat}
> {noformat:title=Finalize Task is Queued, but not being retried!}
> {
>   "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/112/tasks/813?fields=*",
>   "Tasks" : {
>     "attempt_cnt" : 2,
>     "cluster_name" : "c1",
>     "command" : "EXECUTE",
>     "command_detail" : "Save Cluster State",
>     "custom_command_name" : "org.apache.ambari.server.serveraction.upgrades.FinalizeUpgradeAction",
>     "end_time" : -1,
>     "error_log" : "/var/lib/ambari-agent/data/errors-813.txt",
>     "exit_code" : -1,
>     "host_name" : "c6403.ambari.apache.org",
>     "id" : 813,
>     "output_log" : "/var/lib/ambari-agent/data/output-813.txt",
>     "request_id" : 53,
>     "role" : "AMBARI_SERVER_ACTION",
>     "stage_id" : 112,
>     "start_time" : 1423774208969,
>     "status" : "QUEUED",
>     "stderr" : "The following 3 host(s) have not been upgraded to version 2.2.1.0-2214. Please install and upgrade the Stack Version on those hosts and try again.\nHosts: c6403.ambari.apache.org, c6401.ambari.apache.org, c6402.ambari.apache.org\n",
>     "stdout" : "Begin finalizing the upgrade of cluster c1 to version 2.2.1.0-2214\nThe following 3 host(s) have not been upgraded to version 2.2.1.0-2214. Please install and upgrade the Stack Version on those hosts and try again.\nHosts: c6403.ambari.apache.org, c6401.ambari.apache.org, c6402.ambari.apache.org\n",
>     "structured_out" : { }
>   }
> }
> {noformat}
> {noformat}
> "DRPC_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "GANGLIA_MONITOR";"UNKNOWN";"STARTED";"NONE";"c6401.ambari.apache.org"
> "GANGLIA_SERVER";"UNKNOWN";"STARTED";"NONE";"c6401.ambari.apache.org"
> "HBASE_MASTER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "HBASE_REGIONSERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "HCAT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "HDFS_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "HIVE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "JOURNALNODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "KAFKA_BROKER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "KNOX_GATEWAY";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "MAPREDUCE2_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "NAMENODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "NIMBUS";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "OOZIE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "STORM_UI_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "SUPERVISOR";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "TEZ_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "YARN_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "ZKFC";"UNKNOWN";"STARTED";"NONE";"c6401.ambari.apache.org"
> "ZOOKEEPER_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
> "ZOOKEEPER_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
> "APP_TIMELINE_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "FALCON_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "GANGLIA_MONITOR";"UNKNOWN";"STARTED";"NONE";"c6402.ambari.apache.org"
> "HDFS_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
> "HISTORYSERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "HIVE_METASTORE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "HIVE_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "JOURNALNODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "MAPREDUCE2_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
> "MYSQL_SERVER";"UNKNOWN";"STARTED";"NONE";"c6402.ambari.apache.org"
> "NAMENODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "OOZIE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
> "OOZIE_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "PIG";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
> "RESOURCEMANAGER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "TEZ_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
> "WEBHCAT_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "YARN_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
> "ZKFC";"UNKNOWN";"STARTED";"NONE";"c6402.ambari.apache.org"
> "ZOOKEEPER_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
> "ZOOKEEPER_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
> "DATANODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
> "FALCON_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "FLUME_HANDLER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
> "GANGLIA_MONITOR";"UNKNOWN";"STARTED";"NONE";"c6403.ambari.apache.org"
> "HBASE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "HCAT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "HDFS_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "HIVE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "JOURNALNODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
> "MAPREDUCE2_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "NODEMANAGER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
> "OOZIE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "PIG";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "SLIDER";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "SQOOP";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "TEZ_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "YARN_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "ZOOKEEPER_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
> "ZOOKEEPER_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
> {noformat}
> {noformat}
> "c6401.ambari.apache.org";"CURRENT";"2.2.0.0-2041"
> "c6402.ambari.apache.org";"CURRENT";"2.2.0.0-2041"
> "c6403.ambari.apache.org";"CURRENT";"2.2.0.0-2041"
> "c6401.ambari.apache.org";"UPGRADING";"2.2.1.0-2214"
> "c6402.ambari.apache.org";"UPGRADING";"2.2.1.0-2214"
> "c6403.ambari.apache.org";"UPGRADING";"2.2.1.0-2214"
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)