You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Alejandro Fernandez (JIRA)" <ji...@apache.org> on 2015/02/13 00:30:12 UTC

[jira] [Created] (AMBARI-9611) RU - Finalize Fails When Ganglia Is Installed, change versionAdvertised to default to false

Alejandro Fernandez created AMBARI-9611:
-------------------------------------------

             Summary: RU - Finalize Fails When Ganglia Is Installed, change versionAdvertised to default to false
                 Key: AMBARI-9611
                 URL: https://issues.apache.org/jira/browse/AMBARI-9611
             Project: Ambari
          Issue Type: Bug
          Components: ambari-server
    Affects Versions: 2.0.0
            Reporter: Alejandro Fernandez
            Assignee: Alejandro Fernandez
             Fix For: 2.0.0


Install the following services in a new cluster: HDFS, YARN, MapR, Tez, Hive, HBase, Pig, Scoop, Oozie, ZK, Falcon, Storm, Flume, Knox, Slider, Kafka, Ganglia.

Notice that Ganglia is installed instead of AMS. This simulates an upgrade environment from Ambari 1.7.0 to 2.0.0 where Ganglia was kept (which is a valid use case).

Perform an upgrade - it gets to Finalize but then fails. The suspect here was Ganglia. I then removed Ganglia via the API and retried Finalize, but the Finalize task was frozen. No output in the logs.

{noformat:title=Upgrade Tasks After Finalize Retry (last is stuck)}
{
  "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/?fields=upgrade_groups/upgrade_items/UpgradeItem/status,upgrade_groups/upgrade_items/UpgradeItem/context,upgrade_groups/UpgradeGroup/title",
  "Upgrade" : {
    "cluster_name" : "c1",
    "request_id" : 53
  },
  "upgrade_groups" : [
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1",
      "UpgradeGroup" : {
        "group_id" : 1,
        "request_id" : 53,
        "title" : "Prepare Backups"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/1",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Pre Upgrade HDFS",
            "group_id" : 1,
            "request_id" : 53,
            "stage_id" : 1,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/2",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Pre Upgrade HBASE",
            "group_id" : 1,
            "request_id" : 53,
            "stage_id" : 2,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/3",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Pre Upgrade HIVE",
            "group_id" : 1,
            "request_id" : 53,
            "stage_id" : 3,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/1/upgrade_items/4",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Pre Upgrade OOZIE",
            "group_id" : 1,
            "request_id" : 53,
            "stage_id" : 4,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2",
      "UpgradeGroup" : {
        "group_id" : 2,
        "request_id" : 53,
        "title" : "ZooKeeper"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/5",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting ZooKeeper Server on c6403.ambari.apache.org",
            "group_id" : 2,
            "request_id" : 53,
            "stage_id" : 5,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/6",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting ZooKeeper Server on c6401.ambari.apache.org",
            "group_id" : 2,
            "request_id" : 53,
            "stage_id" : 6,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/7",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting ZooKeeper Server on c6402.ambari.apache.org",
            "group_id" : 2,
            "request_id" : 53,
            "stage_id" : 7,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/2/upgrade_items/8",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check ZooKeeper",
            "group_id" : 2,
            "request_id" : 53,
            "stage_id" : 8,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3",
      "UpgradeGroup" : {
        "group_id" : 3,
        "request_id" : 53,
        "title" : "Core Masters"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/9",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting JournalNode on c6403.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 9,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/10",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting JournalNode on c6401.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 10,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/11",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting JournalNode on c6402.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 11,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/12",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting NameNode on c6401.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 12,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/13",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting NameNode on c6402.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 13,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/14",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting History Server on c6402.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 14,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/15",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting App Timeline Server on c6402.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 15,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/16",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting ResourceManager on c6402.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 16,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/3/upgrade_items/17",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HBase Master on c6401.ambari.apache.org",
            "group_id" : 3,
            "request_id" : 53,
            "stage_id" : 17,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4",
      "UpgradeGroup" : {
        "group_id" : 4,
        "request_id" : 53,
        "title" : "All Service Checks"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/18",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HBase",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 18,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/19",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check MapReduce2",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 19,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/20",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HDFS",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 20,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/21",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check YARN",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 21,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/22",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check KAFKA",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 22,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/23",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check FALCON",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 23,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/24",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HIVE",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 24,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/25",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check ZooKeeper",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 25,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/26",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check STORM",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 26,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/27",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check OOZIE",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 27,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/28",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check KNOX",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 28,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/4/upgrade_items/29",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check FLUME",
            "group_id" : 4,
            "request_id" : 53,
            "stage_id" : 29,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5",
      "UpgradeGroup" : {
        "group_id" : 5,
        "request_id" : 53,
        "title" : "Core Slaves"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/30",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting DataNode on c6403.ambari.apache.org",
            "group_id" : 5,
            "request_id" : 53,
            "stage_id" : 30,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/31",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting NodeManager on c6403.ambari.apache.org",
            "group_id" : 5,
            "request_id" : 53,
            "stage_id" : 31,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/32",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting RegionServer on c6401.ambari.apache.org",
            "group_id" : 5,
            "request_id" : 53,
            "stage_id" : 32,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/5/upgrade_items/33",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Verification Required",
            "group_id" : 5,
            "request_id" : 53,
            "stage_id" : 33,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6",
      "UpgradeGroup" : {
        "group_id" : 6,
        "request_id" : 53,
        "title" : "All Service Checks"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/34",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HBase",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 34,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/35",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HDFS",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 35,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/36",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check YARN",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 36,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/37",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check KAFKA",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 37,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/38",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check MapReduce2",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 38,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/39",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check FALCON",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 39,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/40",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HIVE",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 40,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/41",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check ZooKeeper",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 41,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/42",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check STORM",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 42,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/43",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check OOZIE",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 43,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/44",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check KNOX",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 44,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/6/upgrade_items/45",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check FLUME",
            "group_id" : 6,
            "request_id" : 53,
            "stage_id" : 45,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7",
      "UpgradeGroup" : {
        "group_id" : 7,
        "request_id" : 53,
        "title" : "Hive"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/46",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Preparing Hive Metastore on c6402.ambari.apache.org",
            "group_id" : 7,
            "request_id" : 53,
            "stage_id" : 46,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/47",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Hive Metastore on c6402.ambari.apache.org",
            "group_id" : 7,
            "request_id" : 53,
            "stage_id" : 47,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/48",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "HiveServer Port Availability",
            "group_id" : 7,
            "request_id" : 53,
            "stage_id" : 48,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/49",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Updating Config hive-site",
            "group_id" : 7,
            "request_id" : 53,
            "stage_id" : 49,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/50",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HiveServer2 on c6402.ambari.apache.org",
            "group_id" : 7,
            "request_id" : 53,
            "stage_id" : 50,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/51",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting WebHCat Server on c6402.ambari.apache.org",
            "group_id" : 7,
            "request_id" : 53,
            "stage_id" : 51,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/7/upgrade_items/52",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Hive",
            "group_id" : 7,
            "request_id" : 53,
            "stage_id" : 52,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8",
      "UpgradeGroup" : {
        "group_id" : 8,
        "request_id" : 53,
        "title" : "Oozie"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/53",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Oozie Server on c6402.ambari.apache.org",
            "group_id" : 8,
            "request_id" : 53,
            "stage_id" : 53,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/54",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Oozie Client on c6403.ambari.apache.org",
            "group_id" : 8,
            "request_id" : 53,
            "stage_id" : 54,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/55",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Oozie Client on c6401.ambari.apache.org",
            "group_id" : 8,
            "request_id" : 53,
            "stage_id" : 55,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/56",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Oozie Client on c6402.ambari.apache.org",
            "group_id" : 8,
            "request_id" : 53,
            "stage_id" : 56,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/8/upgrade_items/57",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Oozie",
            "group_id" : 8,
            "request_id" : 53,
            "stage_id" : 57,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9",
      "UpgradeGroup" : {
        "group_id" : 9,
        "request_id" : 53,
        "title" : "Falcon"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9/upgrade_items/58",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Falcon Server on c6402.ambari.apache.org",
            "group_id" : 9,
            "request_id" : 53,
            "stage_id" : 58,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9/upgrade_items/59",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Falcon Client on c6403.ambari.apache.org",
            "group_id" : 9,
            "request_id" : 53,
            "stage_id" : 59,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/9/upgrade_items/60",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Falcon",
            "group_id" : 9,
            "request_id" : 53,
            "stage_id" : 60,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10",
      "UpgradeGroup" : {
        "group_id" : 10,
        "request_id" : 53,
        "title" : "Client Components"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/61",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting ZooKeeper Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 61,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/62",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting ZooKeeper Client on c6401.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 62,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/63",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting ZooKeeper Client on c6402.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 63,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/64",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HDFS Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 64,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/65",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HDFS Client on c6401.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 65,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/66",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HDFS Client on c6402.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 66,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/67",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting YARN Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 67,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/68",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting YARN Client on c6401.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 68,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/69",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting YARN Client on c6402.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 69,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/70",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting MapReduce2 Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 70,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/71",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting MapReduce2 Client on c6401.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 71,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/72",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting MapReduce2 Client on c6402.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 72,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/73",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Tez Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 73,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/74",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Tez Client on c6401.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 74,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/75",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Tez Client on c6402.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 75,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/76",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HBase Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 76,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/77",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Pig on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 77,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/78",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Pig on c6402.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 78,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/79",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Sqoop on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 79,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/80",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Hive Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 80,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/81",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Hive Client on c6401.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 81,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/82",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HCat Client on c6403.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 82,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/10/upgrade_items/83",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting HCat Client on c6401.ambari.apache.org",
            "group_id" : 10,
            "request_id" : 53,
            "stage_id" : 83,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11",
      "UpgradeGroup" : {
        "group_id" : 11,
        "request_id" : 53,
        "title" : "All Service Checks"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/84",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HBase",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 84,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/85",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check HDFS",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 85,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/86",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check YARN",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 86,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/87",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check KAFKA",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 87,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/88",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check MapReduce2",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 88,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/89",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Falcon",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 89,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/90",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Hive",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 90,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/91",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check ZooKeeper",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 91,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/92",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check STORM",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 92,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/93",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Oozie",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 93,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/94",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check KNOX",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 94,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/11/upgrade_items/95",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check FLUME",
            "group_id" : 11,
            "request_id" : 53,
            "stage_id" : 95,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/12",
      "UpgradeGroup" : {
        "group_id" : 12,
        "request_id" : 53,
        "title" : "Kafka"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/12/upgrade_items/96",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Kafka Broker on c6401.ambari.apache.org",
            "group_id" : 12,
            "request_id" : 53,
            "stage_id" : 96,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/12/upgrade_items/97",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Kafka",
            "group_id" : 12,
            "request_id" : 53,
            "stage_id" : 97,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/13",
      "UpgradeGroup" : {
        "group_id" : 13,
        "request_id" : 53,
        "title" : "Knox"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/13/upgrade_items/98",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Knox Gateway on c6401.ambari.apache.org",
            "group_id" : 13,
            "request_id" : 53,
            "stage_id" : 98,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/13/upgrade_items/99",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Knox",
            "group_id" : 13,
            "request_id" : 53,
            "stage_id" : 99,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14",
      "UpgradeGroup" : {
        "group_id" : 14,
        "request_id" : 53,
        "title" : "Storm"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/100",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Preparing Nimbus on c6401.ambari.apache.org",
            "group_id" : 14,
            "request_id" : 53,
            "stage_id" : 100,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/101",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Nimbus on c6401.ambari.apache.org",
            "group_id" : 14,
            "request_id" : 53,
            "stage_id" : 101,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/102",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Supervisor on c6401.ambari.apache.org",
            "group_id" : 14,
            "request_id" : 53,
            "stage_id" : 102,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/103",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Storm UI Server on c6401.ambari.apache.org",
            "group_id" : 14,
            "request_id" : 53,
            "stage_id" : 103,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/104",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting DRPC Server on c6401.ambari.apache.org",
            "group_id" : 14,
            "request_id" : 53,
            "stage_id" : 104,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/105",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Completing DRPC Server on c6401.ambari.apache.org",
            "group_id" : 14,
            "request_id" : 53,
            "stage_id" : 105,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/14/upgrade_items/106",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Storm",
            "group_id" : 14,
            "request_id" : 53,
            "stage_id" : 106,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/15",
      "UpgradeGroup" : {
        "group_id" : 15,
        "request_id" : 53,
        "title" : "Slider"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/15/upgrade_items/107",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Slider on c6403.ambari.apache.org",
            "group_id" : 15,
            "request_id" : 53,
            "stage_id" : 107,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/16",
      "UpgradeGroup" : {
        "group_id" : 16,
        "request_id" : 53,
        "title" : "Flume"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/16/upgrade_items/108",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Restarting Flume on c6403.ambari.apache.org",
            "group_id" : 16,
            "request_id" : 53,
            "stage_id" : 108,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/16/upgrade_items/109",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Service Check Flume",
            "group_id" : 16,
            "request_id" : 53,
            "stage_id" : 109,
            "status" : "COMPLETED"
          }
        }
      ]
    },
    {
      "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17",
      "UpgradeGroup" : {
        "group_id" : 17,
        "request_id" : 53,
        "title" : "Finalize Upgrade"
      },
      "upgrade_items" : [
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/110",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Confirm Finalize",
            "group_id" : 17,
            "request_id" : 53,
            "stage_id" : 110,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/111",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Execute HDFS Finalize",
            "group_id" : 17,
            "request_id" : 53,
            "stage_id" : 111,
            "status" : "COMPLETED"
          }
        },
        {
          "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/112",
          "UpgradeItem" : {
            "cluster_name" : "c1",
            "context" : "Save Cluster State",
            "group_id" : 17,
            "request_id" : 53,
            "stage_id" : 112,
            "status" : "IN_PROGRESS"
          }
        }
      ]
    }
  ]
}
{noformat}

{noformat:title=Finalize Task is Queued, but not being retried!}
{
  "href" : "http://localhost:8080/api/v1/clusters/c1/upgrades/53/upgrade_groups/17/upgrade_items/112/tasks/813?fields=*",
  "Tasks" : {
    "attempt_cnt" : 2,
    "cluster_name" : "c1",
    "command" : "EXECUTE",
    "command_detail" : "Save Cluster State",
    "custom_command_name" : "org.apache.ambari.server.serveraction.upgrades.FinalizeUpgradeAction",
    "end_time" : -1,
    "error_log" : "/var/lib/ambari-agent/data/errors-813.txt",
    "exit_code" : -1,
    "host_name" : "c6403.ambari.apache.org",
    "id" : 813,
    "output_log" : "/var/lib/ambari-agent/data/output-813.txt",
    "request_id" : 53,
    "role" : "AMBARI_SERVER_ACTION",
    "stage_id" : 112,
    "start_time" : 1423774208969,
    "status" : "QUEUED",
    "stderr" : "The following 3 host(s) have not been upgraded to version 2.2.1.0-2214. Please install and upgrade the Stack Version on those hosts and try again.\nHosts: c6403.ambari.apache.org, c6401.ambari.apache.org, c6402.ambari.apache.org\n",
    "stdout" : "Begin finalizing the upgrade of cluster c1 to version 2.2.1.0-2214\nThe following 3 host(s) have not been upgraded to version 2.2.1.0-2214. Please install and upgrade the Stack Version on those hosts and try again.\nHosts: c6403.ambari.apache.org, c6401.ambari.apache.org, c6402.ambari.apache.org\n",
    "structured_out" : { }
  }
}
{noformat}

{noformat}
"DRPC_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"GANGLIA_MONITOR";"UNKNOWN";"STARTED";"NONE";"c6401.ambari.apache.org"
"GANGLIA_SERVER";"UNKNOWN";"STARTED";"NONE";"c6401.ambari.apache.org"
"HBASE_MASTER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"HBASE_REGIONSERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"HCAT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"HDFS_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"HIVE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"JOURNALNODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"KAFKA_BROKER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"KNOX_GATEWAY";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"MAPREDUCE2_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"NAMENODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"NIMBUS";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"OOZIE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"STORM_UI_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"SUPERVISOR";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"TEZ_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"YARN_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"ZKFC";"UNKNOWN";"STARTED";"NONE";"c6401.ambari.apache.org"
"ZOOKEEPER_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6401.ambari.apache.org"
"ZOOKEEPER_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6401.ambari.apache.org"
"APP_TIMELINE_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"FALCON_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"GANGLIA_MONITOR";"UNKNOWN";"STARTED";"NONE";"c6402.ambari.apache.org"
"HDFS_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
"HISTORYSERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"HIVE_METASTORE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"HIVE_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"JOURNALNODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"MAPREDUCE2_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
"MYSQL_SERVER";"UNKNOWN";"STARTED";"NONE";"c6402.ambari.apache.org"
"NAMENODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"OOZIE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
"OOZIE_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"PIG";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
"RESOURCEMANAGER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"TEZ_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
"WEBHCAT_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"YARN_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
"ZKFC";"UNKNOWN";"STARTED";"NONE";"c6402.ambari.apache.org"
"ZOOKEEPER_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6402.ambari.apache.org"
"ZOOKEEPER_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6402.ambari.apache.org"
"DATANODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
"FALCON_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"FLUME_HANDLER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
"GANGLIA_MONITOR";"UNKNOWN";"STARTED";"NONE";"c6403.ambari.apache.org"
"HBASE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"HCAT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"HDFS_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"HIVE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"JOURNALNODE";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
"MAPREDUCE2_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"NODEMANAGER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
"OOZIE_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"PIG";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"SLIDER";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"SQOOP";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"TEZ_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"YARN_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"ZOOKEEPER_CLIENT";"2.2.1.0-2214";"INSTALLED";"COMPLETE";"c6403.ambari.apache.org"
"ZOOKEEPER_SERVER";"2.2.1.0-2214";"STARTED";"COMPLETE";"c6403.ambari.apache.org"
{noformat}

{noformat}
"c6401.ambari.apache.org";"CURRENT";"2.2.0.0-2041"
"c6402.ambari.apache.org";"CURRENT";"2.2.0.0-2041"
"c6403.ambari.apache.org";"CURRENT";"2.2.0.0-2041"
"c6401.ambari.apache.org";"UPGRADING";"2.2.1.0-2214"
"c6402.ambari.apache.org";"UPGRADING";"2.2.1.0-2214"
"c6403.ambari.apache.org";"UPGRADING";"2.2.1.0-2214"
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)