install KAFKA using blueprint

[Lian Jiang <ji...@gmail.com>]

Hi,

I try to install KAFKA on my hadoop cluster using below blueprint.

{
      "name" : "master_host_group",
      "components" : [
        {
          "name" : "NAMENODE"
        },
        {
          "name" : "SECONDARY_NAMENODE"
        },
        {
          "name" : "APP_TIMELINE_SERVER"
        },
        {
          "name" : "RESOURCEMANAGER"
        },
        {
          "name" : "HISTORYSERVER"
        },
        {
          "name" : "KAFKA"
        },
        {
          "name" : "STORM"
        },
        {
          "name" : "HBASE_MASTER"
        },
        {
          "name" : "HIVE_SERVER"
        },
        {
          "name" : "YARN_CLIENT"
        },
        {
          "name" : "MAPREDUCE2_CLIENT"
        },
        {
          "name" : "WEBHCAT_SERVER"
        },
        {
          "name" : "HDFS_CLIENT"
        },
        {
          "name" : "HIVE_CLIENT"
        },
        {
          "name" : "MAPREDUCE2_CLIENT"
        },
        {
          "name" : "MYSQL_SERVER"
        },
        {
          "name" : "ZOOKEEPER_SERVER"
        },
        {
          "name" : "SPARK2_JOBHISTORYSERVER"
        },
        {
          "name" : "PIG"
        },
        {
          "name" : "OOZIE_SERVER"
        },
        {
          "name" : "OOZIE_CLIENT"
        },
        {
          "name" : "ZEPPELIN_MASTER"
        },
        {
          "name" : "METRICS_COLLECTOR"
        },
        {
          "name" : "METRICS_MONITOR"
        },
        {
          "name" : "METRICS_GRAFANA"
        },
        {
          "name" : "INFRA_SOLR"
        },
        {
          "name" : "INFRA_SOLR_CLIENT"
        },
        {
          "name" : "LOGSEARCH_SERVER"
        },
        {
          "name" : "LOGSEARCH_LOGFEEDER"
        }
      ],
      "cardinality" : "1"
    }

The error I got is:

[opc@test-edgenode ~]$ curl -H "X-Requested-By: ambari" -X POST -d
@/home/opcbootstrap/spark_blueprint.json -u admin:admin
http://177.30.31.103:8080/api/v1/blueprints/:spark_blueprint
{
  "status" : 400,
  "message" : "The component 'KAFKA' in host group 'master_host_group' is
not valid for the specified stack"
}

I got the KAFKA component name from
https://github.com/apache/ambari/blob/branch-2.6/ambari-server/src/main/resources/common-services/KAFKA/0.10.0/metainfo.xml
.

What I did wrong in the blueprint? Thanks a lot.

Re: install KAFKA using blueprint

[Lian Jiang <ji...@gmail.com>]

Thanks!

On Mon, Mar 26, 2018 at 10:32 AM, Doroszlai, Attila <ad...@apache.org>
wrote:

> Hi,
>
> >   "message" : "The component 'KAFKA' in host group 'master_host_group'
> is not valid for the specified stack"
> >
> > I got the KAFKA component name from
> > https://github.com/apache/ambari/blob/branch-2.6/ambari-
> server/src/main/resources/common-services/KAFKA/0.10.0/metainfo.xml.
>
> The component name is KAFKA_BROKER.
> KAFKA is the service name.
>
> https://github.com/apache/ambari/blob/c0fcea8925a35be406c37a388b781d
> edf92996c5/ambari-server/src/main/resources/common-
> services/KAFKA/0.8.1/metainfo.xml#L27-L28
>
> -Attila
>

Re: install KAFKA using blueprint

["Doroszlai, Attila" <ad...@apache.org>]

Hi,

>   "message" : "The component 'KAFKA' in host group 'master_host_group' is not valid for the specified stack"
>
> I got the KAFKA component name from
> https://github.com/apache/ambari/blob/branch-2.6/ambari-server/src/main/resources/common-services/KAFKA/0.10.0/metainfo.xml.

The component name is KAFKA_BROKER.
KAFKA is the service name.

https://github.com/apache/ambari/blob/c0fcea8925a35be406c37a388b781dedf92996c5/ambari-server/src/main/resources/common-services/KAFKA/0.8.1/metainfo.xml#L27-L28

-Attila