You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Devendar Rao <de...@gmail.com> on 2018/01/12 20:55:23 UTC

Kafka on kubernetes

Hi,

Any one has done work on kafka on kubernetes? Could you share the
references/links if you have any?

Thanks,
Devendar

Re: Kafka on kubernetes

Posted by Devendar Rao <de...@gmail.com>.

Thanks Paolo for the info.

On Fri, Jan 12, 2018 at 1:30 PM, Paolo Patierno <pp...@live.com> wrote:

> Hi Devendar,
>
> there is the Strimzi project (http://strimzi.io) which is focused on
> providing a full solution for running Apache Kafka both on Kubernetes and
> OpenShift. The current first release (0.1.0) provides the Docker images and
> YAML files (with "templates" for OpenShift as well) for deploying a Kafka
> cluster (broker and Zookeeper nodes); It also provide Kafka Connect
> deployment as well. Finally, the metrics cluster are available through JMX
> endpoints in order to use a Prometheus server for getting them (for example
> using Grafana to show their values).
>
> We are working to add more advanced features using the "operator" pattern.
> The cluster deployment will be possible using a so called
> cluster-controller starting from a configmap which contains the cluster
> configuration. In the same way a topic-controller will be in charge for
> creating topics from configmaps.
>
> Cluster balancing with partition reassignment based on detected specific
> metrics values is on the roadmap as well.
>
> On the official web site you can find the link to the GitHub repo and the
> way for getting in touch with the contributors through an IRC channel,
> mailing list and the Twitter account as well.
>
> Thanks
> Paolo
>
> From: Devendar Rao
> Sent: Friday, 12 January, 21:55
> Subject: Kafka on kubernetes
> To: users@kafka.apache.org
>
>
> Hi, Any one has done work on kafka on kubernetes? Could you share the
> references/links if you have any? Thanks, Devendar
>
>

Re: Kafka on kubernetes

Posted by Paolo Patierno <pp...@live.com>.

Hi Devendar,

there is the Strimzi project (http://strimzi.io) which is focused on providing a full solution for running Apache Kafka both on Kubernetes and OpenShift. The current first release (0.1.0) provides the Docker images and YAML files (with "templates" for OpenShift as well) for deploying a Kafka cluster (broker and Zookeeper nodes); It also provide Kafka Connect deployment as well. Finally, the metrics cluster are available through JMX endpoints in order to use a Prometheus server for getting them (for example using Grafana to show their values).

We are working to add more advanced features using the "operator" pattern. The cluster deployment will be possible using a so called cluster-controller starting from a configmap which contains the cluster configuration. In the same way a topic-controller will be in charge for creating topics from configmaps.

Cluster balancing with partition reassignment based on detected specific metrics values is on the roadmap as well.

On the official web site you can find the link to the GitHub repo and the way for getting in touch with the contributors through an IRC channel, mailing list and the Twitter account as well.

Thanks
Paolo

From: Devendar Rao
Sent: Friday, 12 January, 21:55
Subject: Kafka on kubernetes
To: users@kafka.apache.org


Hi, Any one has done work on kafka on kubernetes? Could you share the references/links if you have any? Thanks, Devendar