Kafka as A Metrics Collector

[Furkan KAMACI <fu...@gmail.com>]

Hi,

I am so new to Kafka and really liked it further to its name.

I have a distributed search application. Search requests come to one of my
search service (each of them is a Spring Boot application). I want to
report query per second and document per second rates.

So, I think that Kafka can be a good fit for it. I want to publish metrics
like that and aggregate that metrics and also publish it to other services
as like a system monitoring tool.

My question is: Is Kafka a right choice for my approach and how can I
implement it (should I use Kafka Streams too for my target).

Kind Regards,
Furkan KAMACI

RE: Kafka as A Metrics Collector

["Tauzell, Dave" <Da...@surescripts.com>]

I don't see why you couldn't.  InfluxDB's Telegraph (https://docs.influxdata.com/telegraf/v1.0/) has  plugin to read from Kafka.  You could use Spark or Kafka streams to do custom aggregation.

-Dave

-----Original Message-----
From: Furkan KAMACI [mailto:furkankamaci@gmail.com]
Sent: Sunday, October 16, 2016 2:50 PM
To: users@kafka.apache.org
Subject: Kafka as A Metrics Collector

Hi,

I am so new to Kafka and really liked it further to its name.

I have a distributed search application. Search requests come to one of my search service (each of them is a Spring Boot application). I want to report query per second and document per second rates.

So, I think that Kafka can be a good fit for it. I want to publish metrics like that and aggregate that metrics and also publish it to other services as like a system monitoring tool.

My question is: Is Kafka a right choice for my approach and how can I implement it (should I use Kafka Streams too for my target).

Kind Regards,
Furkan KAMACI
This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.