You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by a s <al...@gmail.com> on 2020/06/09 20:40:39 UTC

how can i write spark addListener metric to kafka

hi Guys,

I am building a structured streaming  app for google analytics data

i want to capture the number of rows read and processed

i am able to see it in log how can i send it to kafka


Thanks
Alis

Re: how can i write spark addListener metric to kafka

Posted by Tathagata Das <ta...@gmail.com>.

https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#reporting-metrics-programmatically-using-asynchronous-apis

On Tue, Jun 9, 2020 at 4:42 PM a s <al...@gmail.com> wrote:

> hi Guys,
>
> I am building a structured streaming  app for google analytics data
>
> i want to capture the number of rows read and processed
>
> i am able to see it in log how can i send it to kafka
>
>
> Thanks
> Alis
>