You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Manish G <ma...@gmail.com> on 2020/07/09 09:39:28 UTC

A query on Flink metrics in kubernetes

Hi,

I have a query regarding prometheus scraping Flink metrics data with
application running in kubernetes cluster.

If taskmanager is running on multiple nodes, and prometheus requests for
the metrics data, then is that request directed to one of the nodes(based
on some strategy, like round-robin) or is data aggregated from all the
nodes?

With regards

Re: A query on Flink metrics in kubernetes

Posted by Chesnay Schepler <ch...@apache.org>.

 From Flink's perspective no metrics are aggregated, nor are metric 
requests forwarded to some other process.

Each TaskExecutor has its own reporter, that each must be scraped to get 
the full set of metrics.

On 09/07/2020 11:39, Manish G wrote:
> Hi,
>
> I have a query regarding prometheus scraping Flink metrics data with 
> application running in kubernetes cluster.
>
> If taskmanager is running on multiple nodes, and prometheus requests 
> for the metrics data, then is that request directed to one of the 
> nodes(based on some strategy, like round-robin) or is data aggregated 
> from all the nodes?
>
> With regards
>