You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Kamal Mittal via user <us...@flink.apache.org> on 2025/05/21 04:39:41 UTC
Flink metrices for pending records
Hello,
Can you please help to know if any metrices for "pending records" at source level is exposed by flink - 1.20? At below link there is nothing like that.
Metrics | Apache Flink<https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/ops/metrics/>
Rgds,
Kamal
Re: Flink metrices for pending records
Posted by Andreas Bube via user <us...@flink.apache.org>.
I do not know why that is. It's entirely up to the Source/Sink implementors
to provide these metrics. It's highly recommended, but not required.
If I were you I'd look into those particular Source's and Sink's
documentation and source code to understand why you see zeros where you do
not expect to see them.
On Wed, 21 May 2025 at 08:35, Kamal Mittal <ka...@ericsson.com>
wrote:
> Thanks.
>
>
>
> Can you please also let me know that why for source like
> ‘0.Source__RandomNumberSource.numRecordsIn’ is always seen as ‘0’ and only
> out records count is shown?
>
>
>
> Similarly for sink like ‘0.Sink__Print_to_Std__Out.numRecordsOut’ is
> always shown as ‘0’ and only in records count is shown?
>
>
>
> Rgds,
>
> Kamal
>
>
>
> *From:* Andreas Bube <ab...@toogoodtogo.com>
> *Sent:* 21 May 2025 11:41
> *To:* Kamal Mittal <ka...@ericsson.com>
> *Subject:* Re: Flink metrices for pending records
>
>
>
> You don't often get email from abube@toogoodtogo.com. Learn why this is
> important <https://aka.ms/LearnAboutSenderIdentification>
>
> Hi Kamal,
>
>
>
> Each Source implementation may provide it's own set of metrics. Kafka, for
> instance, has a "pendingRecords" metrics. See
> https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/ops/metrics/
>
>
>
> On Wed, 21 May 2025 at 06:39, Kamal Mittal via user <us...@flink.apache.org>
> wrote:
>
> Hello,
>
>
>
> Can you please help to know if any metrices for “pending records” at
> source level is exposed by flink – 1.20? At below link there is nothing
> like that.
>
>
>
> Metrics | Apache Flink
> <https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/ops/metrics/>
>
>
>
> Rgds,
>
> Kamal
>
>
RE: Flink metrices for pending records
Posted by Kamal Mittal via user <us...@flink.apache.org>.
Thanks.
Can you please also let me know that why for source like '0.Source__RandomNumberSource.numRecordsIn' is always seen as '0' and only out records count is shown?
Similarly for sink like '0.Sink__Print_to_Std__Out.numRecordsOut' is always shown as '0' and only in records count is shown?
Rgds,
Kamal
From: Andreas Bube <ab...@toogoodtogo.com>
Sent: 21 May 2025 11:41
To: Kamal Mittal <ka...@ericsson.com>
Subject: Re: Flink metrices for pending records
You don't often get email from abube@toogoodtogo.com<ma...@toogoodtogo.com>. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification>
Hi Kamal,
Each Source implementation may provide it's own set of metrics. Kafka, for instance, has a "pendingRecords" metrics. See https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/ops/metrics/
On Wed, 21 May 2025 at 06:39, Kamal Mittal via user <us...@flink.apache.org>> wrote:
Hello,
Can you please help to know if any metrices for "pending records" at source level is exposed by flink - 1.20? At below link there is nothing like that.
Metrics | Apache Flink<https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/ops/metrics/>
Rgds,
Kamal