You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Kamal Mittal via user <us...@flink.apache.org> on 2023/07/01 08:53:39 UTC

Checkpointed data size is zero

Hello Community,

I have a requirement to read data coming over TCP socket stream and for the same written one custom source function reading data by TCP socket.

Job is running successfully but in flink dashboard checkpoint overview, checkpointed data size is 0.

Can you please help if there is anything need to check or some issue/limitation due to TCP streaming?

Rgds,
Kamal

Re: Checkpointed data size is zero

Posted by Yanfei Lei <fr...@gmail.com>.

Hi Kamal,

Is the Full Checkpoint Data Size[1] also zero? If not, it may be that
no data is processed during this checkpoint.

[1] https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/ops/monitoring/checkpoint_monitoring/

Shammon FY <zj...@gmail.com> 于2023年7月4日周二 09:10写道：

>
> Hi Kamal,
>
> You can check whether flink job has readed data from source in flink web ui, it will show total record count and size for each operator.
>
> Best,
> Shammon FY
>
> On Sat, Jul 1, 2023 at 4:53 PM Kamal Mittal via user <us...@flink.apache.org> wrote:
>>
>> Hello Community,
>>
>>
>>
>> I have a requirement to read data coming over TCP socket stream and for the same written one custom source function reading data by TCP socket.
>>
>>
>>
>> Job is running successfully but in flink dashboard checkpoint overview, checkpointed data size is 0.
>>
>>
>>
>> Can you please help if there is anything need to check or some issue/limitation due to TCP streaming?
>>
>>
>>
>> Rgds,
>>
>> Kamal



--
Best,
Yanfei

Re: Checkpointed data size is zero

Posted by Shammon FY <zj...@gmail.com>.

Hi Kamal,

You can check whether flink job has readed data from source in flink web
ui, it will show total record count and size for each operator.

Best,
Shammon FY

On Sat, Jul 1, 2023 at 4:53 PM Kamal Mittal via user <us...@flink.apache.org>
wrote:

> Hello Community,
>
>
>
> I have a requirement to read data coming over TCP socket stream and for
> the same written one custom source function reading data by TCP socket.
>
>
>
> Job is running successfully but in flink dashboard checkpoint overview,
> checkpointed data size is 0.
>
>
>
> Can you please help if there is anything need to check or some
> issue/limitation due to TCP streaming?
>
>
>
> Rgds,
>
> Kamal
>