You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by 湘晗刚 <10...@qq.com> on 2023/05/15 01:41:07 UTC

(无主题)

Flink&nbsp;1.10.0&nbsp;checkpoint&nbsp;to&nbsp;hdfs&nbsp;failed:
Caused&nbsp;by:org.apache.flink.util.SerializedThrowable:
The&nbsp;directory&nbsp;item&nbsp;limit&nbsp;of&nbsp;.../shared&nbsp;is&nbsp;
Exceeded:limit=1048576&nbsp;items=1048576

Re: (无主题)

Posted by Hangxiang Yu <ma...@gmail.com>.

Hi,
It's related to FLINK-11695
<https://issues.apache.org/jira/browse/FLINK-11695> which has not been
resolved until now.
You could increase the limit size of hdfs to alleviate this problem.
BTW, You could also share or check something before modifying the
configuration:
From the logic of your job (how to use state), does the size and quantity
of this state data meet expectations?

On Mon, May 15, 2023 at 9:42 AM 湘晗刚 <10...@qq.com> wrote:

> Flink 1.10.0 checkpoint to hdfs failed:
> Caused by:org.apache.flink.util.SerializedThrowable:
> The directory item limit of .../shared is
> Exceeded:limit=1048576 items=1048576
>

-- 
Best,
Hangxiang.