You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Udit Mehrotra (Jira)" <ji...@apache.org> on 2021/08/03 23:14:00 UTC
[jira] [Updated] (HUDI-2162) Instant is null cause flushBuffer
failed in casual
[ https://issues.apache.org/jira/browse/HUDI-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Udit Mehrotra updated HUDI-2162:
--------------------------------
Fix Version/s: 0.10.0
> Instant is null cause flushBuffer failed in casual
> --------------------------------------------------
>
> Key: HUDI-2162
> URL: https://issues.apache.org/jira/browse/HUDI-2162
> Project: Apache Hudi
> Issue Type: Bug
> Components: Flink Integration
> Reporter: zhangminglei
> Assignee: zhangminglei
> Priority: Blocker
> Fix For: 0.10.0
>
>
> Since commit Instant and getting Instant are asynchronous , and thus instant is null the default waiting time is 0 must greater than ckpTimeout would cause Exception belows as shown.
> WRITE_COMMIT_ACK_TIMEOUT is for internal usage. so it is not suitable for java api user under exactly once, This kind of usage is too weak under the context.
> Timeout(0ms) while waiting for instant null to commit
> at org.apache.hudi.sink.StreamWriteFunction.instantToWrite(StreamWriteFunction.java:597)
> at org.apache.hudi.sink.StreamWriteFunction.flushBucket(StreamWriteFunction.java:618)
> at org.apache.hudi.sink.StreamWriteFunction.bufferRecord(StreamWriteFunction.java:554)
> at org.apache.hudi.sink.StreamWriteFunction.processElement(StreamWriteFunction.java:236)
> at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)