You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 03:21:54 UTC
[I] Refactor Flink MOR write in a streaming way [hudi]
hudi-bot opened a new issue, #14438:
URL: https://github.com/apache/hudi/issues/14438
Currently, we do the actual write during the snapshot and pass a List<HoodieRecord> to the WriteHandle. This will make the snapshot operation and causing checkpoint timeout sometimes. We need to refactor the handle in a streaming fashion.
To append records to the WriteHandle during the processElement stage and only flush to the disk during the checkpoint.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-2128
- Type: Improvement
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Refactor Flink MOR write in a streaming way [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #14438:
URL: https://github.com/apache/hudi/issues/14438#issuecomment-4795159291
Closing for inactivity. JIRA: [HUDI-2128](https://issues.apache.org/jira/browse/HUDI-2128). This issue has had no activity for over two years and the GitHub thread has no replies. If this is still relevant, please open a fresh issue with reproduction details on a recent release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Refactor Flink MOR write in a streaming way [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #14438: Refactor Flink MOR write in a streaming way
URL: https://github.com/apache/hudi/issues/14438
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org