You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "bithw1 (via GitHub)" <gi...@apache.org> on 2026/01/21 00:28:55 UTC
[I] Help understanding how compaction and normal write work [hudi]
bithw1 opened a new issue, #17960:
URL: https://github.com/apache/hudi/issues/17960
### Describe the problem you faced
Hi,
I would like to understand how normal write works when compaction is scheduled.
As we know,during the Hudi compaction schedule phase, Hudi will collect which file slices will be compacted during compaction execution phase.
Before compaction execution phase actullay starts, write operations continue, I would ask where will the write operations write data to after the file slices are marked as to be compacted? to new file groups?
Thanks.
### To Reproduce
1.
2.
3.
4.
### Expected behavior
1
### Environment Description
* Hudi version:
* Spark version:
* Flink version:
* Hive version:
* Hadoop version:
* Storage (HDFS/S3/GCS..):
* Running on Docker? (yes/no):
### Additional context
1
### Stacktrace
```shell
1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Help understanding how compaction and normal write work [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #17960:
URL: https://github.com/apache/hudi/issues/17960#issuecomment-3791233920
Hi @bithw1
After compaction is **scheduled**, Hudi only marks eligible file slices but does not block writes. Normal write operations continue appending data to **new log files of the same file groups**, not new file groups.
When compaction executes, it compacts only the log files present at scheduling time. Log files created after scheduling are handled in the **next compaction cycle**.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org