Re: [I] split is arranged in ascending order of instant [hudi]

["nsivabalan (via GitHub)" <gi...@apache.org>]

nsivabalan commented on issue #16314:
URL: https://github.com/apache/hudi/issues/16314#issuecomment-4795576127

   This appears to have been fixed on master. In `IncrementalInputSplits#getInputSplits` (`hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/IncrementalInputSplits.java:427`), the resulting splits are sorted in ascending order of the latest commit via `Comparator.comparing(MergeOnReadInputSplit::getLatestCommit)`. This was introduced by commit `44ca2bb` ([HUDI-6992] / #9923, Nov 2023), which also corrected the `latestCommit` attribute on each split (previously every split was assigned `endInstant`, defeating any ordering by commit time). The downstream contract is also documented in `StreamReadMonitoringFunction` Javadoc (`StreamReadMonitoringFunction.java:70-72`). If you can still reproduce out-of-order forwarding on a recent build, please share repro steps / table layout — otherwise this issue can probably be closed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org