You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "voon (Jira)" <ji...@apache.org> on 2022/10/11 06:35:00 UTC

[jira] [Created] (HUDI-5007) Prevent Hudi from reading the entire timeline's when performing a LATEST streaming read

voon created HUDI-5007:
--------------------------

             Summary: Prevent Hudi from reading the entire timeline's when performing a LATEST streaming read
                 Key: HUDI-5007
                 URL: https://issues.apache.org/jira/browse/HUDI-5007
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: voon


The current implementation of the Hudi-on-Flink stream reader will attempt to read out all files on the active timeline when reading from the latest instant (read.start-commit not specified).

 

This will cause unnecessary file exists check, decreasing read performance on the first read iteration.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)