You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "konwu (Jira)" <ji...@apache.org> on 2022/03/31 07:36:00 UTC

[jira] [Created] (HUDI-3758) Optimize flink partition table with BucketIndex

konwu created HUDI-3758:
---------------------------

             Summary: Optimize flink partition table with BucketIndex
                 Key: HUDI-3758
                 URL: https://issues.apache.org/jira/browse/HUDI-3758
             Project: Apache Hudi
          Issue Type: Improvement
          Components: flink
            Reporter: konwu
             Fix For: 0.11.0


When using flink bucket index , I meet two problems
 * without use all streamWriter tasks when partition table with small Bucket number
 * crashed with the following step

 # start job
 # killed before first commit success ( left some log files)
 # restart job run nomal
 # kill job and restart  throws `Duplicate fileID`



--
This message was sent by Atlassian Jira
(v8.20.1#820001)