You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/22 14:40:40 UTC

[GitHub] [hudi] minihippo commented on a change in pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.

minihippo commented on a change in pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#discussion_r832273516



##########
File path: hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/BucketStreamWriteFunction.java
##########
@@ -66,16 +68,21 @@
   private String indexKeyFields;
 
   /**
-   * BucketID to file group mapping.
+   * BucketID should be load in this task.
    */
-  private HashMap<String, String> bucketIndex;
+  private Set<Integer> bucketToLoad;
+
+  /**
+   * BucketID to file group mapping in each partition.
+   */
+  private Map<String, Map<Integer, String>> bucketIndex;

Review comment:
       fixed
   




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org