You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/22 12:53:27 UTC
[GitHub] [hudi] minihippo opened a new pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
minihippo opened a new pull request #5093:
URL: https://github.com/apache/hudi/pull/5093
## What is the purpose of the pull request
Optimization for bootstrap when use flink bucket index. Load and cache the filegroups info of a partition which poccessing the records belong to instead of loading all partitions at first.
## Brief change log
- BucketStreamWriteFunction
## Verify this pull request
This pull request is already covered by existing tests.
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] garyli1019 commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
garyli1019 commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075805688
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] garyli1019 commented on a change in pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
garyli1019 commented on a change in pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#discussion_r832204078
##########
File path: hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/BucketStreamWriteFunction.java
##########
@@ -108,25 +116,30 @@ public void initializeState(FunctionInitializationContext context) throws Except
@Override
public void snapshotState() {
super.snapshotState();
- this.bucketIndex.putAll(this.incBucketIndex);
this.incBucketIndex.clear();
}
@Override
public void processElement(I i, ProcessFunction<I, Object>.Context context, Collector<Object> collector) throws Exception {
HoodieRecord<?> record = (HoodieRecord<?>) i;
final HoodieKey hoodieKey = record.getKey();
+ final String partition = hoodieKey.getPartitionPath();
final HoodieRecordLocation location;
+ bootstrapIndexIfNeed(partition);
+ Map<Integer, String> bucketToFileIdMap = bucketIndex.get(partition);
final int bucketNum = BucketIdentifier.getBucketId(hoodieKey, indexKeyFields, this.bucketNum);
final String partitionBucketId = BucketIdentifier.partitionBucketIdStr(hoodieKey.getPartitionPath(), bucketNum);
- if (bucketIndex.containsKey(partitionBucketId)) {
- location = new HoodieRecordLocation("U", bucketIndex.get(partitionBucketId));
+ if (incBucketIndex.contains(partitionBucketId)) {
Review comment:
nice catch, a bug fixed here
##########
File path: hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/BucketStreamWriteFunction.java
##########
@@ -66,16 +68,21 @@
private String indexKeyFields;
/**
- * BucketID to file group mapping.
+ * BucketID should be load in this task.
*/
- private HashMap<String, String> bucketIndex;
+ private Set<Integer> bucketToLoad;
+
+ /**
+ * BucketID to file group mapping in each partition.
+ */
+ private Map<String, Map<Integer, String>> bucketIndex;
Review comment:
please add comments for the meaning of key and value of this map.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] minihippo commented on a change in pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
minihippo commented on a change in pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#discussion_r832273516
##########
File path: hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/BucketStreamWriteFunction.java
##########
@@ -66,16 +68,21 @@
private String indexKeyFields;
/**
- * BucketID to file group mapping.
+ * BucketID should be load in this task.
*/
- private HashMap<String, String> bucketIndex;
+ private Set<Integer> bucketToLoad;
+
+ /**
+ * BucketID to file group mapping in each partition.
+ */
+ private Map<String, Map<Integer, String>> bucketIndex;
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080223446
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
* 7d104082d737bb48dc61c4a54462b4bf795a6422 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075266249
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
}, {
"hash" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
* 48807f436bf5271116426dc068b7a47bc7dd494b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075150145
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075140099
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075806773
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a change in pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
danny0405 commented on a change in pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#discussion_r836190712
##########
File path: hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/bucket/BucketStreamWriteFunction.java
##########
@@ -109,25 +118,30 @@ public void initializeState(FunctionInitializationContext context) throws Except
@Override
public void snapshotState() {
super.snapshotState();
- this.bucketIndex.putAll(this.incBucketIndex);
this.incBucketIndex.clear();
}
@Override
public void processElement(I i, ProcessFunction<I, Object>.Context context, Collector<Object> collector) throws Exception {
HoodieRecord<?> record = (HoodieRecord<?>) i;
final HoodieKey hoodieKey = record.getKey();
+ final String partition = hoodieKey.getPartitionPath();
final HoodieRecordLocation location;
+ bootstrapIndexIfNeed(partition);
+ Map<Integer, String> bucketToFileIdMap = bucketIndex.get(partition);
final int bucketNum = BucketIdentifier.getBucketId(hoodieKey, indexKeyFields, this.bucketNum);
Review comment:
`.get(partition)` -> `computeIfAbsent(partition, p -> new HashMap<>())`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080343102
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7444",
"triggerID" : "1080340650",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 7d104082d737bb48dc61c4a54462b4bf795a6422 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7444)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1077913093
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075269921
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
}, {
"hash" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
* 48807f436bf5271116426dc068b7a47bc7dd494b UNKNOWN
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075269921
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
}, {
"hash" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
* 48807f436bf5271116426dc068b7a47bc7dd494b UNKNOWN
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075806773
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1077806787
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1077806787
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1076345117
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075145668
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] minihippo commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
minihippo commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075147932
@garyli1019 An improvement for HUDI-3315, please take a look.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075150145
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080221964
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
* 7d104082d737bb48dc61c4a54462b4bf795a6422 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080343102
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7444",
"triggerID" : "1080340650",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 7d104082d737bb48dc61c4a54462b4bf795a6422 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7444)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1077913093
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075145668
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075293632
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
}, {
"hash" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
* 48807f436bf5271116426dc068b7a47bc7dd494b UNKNOWN
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] garyli1019 commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
garyli1019 commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1076264419
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1076265533
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] garyli1019 merged pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
garyli1019 merged pull request #5093:
URL: https://github.com/apache/hudi/pull/5093
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080223446
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
* 7d104082d737bb48dc61c4a54462b4bf795a6422 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075405949
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075857887
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] garyli1019 commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
garyli1019 commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080340650
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1077803857
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a change in pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
danny0405 commented on a change in pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#discussion_r836191215
##########
File path: hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/bucket/BucketStreamWriteFunction.java
##########
@@ -67,16 +69,22 @@
private String indexKeyFields;
/**
- * BucketID to file group mapping.
+ * BucketID should be load in this task.
*/
- private HashMap<String, String> bucketIndex;
+ private Set<Integer> bucketToLoad;
+
Review comment:
We can make the `bucketToLoad` as local variable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] garyli1019 commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
garyli1019 commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1078699819
@minihippo would you resolve the conflict
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080336483
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7d104082d737bb48dc61c4a54462b4bf795a6422 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080434143
Thanks for the fix, i have fired a minor fix patch, can you apply it then, thanks ~
[3539_fix.patch.zip](https://github.com/apache/hudi/files/8361529/3539_fix.patch.zip)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1076265533
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1077803857
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075408907
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075140099
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075218095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075857887
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080221964
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301)
* 7d104082d737bb48dc61c4a54462b4bf795a6422 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080336483
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7d104082d737bb48dc61c4a54462b4bf795a6422 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1076345117
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075266249
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
}, {
"hash" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
* 48807f436bf5271116426dc068b7a47bc7dd494b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075408907
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075293632
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
}, {
"hash" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "48807f436bf5271116426dc068b7a47bc7dd494b",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
* 48807f436bf5271116426dc068b7a47bc7dd494b UNKNOWN
* 53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1075218095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186",
"triggerID" : "6e7ea4918f919d51fb06da5c8cacc29c3837049f",
"triggerType" : "PUSH"
}, {
"hash" : "15719261baa62d64201094adfe6e9570db5bb979",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188",
"triggerID" : "15719261baa62d64201094adfe6e9570db5bb979",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e7ea4918f919d51fb06da5c8cacc29c3837049f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7186)
* 15719261baa62d64201094adfe6e9570db5bb979 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7188)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a change in pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
danny0405 commented on a change in pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#discussion_r836191215
##########
File path: hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/bucket/BucketStreamWriteFunction.java
##########
@@ -67,16 +69,22 @@
private String indexKeyFields;
/**
- * BucketID to file group mapping.
+ * BucketID should be load in this task.
*/
- private HashMap<String, String> bucketIndex;
+ private Set<Integer> bucketToLoad;
+
Review comment:
We can make the `bucketToLoad` as local variable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5093: [HUDI-3539] Flink bucket index bucketID bootstrap optimization.
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #5093:
URL: https://github.com/apache/hudi/pull/5093#issuecomment-1080532451
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7190",
"triggerID" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"triggerType" : "PUSH"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7205",
"triggerID" : "1075805688",
"triggerType" : "MANUAL"
}, {
"hash" : "53ff8054bc7f8c7b6358a622b2197f4bb48fb0d9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7235",
"triggerID" : "1076264419",
"triggerType" : "MANUAL"
}, {
"hash" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7301",
"triggerID" : "84fbc2eee9f31fdf66823f10f4e023bfaf2e2a09",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438",
"triggerID" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"triggerType" : "PUSH"
}, {
"hash" : "7d104082d737bb48dc61c4a54462b4bf795a6422",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7444",
"triggerID" : "1080340650",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 7d104082d737bb48dc61c4a54462b4bf795a6422 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7438) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7444)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org