You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/08/21 03:57:25 UTC
[GitHub] [hudi] yuzhaojing opened a new pull request #3516: [HUDI-2342] Optimize Bootstrap operator
yuzhaojing opened a new pull request #3516:
URL: https://github.com/apache/hudi/pull/3516
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
*(For example: This pull request adds quick-start document.)*
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
}, {
"hash" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847",
"triggerID" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* debb3d5a65c31ea246e9ef47d5ad88d69099ff82 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
}, {
"hash" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847",
"triggerID" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6c7b7c675787252278132ea7bcd94e78bb352eac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846)
* debb3d5a65c31ea246e9ef47d5ad88d69099ff82 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903091354
> BootstrapFunction become lighter,i think index.bootstrap.enabled default value set true is necessary
Thanks for this idea, it's a better implementation.
I also think we will set index.bootstrap.enabled default value to true when load the keys incrementally in next pr.
@danny0405 what do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
}, {
"hash" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6c7b7c675787252278132ea7bcd94e78bb352eac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846)
* debb3d5a65c31ea246e9ef47d5ad88d69099ff82 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] loukey-lj commented on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
loukey-lj commented on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903063370
BootstrapFunction become lighter,i think index.bootstrap.enabled default value set true is necessary
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903106376
> > BootstrapFunction become lighter,i think index.bootstrap.enabled default value set true is necessary
>
> Thanks for this idea, it's a better implementation.
> I also think we will set index.bootstrap.enabled default value to true when support load the keys incrementally in next pr.
> @danny0405 what do you think?
I think we can.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
}, {
"hash" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847",
"triggerID" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"triggerType" : "PUSH"
}, {
"hash" : "f32978c6e5a7c75562a53cee6608ce067fe3fe84",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1848",
"triggerID" : "f32978c6e5a7c75562a53cee6608ce067fe3fe84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f32978c6e5a7c75562a53cee6608ce067fe3fe84 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1848)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
yuzhaojing edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903091354
> BootstrapFunction become lighter,i think index.bootstrap.enabled default value set true is necessary
Thanks for this idea, it's a better implementation.
I also think we will set index.bootstrap.enabled default value to true when support load the keys incrementally in next pr.
@danny0405 what do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6c7b7c675787252278132ea7bcd94e78bb352eac UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a change in pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
danny0405 commented on a change in pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#discussion_r693307276
##########
File path: hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/BootstrapFunction.java
##########
@@ -68,7 +79,7 @@
* <p>The output records should then shuffle by the recordKey and thus do scalable write.
*/
public class BootstrapFunction<I, O extends HoodieRecord>
- extends ProcessFunction<I, O> {
+ extends AbstractStreamOperator<O> implements OneInputStreamOperator<I, O> {
Review comment:
BootstrapFunction -> BootstrapOperator
##########
File path: hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/BootstrapFunction.java
##########
@@ -193,22 +205,22 @@ protected void loadRecords(String partitionPath, Collector<O> out) throws Except
}
for (HoodieKey hoodieKey : hoodieKeys) {
- out.collect((O) new IndexRecord(generateHoodieRecord(hoodieKey, fileSlice)));
+ output.collect(new StreamRecord(new IndexRecord(generateHoodieRecord(hoodieKey, fileSlice))));
}
});
// load avro log records
List<String> logPaths = fileSlice.getLogFiles()
- // filter out crushed files
- .filter(logFile -> isValidFile(logFile.getFileStatus()))
- .map(logFile -> logFile.getPath().toString())
- .collect(toList());
+ // filter out crushed files
+ .filter(logFile -> isValidFile(logFile.getFileStatus()))
+ .map(logFile -> logFile.getPath().toString())
Review comment:
We can do that in following PR.
##########
File path: hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/BootstrapFunction.java
##########
@@ -79,65 +90,63 @@
protected transient org.apache.hadoop.conf.Configuration hadoopConf;
protected transient HoodieWriteConfig writeConfig;
- private GlobalAggregateManager aggregateManager;
-
+ private transient ListState<String> instantState;
private final Pattern pattern;
- private boolean alreadyBootstrap;
+ private String lastInstantTime;
+ private HoodieFlinkWriteClient writeClient;
+ private String actionType;
public BootstrapFunction(Configuration conf) {
this.conf = conf;
this.pattern = Pattern.compile(conf.getString(FlinkOptions.INDEX_PARTITION_REGEX));
}
@Override
- public void open(Configuration parameters) throws Exception {
- super.open(parameters);
- this.hadoopConf = StreamerUtil.getHadoopConf();
- this.writeConfig = StreamerUtil.getHoodieClientConfig(this.conf);
- this.hoodieTable = getTable();
- this.aggregateManager = ((StreamingRuntimeContext) getRuntimeContext()).getGlobalAggregateManager();
+ public void snapshotState(StateSnapshotContext context) throws Exception {
+ lastInstantTime = this.writeClient.getLastPendingInstant(this.actionType);
+ instantState.update(Collections.singletonList(lastInstantTime));
}
@Override
- @SuppressWarnings("unchecked")
- public void processElement(I value, Context ctx, Collector<O> out) throws Exception {
- if (!alreadyBootstrap) {
- String basePath = hoodieTable.getMetaClient().getBasePath();
- int taskID = getRuntimeContext().getIndexOfThisSubtask();
- LOG.info("Start loading records in table {} into the index state, taskId = {}", basePath, taskID);
- for (String partitionPath : FSUtils.getAllFoldersWithPartitionMetaFile(FSUtils.getFs(basePath, hadoopConf), basePath)) {
- if (pattern.matcher(partitionPath).matches()) {
- loadRecords(partitionPath, out);
- }
+ public void initializeState(StateInitializationContext context) throws Exception {
+ ListStateDescriptor<String> instantStateDescriptor = new ListStateDescriptor<>(
+ "instantStateDescriptor",
+ TypeInformation.of(new TypeHint<String>() {
+ })
Review comment:
Types.STRING()
##########
File path: hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/BootstrapFunction.java
##########
@@ -193,22 +205,22 @@ protected void loadRecords(String partitionPath, Collector<O> out) throws Except
}
for (HoodieKey hoodieKey : hoodieKeys) {
- out.collect((O) new IndexRecord(generateHoodieRecord(hoodieKey, fileSlice)));
+ output.collect(new StreamRecord(new IndexRecord(generateHoodieRecord(hoodieKey, fileSlice))));
}
});
// load avro log records
List<String> logPaths = fileSlice.getLogFiles()
- // filter out crushed files
- .filter(logFile -> isValidFile(logFile.getFileStatus()))
- .map(logFile -> logFile.getPath().toString())
- .collect(toList());
+ // filter out crushed files
+ .filter(logFile -> isValidFile(logFile.getFileStatus()))
+ .map(logFile -> logFile.getPath().toString())
Review comment:
We can promote the code to load the keys incrementally, say, the new keys since last commit state instant.
##########
File path: hudi-flink/src/main/java/org/apache/hudi/sink/bootstrap/BootstrapFunction.java
##########
@@ -68,7 +79,7 @@
* <p>The output records should then shuffle by the recordKey and thus do scalable write.
*/
public class BootstrapFunction<I, O extends HoodieRecord>
- extends ProcessFunction<I, O> {
+ extends AbstractStreamOperator<O> implements OneInputStreamOperator<I, O> {
Review comment:
Also fix the class doc, ditto ` BatchBootstrapFunction`.
##########
File path: hudi-flink/src/test/java/org/apache/hudi/sink/StreamWriteITCase.java
##########
@@ -238,6 +238,7 @@ public void testMergeOnReadWriteWithCompaction() throws Exception {
Configuration conf = TestConfigurations.getDefaultConf(tempFile.getAbsolutePath());
conf.setInteger(FlinkOptions.COMPACTION_DELTA_COMMITS, 1);
conf.setString(FlinkOptions.TABLE_TYPE, HoodieTableType.MERGE_ON_READ.name());
+ conf.setBoolean(FlinkOptions.INDEX_BOOTSTRAP_ENABLED, true);
StreamExecutionEnvironment execEnv = StreamExecutionEnvironment.getExecutionEnvironment();
Review comment:
Why we turn on the bootstrap.
##########
File path: hudi-flink/src/test/java/org/apache/hudi/sink/utils/CompactFunctionWrapper.java
##########
@@ -70,7 +70,7 @@ public CompactFunctionWrapper(Configuration conf) throws Exception {
.build();
this.runtimeContext = new MockStreamingRuntimeContext(false, 1, 0, environment);
this.conf = conf;
- this.functionInitializationContext = new MockFunctionInitializationContext();
+ this.functionInitializationContext = new MockStateInitializationContext();
}
Review comment:
Maybe remove the `this.functionInitializationContext` because it is useless.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
}, {
"hash" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847",
"triggerID" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"triggerType" : "PUSH"
}, {
"hash" : "f32978c6e5a7c75562a53cee6608ce067fe3fe84",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f32978c6e5a7c75562a53cee6608ce067fe3fe84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* debb3d5a65c31ea246e9ef47d5ad88d69099ff82 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847)
* f32978c6e5a7c75562a53cee6608ce067fe3fe84 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
}, {
"hash" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847",
"triggerID" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"triggerType" : "PUSH"
}, {
"hash" : "f32978c6e5a7c75562a53cee6608ce067fe3fe84",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1848",
"triggerID" : "f32978c6e5a7c75562a53cee6608ce067fe3fe84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* debb3d5a65c31ea246e9ef47d5ad88d69099ff82 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1847)
* f32978c6e5a7c75562a53cee6608ce067fe3fe84 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1848)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
}, {
"hash" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "debb3d5a65c31ea246e9ef47d5ad88d69099ff82",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6c7b7c675787252278132ea7bcd94e78bb352eac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846)
* debb3d5a65c31ea246e9ef47d5ad88d69099ff82 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3516:
URL: https://github.com/apache/hudi/pull/3516#issuecomment-903051424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846",
"triggerID" : "6c7b7c675787252278132ea7bcd94e78bb352eac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6c7b7c675787252278132ea7bcd94e78bb352eac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1846)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 merged pull request #3516: [HUDI-2342] Optimize Bootstrap operator
Posted by GitBox <gi...@apache.org>.
danny0405 merged pull request #3516:
URL: https://github.com/apache/hudi/pull/3516
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org