You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/05/18 15:32:58 UTC
[GitHub] [hudi] wulei0302 opened a new pull request, #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
wulei0302 opened a new pull request, #5627:
URL: https://github.com/apache/hudi/pull/5627
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
Step2 (RFC - 46)：HoodieRecordCombiningEngine and its bridge and spark record
Based on [Step1](https://github.com/apache/hudi/pull/5522) , Step2 adds the HoodieRecordCombiningEngine API and the HoodieSparkRecord
## Brief change log
- Rebase Record combining semantic into `HoodieRecordCombiningEngine`
- Create Engine-specific Implementations of `HoodieRecord`
Jira:
[HUDI-3350](https://issues.apache.org/jira/browse/HUDI-3350)
[HUDI-3351](https://issues.apache.org/jira/browse/HUDI-3351)
## Verify this pull request
This pull request is already covered by existing tests
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917602895
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadTableState.java:
##########
@@ -82,6 +85,10 @@ public int getOperationPos() {
return operationPos;
}
+ public String getMergeClass() {
+ return mergeClass;
+ }
Review Comment:
that`s right,ths
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914350928
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -123,6 +124,12 @@ public class HoodieWriteConfig extends HoodieConfig {
.withDocumentation("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting. "
+ "This will render any value set for PRECOMBINE_FIELD_OPT_VAL in-effective");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
Review Comment:
Would suggest to use `hoodie.merge.class` if the option is also used for reading code path.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914355923
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
Review Comment:
I would suggest a name like `HoodiePayloadMerger` and definitely -1 for `HoodieMerge` because it is a confusing bad word and merge is a verb.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r895332836
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##########
@@ -234,6 +235,12 @@ public class HoodieCompactionConfig extends HoodieConfig {
+ "the record payload class to merge records in the log against each other, merge again with the base file and "
+ "produce the final record to be written after compaction.");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.combine.engine.class")
+ .defaultValue(HoodieAvroRecordCombiningEngine.class.getName())
+ .withDocumentation("Combine engine class to use for performing compactions, i.e merge delta logs with current base file and then "
Review Comment:
Yeah,I will make adjustments, Thank you for your advice.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154632017
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157294441
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323)
* 88bfb7612b10d46fd752c1caed2572ba72f5d773 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1160519469
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157169890
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168794079
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
* 7e0eea449656a8c38897778f8b39e4400e36d11f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168754236
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan merged pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
xushiyan merged PR #5627:
URL: https://github.com/apache/hudi/pull/5627
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141948931
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 932911e7c61e35795e0a7d1076eabc4787df4972 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1162903638
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ef9f638b283a9fd8ace9349f3ba461d229bc68ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423)
* 073ca5cf638176264ef5a09a4ea083be6780d2b7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904529468
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
Review Comment:
fixed, same as `HoodieAvroUtils`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154633993
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157226761
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1164236909
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 98a75b36c814c85acd058a636830d627357beee1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465)
* 247df2328bfdc55400c16aca7e3d031a2217049e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167248579
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* b61c6fff92835625283c20136e8ee5e6fd9a8e49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167256329
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* b61c6fff92835625283c20136e8ee5e6fd9a8e49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578)
* 5c34cb62dac887b1adb4ea9ff8c3873f3680818b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1164037891
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 073ca5cf638176264ef5a09a4ea083be6780d2b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141272832
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141280698
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r903936471
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), ((HoodieMetadataPayload) picked), newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.of(((HoodieAvroIndexedRecord) older).getData());
Review Comment:
can `getData()` return null ? `ofNullable()` looks safer
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieWriteHelper.java:
##########
@@ -58,10 +58,8 @@ public HoodieData<HoodieRecord<T>> deduplicateRecords(
return Pair.of(key, record);
}).reduceByKey((rec1, rec2) -> {
@SuppressWarnings("unchecked")
- HoodieRecord reducedRec = rec2.preCombine(rec1);
- HoodieKey reducedKey = rec1.getData().equals(reducedRec) ? rec1.getKey() : rec2.getKey();
-
- return (HoodieRecord<T>) reducedRec.newInstance(reducedKey);
+ HoodieRecord<T> reducedRecord = hoodieMerge.preCombine(rec1, rec2);
+ return reducedRecord.newInstance();
Review Comment:
can you clarify the purpose of `newInstance()` pls?
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), ((HoodieMetadataPayload) picked), newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.of(((HoodieAvroIndexedRecord) older).getData());
+ } else {
+ if (null == props) {
+ previousRecordAvroPayload = ((HoodieRecordPayload)older.getData()).getInsertValue(schema);
Review Comment:
this API is deprecated and we should just skip calling it? should just invoke the one with props ? by convention an argument should not be `null` so the null check also redundant.
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala:
##########
@@ -303,7 +305,13 @@ class HoodieMergeOnReadRDD(@transient sc: SparkContext,
private def merge(curAvroRecord: GenericRecord, newRecord: HoodieRecord[_ <: HoodieRecordPayload[_]]): Option[IndexedRecord] = {
// NOTE: We have to pass in Avro Schema used to read from Delta Log file since we invoke combining API
// on the record from the Delta Log
- toScalaOption(newRecord.getData.combineAndGetUpdateValue(curAvroRecord, logFileReaderAvroSchema, payloadProps))
+ // TODO IndexedRecord to HoodieRecord
Review Comment:
ditto
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
Review Comment:
```suggestion
val projection = getCachedProjection(mergeSchema, stitchedSchema)
```
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
Review Comment:
unfinished work?
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
Review Comment:
you can use `{@link }` in javadoc to hyperlink to it
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSparkRecordMerge.java:
##########
@@ -0,0 +1,48 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.model.HoodieRecord;
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.util.Properties;
+
+public class HoodieSparkRecordMerge implements HoodieMerge {
+
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ if (older.getData() == null) {
+ // use natural order for delete record
+ return older;
+ }
+ if (older.getOrderingValue().compareTo(newer.getOrderingValue()) > 0) {
+ return older;
+ } else {
+ return newer;
+ }
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ return Option.of(newer);
+ }
Review Comment:
no merging logic here? is this planned in step 3's work?
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldElementType = oldSchema.asInstanceOf[ArrayType].elementType
+ val oldArray = oldRecord.asInstanceOf[ArrayData]
+ val newElementType = targetSchema.elementType
+ val newArray = new GenericArrayData(Array.fill(oldArray.numElements())(null).asInstanceOf[Array[Any]])
+ fieldNames.push("element")
+ oldArray.toSeq[Any](oldElementType).zipWithIndex.foreach { case (value, i) => newArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldElementType, newElementType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newArray
+ case targetSchema: MapType =>
+ if (!oldRecord.isInstanceOf[MapData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldValueType = oldSchema.asInstanceOf[MapType].valueType
+ val oldKeyType = oldSchema.asInstanceOf[MapType].keyType
+ val oldMap = oldRecord.asInstanceOf[MapData]
+ val newValueType = targetSchema.valueType
+ val newKeyArray = new GenericArrayData(Array.fill(oldMap.keyArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newValueArray = new GenericArrayData(Array.fill(oldMap.valueArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newMap = new ArrayBasedMapData(newKeyArray, newValueArray)
+ fieldNames.push("value")
+ oldMap.keyArray().toSeq[Any](oldKeyType).zipWithIndex.foreach { case (value, i) => newKeyArray.update(i, value) }
+ oldMap.valueArray().toSeq[Any](oldValueType).zipWithIndex.foreach { case (value, i) => newValueArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldValueType, newValueType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newMap
+ case _ => rewritePrimaryType(oldRecord, oldSchema, newSchema)
+ }
+ }
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecord(record, oldSchema, newSchema)
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteEvolutionRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteEvolutionRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecordWithNewSchema(record, oldSchema, newSchema, new util.HashMap[String, String]())
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ def getCacheSchema(schema: Schema): StructType = {
Review Comment:
```suggestion
def getCachedSchema(schema: Schema): StructType = {
```
##########
hudi-common/src/main/java/org/apache/hudi/common/util/ReflectionUtils.java:
##########
@@ -61,6 +63,10 @@ public static Class<?> getClass(String clazzName) {
return CLAZZ_CACHE.get(clazzName);
}
+ private static Object getInstance(String clazzName) {
+ return INSTANCE_CACHE.get(clazzName);
+ }
Review Comment:
this private method looks redundant
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadInputFormat.java:
##########
@@ -753,7 +761,9 @@ private Option<IndexedRecord> mergeRowWithLog(
String curKey) throws IOException {
final HoodieAvroRecord<?> record = (HoodieAvroRecord) scanner.getRecords().get(curKey);
GenericRecord historyAvroRecord = (GenericRecord) rowDataToAvroConverter.convert(tableSchema, curRow);
- return record.getData().combineAndGetUpdateValue(historyAvroRecord, tableSchema);
+ // TODO IndexedRecord to HoodieRecord
Review Comment:
is this TODO part of step 2 work?
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -169,15 +180,21 @@ public HoodieOperation getOperation() {
return operation;
}
+ public Comparable getOrderingValue() {
+ if (null == orderingVal) {
+ // default natural order is 0
+ return 0;
+ }
+ return orderingVal;
Review Comment:
why not set this within constructor so you don't need to check it for every get?
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), ((HoodieMetadataPayload) picked), newer.getOperation());
Review Comment:
the casting `(HoodieMetadataPayload)` is not needed
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
Review Comment:
ditto
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldElementType = oldSchema.asInstanceOf[ArrayType].elementType
+ val oldArray = oldRecord.asInstanceOf[ArrayData]
+ val newElementType = targetSchema.elementType
+ val newArray = new GenericArrayData(Array.fill(oldArray.numElements())(null).asInstanceOf[Array[Any]])
+ fieldNames.push("element")
+ oldArray.toSeq[Any](oldElementType).zipWithIndex.foreach { case (value, i) => newArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldElementType, newElementType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newArray
+ case targetSchema: MapType =>
+ if (!oldRecord.isInstanceOf[MapData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
Review Comment:
ditto
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
Review Comment:
use helper from `org.apache.hudi.common.util.ValidationUtils`
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldElementType = oldSchema.asInstanceOf[ArrayType].elementType
+ val oldArray = oldRecord.asInstanceOf[ArrayData]
+ val newElementType = targetSchema.elementType
+ val newArray = new GenericArrayData(Array.fill(oldArray.numElements())(null).asInstanceOf[Array[Any]])
+ fieldNames.push("element")
+ oldArray.toSeq[Any](oldElementType).zipWithIndex.foreach { case (value, i) => newArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldElementType, newElementType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newArray
+ case targetSchema: MapType =>
+ if (!oldRecord.isInstanceOf[MapData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldValueType = oldSchema.asInstanceOf[MapType].valueType
+ val oldKeyType = oldSchema.asInstanceOf[MapType].keyType
+ val oldMap = oldRecord.asInstanceOf[MapData]
+ val newValueType = targetSchema.valueType
+ val newKeyArray = new GenericArrayData(Array.fill(oldMap.keyArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newValueArray = new GenericArrayData(Array.fill(oldMap.valueArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newMap = new ArrayBasedMapData(newKeyArray, newValueArray)
+ fieldNames.push("value")
+ oldMap.keyArray().toSeq[Any](oldKeyType).zipWithIndex.foreach { case (value, i) => newKeyArray.update(i, value) }
+ oldMap.valueArray().toSeq[Any](oldValueType).zipWithIndex.foreach { case (value, i) => newValueArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldValueType, newValueType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newMap
+ case _ => rewritePrimaryType(oldRecord, oldSchema, newSchema)
+ }
+ }
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecord(record, oldSchema, newSchema)
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteEvolutionRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteEvolutionRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecordWithNewSchema(record, oldSchema, newSchema, new util.HashMap[String, String]())
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ def getCacheSchema(schema: Schema): StructType = {
+ if (!schemaMap.contains(schema)) {
+ schemaMap.synchronized {
+ if (!schemaMap.contains(schema)) {
+ val structType = AvroConversionUtils.convertAvroSchemaToStructType(schema)
+ schemaMap.put(schema, structType)
+ }
+ }
+ }
+ schemaMap.get(schema)
+ }
+
+ private def getCacheProjection(from: StructType, to: StructType): Projection = {
Review Comment:
```suggestion
private def getCachedProjection(from: StructType, to: StructType): Projection = {
```
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldElementType = oldSchema.asInstanceOf[ArrayType].elementType
+ val oldArray = oldRecord.asInstanceOf[ArrayData]
+ val newElementType = targetSchema.elementType
+ val newArray = new GenericArrayData(Array.fill(oldArray.numElements())(null).asInstanceOf[Array[Any]])
+ fieldNames.push("element")
+ oldArray.toSeq[Any](oldElementType).zipWithIndex.foreach { case (value, i) => newArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldElementType, newElementType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newArray
+ case targetSchema: MapType =>
+ if (!oldRecord.isInstanceOf[MapData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldValueType = oldSchema.asInstanceOf[MapType].valueType
+ val oldKeyType = oldSchema.asInstanceOf[MapType].keyType
+ val oldMap = oldRecord.asInstanceOf[MapData]
+ val newValueType = targetSchema.valueType
+ val newKeyArray = new GenericArrayData(Array.fill(oldMap.keyArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newValueArray = new GenericArrayData(Array.fill(oldMap.valueArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newMap = new ArrayBasedMapData(newKeyArray, newValueArray)
+ fieldNames.push("value")
+ oldMap.keyArray().toSeq[Any](oldKeyType).zipWithIndex.foreach { case (value, i) => newKeyArray.update(i, value) }
+ oldMap.valueArray().toSeq[Any](oldValueType).zipWithIndex.foreach { case (value, i) => newValueArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldValueType, newValueType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newMap
+ case _ => rewritePrimaryType(oldRecord, oldSchema, newSchema)
+ }
+ }
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecord(record, oldSchema, newSchema)
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteEvolutionRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteEvolutionRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecordWithNewSchema(record, oldSchema, newSchema, new util.HashMap[String, String]())
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ def getCacheSchema(schema: Schema): StructType = {
+ if (!schemaMap.contains(schema)) {
+ schemaMap.synchronized {
+ if (!schemaMap.contains(schema)) {
+ val structType = AvroConversionUtils.convertAvroSchemaToStructType(schema)
+ schemaMap.put(schema, structType)
+ }
+ }
+ }
+ schemaMap.get(schema)
+ }
+
+ private def getCacheProjection(from: StructType, to: StructType): Projection = {
+ val schemaPair = (from, to)
+ if (!projectionMap.contains(schemaPair)) {
+ projectionMap.synchronized {
+ if (!projectionMap.contains(schemaPair)) {
+ val projection = generateMutableProjection(from, to)
+ projectionMap.put(schemaPair, projection)
+ }
+ }
+ }
+ projectionMap.get(schemaPair)
+ }
+
+ def getCacheSchemaPosMap(schema: StructType): Map[String, (StructField, Int)] = {
+ if (!SchemaPosMap.contains(schema)) {
+ SchemaPosMap.synchronized {
+ if (!SchemaPosMap.contains(schema)) {
+ val fieldMap = schema.fields.zipWithIndex.map { case (field, i) => (field.name, (field, i)) }.toMap
+ SchemaPosMap.put(schema, fieldMap)
+ }
+ }
+ }
+ SchemaPosMap.get(schema)
+ }
+
+ private def rewritePrimaryType(oldValue: Any, oldSchema: DataType, newSchema: DataType): Any = {
+ if (oldSchema.equals(newSchema) || (oldSchema.isInstanceOf[DecimalType] && newSchema.isInstanceOf[DecimalType])) {
+ oldSchema match {
+ case NullType | BooleanType | IntegerType | LongType | FloatType | DoubleType | StringType | DateType | TimestampType | BinaryType =>
+ oldValue
+ case DecimalType() =>
+ Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ case _ =>
+ throw new HoodieException("Unknown schema type: " + newSchema)
+ }
+ } else {
+ rewritePrimaryTypeWithDiffSchemaType(oldValue, oldSchema, newSchema)
+ }
+ }
+
+ private def rewritePrimaryTypeWithDiffSchemaType(oldValue: Any, oldSchema: DataType, newSchema: DataType): Any = {
+ val value = newSchema match {
+ case NullType | BooleanType =>
+ case DateType if oldSchema.equals(StringType) =>
+ fromJavaDate(java.sql.Date.valueOf(oldValue.toString))
+ case LongType =>
+ oldSchema match {
+ case IntegerType => oldValue.asInstanceOf[Int].longValue()
+ case _ =>
+ }
+ case FloatType =>
+ oldSchema match {
+ case IntegerType => oldValue.asInstanceOf[Int].floatValue()
+ case LongType => oldValue.asInstanceOf[Long].floatValue()
+ case _ =>
+ }
+ case DoubleType =>
+ oldSchema match {
+ case IntegerType => oldValue.asInstanceOf[Int].doubleValue()
+ case LongType => oldValue.asInstanceOf[Long].doubleValue()
+ case FloatType => java.lang.Double.valueOf(oldValue.asInstanceOf[Float] + "")
Review Comment:
can't we convert float to double directly? parsing string takes time
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldElementType = oldSchema.asInstanceOf[ArrayType].elementType
+ val oldArray = oldRecord.asInstanceOf[ArrayData]
+ val newElementType = targetSchema.elementType
+ val newArray = new GenericArrayData(Array.fill(oldArray.numElements())(null).asInstanceOf[Array[Any]])
+ fieldNames.push("element")
+ oldArray.toSeq[Any](oldElementType).zipWithIndex.foreach { case (value, i) => newArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldElementType, newElementType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newArray
+ case targetSchema: MapType =>
+ if (!oldRecord.isInstanceOf[MapData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldValueType = oldSchema.asInstanceOf[MapType].valueType
+ val oldKeyType = oldSchema.asInstanceOf[MapType].keyType
+ val oldMap = oldRecord.asInstanceOf[MapData]
+ val newValueType = targetSchema.valueType
+ val newKeyArray = new GenericArrayData(Array.fill(oldMap.keyArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newValueArray = new GenericArrayData(Array.fill(oldMap.valueArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newMap = new ArrayBasedMapData(newKeyArray, newValueArray)
+ fieldNames.push("value")
+ oldMap.keyArray().toSeq[Any](oldKeyType).zipWithIndex.foreach { case (value, i) => newKeyArray.update(i, value) }
+ oldMap.valueArray().toSeq[Any](oldValueType).zipWithIndex.foreach { case (value, i) => newValueArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldValueType, newValueType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newMap
+ case _ => rewritePrimaryType(oldRecord, oldSchema, newSchema)
+ }
+ }
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecord(record, oldSchema, newSchema)
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteEvolutionRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteEvolutionRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecordWithNewSchema(record, oldSchema, newSchema, new util.HashMap[String, String]())
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ def getCacheSchema(schema: Schema): StructType = {
+ if (!schemaMap.contains(schema)) {
+ schemaMap.synchronized {
+ if (!schemaMap.contains(schema)) {
+ val structType = AvroConversionUtils.convertAvroSchemaToStructType(schema)
+ schemaMap.put(schema, structType)
+ }
+ }
+ }
+ schemaMap.get(schema)
+ }
+
+ private def getCacheProjection(from: StructType, to: StructType): Projection = {
+ val schemaPair = (from, to)
+ if (!projectionMap.contains(schemaPair)) {
+ projectionMap.synchronized {
+ if (!projectionMap.contains(schemaPair)) {
+ val projection = generateMutableProjection(from, to)
+ projectionMap.put(schemaPair, projection)
+ }
+ }
+ }
+ projectionMap.get(schemaPair)
+ }
+
+ def getCacheSchemaPosMap(schema: StructType): Map[String, (StructField, Int)] = {
Review Comment:
```suggestion
def getCachedSchemaPosMap(schema: StructType): Map[String, (StructField, Int)] = {
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r915156893
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java:
##########
@@ -160,6 +162,7 @@ protected AbstractHoodieLogRecordReader(FileSystem fs, String basePath, List<Str
HoodieTableConfig tableConfig = this.hoodieTableMetaClient.getTableConfig();
this.payloadClassFQN = tableConfig.getPayloadClass();
this.preCombineField = tableConfig.getPreCombineField();
+ this.mergeClassFQN = tableConfig.getMergeClass();
this.totalLogFiles.addAndGet(logFilePaths.size());
Review Comment:
Fully-qualified name. It's a pretty standard acronym
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1170776695
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r910569129
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
Thank you for your suggestion. I create a jira to track this. https://issues.apache.org/jira/browse/HUDI-4347
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169393380
Can we update PR title and description based on the new HoodieMerge design
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168799859
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
* 7e0eea449656a8c38897778f8b39e4400e36d11f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1170894558
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"triggerType" : "PUSH"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "1170776695",
"triggerType" : "MANUAL"
}, {
"hash" : "ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9647",
"triggerID" : "ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9647)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161396704
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411)
* ef9f638b283a9fd8ace9349f3ba461d229bc68ea Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r913362790
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java:
##########
@@ -95,6 +99,7 @@ protected HoodieMergedLogRecordScanner(FileSystem fs, String basePath, List<Stri
this.records = new ExternalSpillableMap<>(maxMemorySizeInBytes, spillableMapBasePath, new DefaultSizeEstimator(),
new HoodieRecordSizeEstimator(readerSchema), diskMapType, isBitCaskDiskMapCompressionEnabled);
this.maxMemorySizeInBytes = maxMemorySizeInBytes;
+ this.merge = HoodieRecordUtils.loadMerge(getMergeClassFQN());
Review Comment:
Fixed in step3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914355454
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), picked, newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.ofNullable(((HoodieAvroIndexedRecord) older).getData());
Review Comment:
Can we avoid the instance of here? `older instanceof HoodieAvroIndexedRecord`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914081837
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
@wulei0302 i think we need to make sure that we wrap up RFC-46 with the following artifacts on hands:
- New APIs (forward-looking, one unified merging API)
- Legacy APIs (backward-compatible, with `preCombine` and `combineAndGetUpdateValue`, necessary to facilitate the migration onto the new API)
That way, we can encourage folks to migrate from existing model where Legacy API will be providing compatibility out-of-the box, onto a new API which we can plan to declare a standard and deprecate a legacy one in 0.13
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r915644240
##########
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/testutils/HoodieWriteableTestTable.java:
##########
@@ -44,13 +50,6 @@
import org.apache.hudi.io.storage.HoodieOrcConfig;
import org.apache.hudi.io.storage.HoodieParquetConfig;
import org.apache.hudi.metadata.HoodieTableMetadataWriter;
-
-import org.apache.avro.Schema;
-import org.apache.avro.generic.GenericRecord;
-import org.apache.avro.generic.IndexedRecord;
Review Comment:
ok we will revert in step3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r916421620
##########
hudi-common/src/main/java/org/apache/hudi/common/util/HoodieRecordUtils.java:
##########
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.model.HoodieRecordPayload;
+import org.apache.hudi.exception.HoodieException;
+
+import java.lang.reflect.InvocationTargetException;
+import java.util.HashMap;
+import java.util.Map;
+
+/**
+ * A utility class for HoodieRecord.
+ */
+public class HoodieRecordUtils {
+
+ private static final Map<String, Object> INSTANCE_CACHE = new HashMap<>();
+
+ /**
+ * Instantiate a given class with a record merge.
+ */
+ public static HoodieMerge loadMerge(String mergeClass) {
+ try {
+ HoodieMerge merge = (HoodieMerge) INSTANCE_CACHE.get(mergeClass);
Review Comment:
we think `ReflectionUtil` is a generic class reflection tool. so, we move `loadMerge` and `loadPayload` methods to the `HoodieRecord``s util.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917594225
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadInputFormat.java:
##########
@@ -649,7 +656,8 @@ static class MergeIterator implements RecordIterator {
int[] requiredPos,
boolean emitDelete,
int operationPos,
- ParquetColumnarRowSplitReader reader) { // the reader should be with full schema
+ ParquetColumnarRowSplitReader reader, // the reader should be with full schema
+ String mergeClass) {
this.tableSchema = tableSchema;
Review Comment:
will adjust in step3, ths
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific record type
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909290558
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java:
##########
@@ -95,6 +99,7 @@ protected HoodieMergedLogRecordScanner(FileSystem fs, String basePath, List<Stri
this.records = new ExternalSpillableMap<>(maxMemorySizeInBytes, spillableMapBasePath, new DefaultSizeEstimator(),
new HoodieRecordSizeEstimator(readerSchema), diskMapType, isBitCaskDiskMapCompressionEnabled);
this.maxMemorySizeInBytes = maxMemorySizeInBytes;
+ this.hoodieMerge = HoodieRecordUtils.loadHoodieMerge(getMergeClassFQN());
Review Comment:
In Step3, the reader/writer will choose the corresponding record type if the user does not specify it directly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168788552
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168375831
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r903804383
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.combine.engine.class")
+ .defaultValue(HoodieAvroRecordCombiningEngine.class.getName())
Review Comment:
https://issues.apache.org/jira/browse/HUDI-4301
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r907016696
##########
hudi-common/src/main/java/org/apache/hudi/common/util/ReflectionUtils.java:
##########
@@ -81,6 +83,27 @@ public static <T extends HoodieRecordPayload> T loadPayload(String recordPayload
}
}
+ /**
+ * Instantiate a given class with a record merge.
+ */
+ public static HoodieMerge loadHoodieMerge(String mergeClass) {
Review Comment:
It make sense, i moved them to a HoodieRecordUtils(a new class)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904502478
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), ((HoodieMetadataPayload) picked), newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.of(((HoodieAvroIndexedRecord) older).getData());
Review Comment:
`getData() ` does not return null
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904499095
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), ((HoodieMetadataPayload) picked), newer.getOperation());
Review Comment:
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904499018
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieWriteHelper.java:
##########
@@ -58,10 +58,8 @@ public HoodieData<HoodieRecord<T>> deduplicateRecords(
return Pair.of(key, record);
}).reduceByKey((rec1, rec2) -> {
@SuppressWarnings("unchecked")
- HoodieRecord reducedRec = rec2.preCombine(rec1);
- HoodieKey reducedKey = rec1.getData().equals(reducedRec) ? rec1.getKey() : rec2.getKey();
-
- return (HoodieRecord<T>) reducedRec.newInstance(reducedKey);
+ HoodieRecord<T> reducedRecord = hoodieMerge.preCombine(rec1, rec2);
+ return reducedRecord.newInstance();
Review Comment:
Sorry, now should directly return to reducedRecord
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141275389
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141624263
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r891876288
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -123,6 +124,12 @@ public class HoodieWriteConfig extends HoodieConfig {
.withDocumentation("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting. "
+ "This will render any value set for PRECOMBINE_FIELD_OPT_VAL in-effective");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
Review Comment:
Can we make it such that we fallback to Avro based merging (and thus support existing payloads but with a potential performance penalty) - if a engine optimized implementation does not exist. ? e.g merging using Spark's row objects
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##########
@@ -234,6 +235,12 @@ public class HoodieCompactionConfig extends HoodieConfig {
+ "the record payload class to merge records in the log against each other, merge again with the base file and "
+ "produce the final record to be written after compaction.");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.combine.engine.class")
+ .defaultValue(HoodieAvroRecordCombiningEngine.class.getName())
+ .withDocumentation("Combine engine class to use for performing compactions, i.e merge delta logs with current base file and then "
Review Comment:
This needs to be made clearer IMO. Can we make the doc more about what a "combine engine" is, rather than explaining what compaction does
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecordCombiningEngine.java:
##########
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+public interface HoodieRecordCombiningEngine extends Serializable {
Review Comment:
Can we call this `HoodieMerge` instead ? IIUC this is the new API that replaces payload? then I would love some higher level discussions on the RFC first.
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.combine.engine.class")
+ .defaultValue(HoodieAvroRecordCombiningEngine.class.getName())
Review Comment:
so the same table be read by Spark or Hive for e.g I would love for such queries to be able to read and merge using the engine' POJO (Spark -> Row, Hive -> ArrayWritable), if the user chooses to write such a "combining engine" implementation. My thought here is that we should be able to discover whether such ability exists for class here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157224637
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157145666
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9fc23fae5e466daa0df3a421483c6b79d29a9f90 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316)
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1156448306
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9fc23fae5e466daa0df3a421483c6b79d29a9f90 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157265400
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161062806
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1156334674
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275)
* 9fc23fae5e466daa0df3a421483c6b79d29a9f90 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168738784
> @wulei0302 seems like CI caught some bug
>
> ```
> 2022-06-27T15:52:42.0821073Z [ERROR] testSchemaEvolutionForTableType{String}[1] Time elapsed: 14.556 s <<< ERROR!
> 2022-06-27T15:52:42.0821677Z org.apache.spark.sql.AnalysisException:
> 2022-06-27T15:52:42.0822277Z Intersect can only be performed on tables with the same number of columns, but the first table has 4 columns and the second table has 3 columns;;
> 2022-06-27T15:52:42.0823142Z 'Intersect false
> 2022-06-27T15:52:42.0823828Z :- LogicalRDD [_row_key#3974, partition#3975, ts#3976L, new_field#3977], false
> 2022-06-27T15:52:42.0824517Z +- Project [_row_key#3987, partition#3988, ts#3989L]
> 2022-06-27T15:52:42.0825448Z +- Project [_hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
> 2022-06-27T15:52:42.0826519Z +- Project [_hoodie_partition_path#3985, _hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
> 2022-06-27T15:52:42.0827447Z +- Project [_hoodie_record_key#3984, _hoodie_partition_path#3985, _hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
> 2022-06-27T15:52:42.0828459Z +- Project [_hoodie_commit_seqno#3983, _hoodie_record_key#3984, _hoodie_partition_path#3985, _hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
> 2022-06-27T15:52:42.0829600Z +- Relation[_hoodie_commit_time#3982,_hoodie_commit_seqno#3983,_hoodie_record_key#3984,_hoodie_partition_path#3985,_hoodie_file_name#3986,_row_key#3987,partition#3988,ts#3989L] hoodie-parquet
> ```
hey, shiyan, CI may fail because of this [HUDI-4302](https://issues.apache.org/jira/browse/HUDI-4302)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169021053
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
* 7e0eea449656a8c38897778f8b39e4400e36d11f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169082192
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168510781
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909193074
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
Thank you for your suggestion. It's very constructive. let`s mull this over more
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914352001
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +106,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ this.merge = HoodieRecordUtils.loadMerge(config.getMergeClass());
Review Comment:
Merge is a verb, I would suggest `HoodiePayloadMerger` for better readability.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914361984
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadTableState.java:
##########
@@ -82,6 +85,10 @@ public int getOperationPos() {
return operationPos;
}
+ public String getMergeClass() {
+ return mergeClass;
+ }
Review Comment:
No need to pass the string in this POJO, IMO.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r916432483
##########
hudi-common/src/main/java/org/apache/hudi/common/util/HoodieRecordUtils.java:
##########
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.model.HoodieRecordPayload;
+import org.apache.hudi.exception.HoodieException;
+
+import java.lang.reflect.InvocationTargetException;
+import java.util.HashMap;
+import java.util.Map;
+
+/**
+ * A utility class for HoodieRecord.
+ */
+public class HoodieRecordUtils {
+
+ private static final Map<String, Object> INSTANCE_CACHE = new HashMap<>();
+
+ /**
+ * Instantiate a given class with a record merge.
+ */
+ public static HoodieMerge loadMerge(String mergeClass) {
+ try {
+ HoodieMerge merge = (HoodieMerge) INSTANCE_CACHE.get(mergeClass);
Review Comment:
Don't think there is any necessity to do so now. The cache in `ReflectionUtil` should be reused.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154257502
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 25591a75e59756ae4112add59da0ef5063275804 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157404704
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 88bfb7612b10d46fd752c1caed2572ba72f5d773 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r901564144
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
Review Comment:
Maybe not. I am consistent with the `PAYLOAD_CLASS_NAME` configuration.
That is, `HoodieTableConfig`, `HoodieWriteConfig` and `HoodieCompactionConfig` all set similar parameters
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1160623275
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161152534
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401)
* 42c66b7aed8242d90934927f15411719f431edcb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410)
* 2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161142826
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401)
* 42c66b7aed8242d90934927f15411719f431edcb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410)
* 2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1130184417
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0b30db620e174195a03d499a36aa7a22b2c77c54 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1130285737
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7af9bab093e7dffc60aece12ea9d0ed819ad90e5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141945236
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
* 932911e7c61e35795e0a7d1076eabc4787df4972 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141315661
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1164095317
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 98a75b36c814c85acd058a636830d627357beee1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141279026
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141200416
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141606132
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154151252
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 932911e7c61e35795e0a7d1076eabc4787df4972 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014)
* 25591a75e59756ae4112add59da0ef5063275804 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161386141
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r903800675
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +105,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ hoodieMerge = ReflectionUtils.loadHoodieMerge(config.getMergeClass());
Review Comment:
wulei has [fix it](https://github.com/apache/hudi/pull/5627/commits/073ca5cf638176264ef5a09a4ea083be6780d2b7). We hold HoodieMerge instance and only call reflection once.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904502220
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), ((HoodieMetadataPayload) picked), newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.of(((HoodieAvroIndexedRecord) older).getData());
+ } else {
+ if (null == props) {
+ previousRecordAvroPayload = ((HoodieRecordPayload)older.getData()).getInsertValue(schema);
Review Comment:
Nice advice
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904523462
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1164240968
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 98a75b36c814c85acd058a636830d627357beee1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465)
* 247df2328bfdc55400c16aca7e3d031a2217049e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157297424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323)
* 88bfb7612b10d46fd752c1caed2572ba72f5d773 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167226623
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168141124
>
It passes in my local env, I rerun the CI to try
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168142429
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168226795
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168371049
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r910613045
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
Including the jiar mentioned by @wzx140 , We added two jiras to track the content to be improved:
1. [Detect HoodieMerge type with engine type automatically instead of the default avro-based one ](https://issues.apache.org/jira/browse/HUDI-4301)
2. [Unify one method in HoodieMerge to replace "preCombine" and "combineAndGetUpdateValue" ](https://issues.apache.org/jira/browse/HUDI-4347)
About 1, we will complete it in Step3;
About 2, it may be completed after rfc46;
So as not to block the performance test and subsequent plan of rfc46，So that we can merge Step2 and continue to adjust in Step3.
@xushiyan @vinothchandar @alexeykudinkin What do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r901231805
##########
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala:
##########
@@ -181,6 +181,8 @@ private[sql] class AvroDeserializer(rootAvroType: Schema,
case b: ByteBuffer =>
val bytes = new Array[Byte](b.remaining)
b.get(bytes)
+ // Do not forget to reset the position
+ b.rewind()
Review Comment:
https://github.com/apache/hudi/pull/5907
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r913168791
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable<?> orderingVal;
Review Comment:
we can work on renaming in a separate PR once we decided. We should standardize names: precombineField (SQL), orderingVal (pojo), --source-ordering-field (deltastreamer), and eventTimeField (default record payload)
@wulei0302 do you want to take up this improvement/refactoring work? could you file a ticket for tracking pls?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r913360005
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable<?> orderingVal;
Review Comment:
@xushiyan I'm happy to do it, JIRA: [HUDI-4358]( https://issues.apache.org/jira/browse/HUDI-4358)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914360633
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -283,6 +284,13 @@ private FlinkOptions() {
.withDescription("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting.\n"
+ "This will render any value set for the option in-effective");
+ public static final ConfigOption<String> MERGE_CLASS_NAME = ConfigOptions
+ .key("write.merge.class")
+ .stringType()
Review Comment:
Should name it `merge.class` if the class is used for reading path, say the MOR table logs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r916476015
##########
hudi-common/src/main/java/org/apache/hudi/common/util/HoodieRecordUtils.java:
##########
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.model.HoodieRecordPayload;
+import org.apache.hudi.exception.HoodieException;
+
+import java.lang.reflect.InvocationTargetException;
+import java.util.HashMap;
+import java.util.Map;
+
+/**
+ * A utility class for HoodieRecord.
+ */
+public class HoodieRecordUtils {
+
+ private static final Map<String, Object> INSTANCE_CACHE = new HashMap<>();
+
+ /**
+ * Instantiate a given class with a record merge.
+ */
+ public static HoodieMerge loadMerge(String mergeClass) {
+ try {
+ HoodieMerge merge = (HoodieMerge) INSTANCE_CACHE.get(mergeClass);
Review Comment:
IMO, `HoodieRecordUtils` was reused `ReflectionUtil` in implement, the `HoodieRecordUtils``s cache is different from `ReflectionUtil``s cache (instance & class)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917638304
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), picked, newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.ofNullable(((HoodieAvroIndexedRecord) older).getData());
Review Comment:
ok. I will replace them with single record#toIndexedRecord call in step3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917630263
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +106,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ this.merge = HoodieRecordUtils.loadMerge(config.getMergeClass());
Review Comment:
@xushiyan @vinothchandar @alexeykudinkin @danny0405 I think there are differences on the name of Hoodie merge API. I created a JIRA [HUDI-4380](https://issues.apache.org/jira/browse/HUDI-4380) , and we can make it clear.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917612175
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), picked, newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.ofNullable(((HoodieAvroIndexedRecord) older).getData());
Review Comment:
@wzx140 Help look at this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904502980
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ HoodieRecordPayload picked = unsafeCast(((HoodieAvroRecord) newer).getData().preCombine(((HoodieAvroRecord) older).getData()));
+ if (picked instanceof HoodieMetadataPayload) {
+ // NOTE: HoodieMetadataPayload return a new payload
+ return new HoodieAvroRecord(newer.getKey(), ((HoodieMetadataPayload) picked), newer.getOperation());
+ }
+ return picked.equals(((HoodieAvroRecord) newer).getData()) ? newer : older;
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ Option<IndexedRecord> previousRecordAvroPayload;
+ if (older instanceof HoodieAvroIndexedRecord) {
+ previousRecordAvroPayload = Option.of(((HoodieAvroIndexedRecord) older).getData());
Review Comment:
`getData()` does not return null for now, but i aggre with `ofNullable() `.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904504762
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -169,15 +180,21 @@ public HoodieOperation getOperation() {
return operation;
}
+ public Comparable getOrderingValue() {
+ if (null == orderingVal) {
+ // default natural order is 0
+ return 0;
+ }
+ return orderingVal;
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168146636
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 5c34cb62dac887b1adb4ea9ff8c3873f3680818b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r906919277
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable orderingVal;
+
public HoodieRecord(HoodieKey key, T data) {
- this(key, data, null);
+ this(key, data, null, null);
}
- public HoodieRecord(HoodieKey key, T data, HoodieOperation operation) {
+ public HoodieRecord(HoodieKey key, T data, Comparable orderingVal) {
+ this(key, data, null, orderingVal);
+ }
+
+ public HoodieRecord(HoodieKey key, T data, HoodieOperation operation, Comparable orderingVal) {
Review Comment:
use `Comparable<?>` to avoid ide warning?
##########
hudi-common/src/main/java/org/apache/hudi/common/util/ReflectionUtils.java:
##########
@@ -81,6 +83,27 @@ public static <T extends HoodieRecordPayload> T loadPayload(String recordPayload
}
}
+ /**
+ * Instantiate a given class with a record merge.
+ */
+ public static HoodieMerge loadHoodieMerge(String mergeClass) {
Review Comment:
we should actually keep this and `loadPayload` method out of `ReflectionUtils`, which is only meant for generic reflection helpers. suggest move them to a HoodieRecord specific util class.
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -169,15 +179,17 @@ public HoodieOperation getOperation() {
return operation;
}
+ public Comparable getOrderingValue() {
Review Comment:
ditto
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java:
##########
@@ -78,6 +79,8 @@ public class HoodieMergedLogRecordScanner extends AbstractHoodieLogRecordReader
// Stores the total time taken to perform reading and merging of log blocks
private long totalTimeTakenToReadAndMergeBlocks;
+ private HoodieMerge hoodieMerge;
Review Comment:
can this be final?
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala:
##########
@@ -303,7 +305,12 @@ class HoodieMergeOnReadRDD(@transient sc: SparkContext,
private def merge(curAvroRecord: GenericRecord, newRecord: HoodieRecord[_ <: HoodieRecordPayload[_]]): Option[IndexedRecord] = {
// NOTE: We have to pass in Avro Schema used to read from Delta Log file since we invoke combining API
// on the record from the Delta Log
- toScalaOption(newRecord.getData.combineAndGetUpdateValue(curAvroRecord, logFileReaderAvroSchema, payloadProps))
+ if (hoodieMerge.combineAndGetUpdateValue(new HoodieAvroIndexedRecord(curAvroRecord), newRecord, logFileReaderAvroSchema, payloadProps).isPresent) {
+ toScalaOption(hoodieMerge.combineAndGetUpdateValue(new HoodieAvroIndexedRecord(curAvroRecord), newRecord, logFileReaderAvroSchema, payloadProps)
Review Comment:
can we avoid doing it `combineAndGetUpdateValue()` twice here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168997615
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1166788937
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 9a490b40fac476c1dd9652b9e5b87b0599ca8ba5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167049962
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 9a490b40fac476c1dd9652b9e5b87b0599ca8ba5 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573)
* b61c6fff92835625283c20136e8ee5e6fd9a8e49 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157265700
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r895557171
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecordCombiningEngine.java:
##########
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+public interface HoodieRecordCombiningEngine extends Serializable {
Review Comment:
LGTM, we will update RFC later
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154682429
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157143330
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909199576
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java:
##########
@@ -791,6 +792,11 @@ public PropertyBuilder setPayloadClassName(String payloadClassName) {
return this;
}
+ public PropertyBuilder setMergeClassName(String mergeClassName) {
Review Comment:
The migration plan will be formulated after the completion of Step3 and the performance test;
Step3 defines some merge classes corresponding to payloads.
We will try to migrate our custom payloads first. cc @wzx140
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909205351
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:
##########
@@ -301,6 +301,12 @@ object DataSourceWriteOptions {
*/
val PAYLOAD_CLASS_NAME = HoodieWriteConfig.WRITE_PAYLOAD_CLASS_NAME
+ /**
+ * HoodieMerge will replace the payload to process the merge of data
+ * and provide the same capabilities as the payload
+ */
+ val MERGE_CLASS_NAME = HoodieWriteConfig.MERGE_CLASS_NAME
Review Comment:
We have in Step3. like HoodieRecordType
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169503382
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909206760
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java:
##########
@@ -95,6 +99,7 @@ protected HoodieMergedLogRecordScanner(FileSystem fs, String basePath, List<Stri
this.records = new ExternalSpillableMap<>(maxMemorySizeInBytes, spillableMapBasePath, new DefaultSizeEstimator(),
new HoodieRecordSizeEstimator(readerSchema), diskMapType, isBitCaskDiskMapCompressionEnabled);
this.maxMemorySizeInBytes = maxMemorySizeInBytes;
+ this.hoodieMerge = HoodieRecordUtils.loadHoodieMerge(getMergeClassFQN());
Review Comment:
Yeah，some config in the table properties will choose the record type and merge class.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161064628
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161207153
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r910614096
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
Review Comment:
[HoodieMerge](url) is OK just for me. cc @xushiyan @vinothchandar
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1133883627
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1133910291
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0167efc3be6b046a7dae9e50b869305d8eb246a6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141622418
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1133887216
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7af9bab093e7dffc60aece12ea9d0ed819ad90e5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751)
* 0167efc3be6b046a7dae9e50b869305d8eb246a6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1130224046
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0b30db620e174195a03d499a36aa7a22b2c77c54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1140898675
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0a85e7128839206b82f16b74cac84855ab9774af Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r894222801
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecordCombiningEngine.java:
##########
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+public interface HoodieRecordCombiningEngine extends Serializable {
Review Comment:
+1 on `HoodieMerge` we can update RFC if needed @wzx140
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r915156507
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -169,15 +179,17 @@ public HoodieOperation getOperation() {
return operation;
}
+ public Comparable<?> getOrderingValue() {
+ return orderingVal;
+ }
+
public T getData() {
if (data == null) {
- throw new IllegalStateException("Payload already deflated for record.");
+ throw new IllegalStateException("HoodieRecord already deflated for record.");
}
Review Comment:
I think this was accidental find-replace kind of change
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r913165917
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable<?> orderingVal;
Review Comment:
it's debatable. The `eventTime` here is more of a concept in the context of stream processing. but the name can imply it's always timestamp. maybe `eventOrder` works better.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917630263
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +106,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ this.merge = HoodieRecordUtils.loadMerge(config.getMergeClass());
Review Comment:
@xushiyan @vinothchandar @alexeykudinkin @danny0405 I think there are differences on the name of Hoodie merge API. I created a JIRA [HUDI-4380](https://issues.apache.org/jira/browse/HUDI-4380) , and we can make it clear. cc @wzx140 @minihippo
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1160571432
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 88bfb7612b10d46fd752c1caed2572ba72f5d773 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329)
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167252713
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* b61c6fff92835625283c20136e8ee5e6fd9a8e49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578)
* 5c34cb62dac887b1adb4ea9ff8c3873f3680818b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168151580
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 5c34cb62dac887b1adb4ea9ff8c3873f3680818b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587)
* 427cbc6076f215419616df39deb4dceb54c1b6bc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169025468
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
* 7e0eea449656a8c38897778f8b39e4400e36d11f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616)
* a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909084524
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java:
##########
@@ -95,6 +99,7 @@ protected HoodieMergedLogRecordScanner(FileSystem fs, String basePath, List<Stri
this.records = new ExternalSpillableMap<>(maxMemorySizeInBytes, spillableMapBasePath, new DefaultSizeEstimator(),
new HoodieRecordSizeEstimator(readerSchema), diskMapType, isBitCaskDiskMapCompressionEnabled);
this.maxMemorySizeInBytes = maxMemorySizeInBytes;
+ this.hoodieMerge = HoodieRecordUtils.loadHoodieMerge(getMergeClassFQN());
Review Comment:
when writing from Spark we would use `HoodieSparkRecord` and the merge class would be `HoodieSparkMerge` in the table properties? and if we now read with Hive, it falls back to avro somehow?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 closed pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 closed pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
URL: https://github.com/apache/hudi/pull/5627
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific record type
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909211336
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSparkRecord.java:
##########
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi;
+
+import org.apache.hudi.common.config.TypedProperties;
+import org.apache.hudi.common.model.HoodieKey;
+import org.apache.hudi.common.model.HoodieOperation;
+import org.apache.hudi.common.model.HoodieRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.keygen.BaseKeyGenerator;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.spark.sql.catalyst.InternalRow;
+import org.apache.spark.sql.types.StructType;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+
+import static org.apache.spark.sql.types.DataTypes.BooleanType;
+
+/**
+ * Spark Engine-specific Implementations of `HoodieRecord`.
+ */
+public class HoodieSparkRecord extends HoodieRecord<InternalRow> {
Review Comment:
`TestHoodieInternalRowUtils` and `TestStructTypeSchemaEvolutionUtils` have been basically covered
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168257656
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 870167d142cad0c0503176c8dc1b0910a996a096 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r910605015
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
Including the JIAR mentioned by @wzx140 , We added two JIRA to track the content to be improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154147772
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 932911e7c61e35795e0a7d1076eabc4787df4972 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014)
* 25591a75e59756ae4112add59da0ef5063275804 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154120371
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1162908556
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ef9f638b283a9fd8ace9349f3ba461d229bc68ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423)
* 073ca5cf638176264ef5a09a4ea083be6780d2b7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1166933585
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 9a490b40fac476c1dd9652b9e5b87b0599ca8ba5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573)
* b61c6fff92835625283c20136e8ee5e6fd9a8e49 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1166987953
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 9a490b40fac476c1dd9652b9e5b87b0599ca8ba5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573)
* b61c6fff92835625283c20136e8ee5e6fd9a8e49 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1164041718
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 073ca5cf638176264ef5a09a4ea083be6780d2b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 98a75b36c814c85acd058a636830d627357beee1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904663338
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
Review Comment:
I do not find the default value in the structType. Maybe we can leave it null
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161069800
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401)
* 42c66b7aed8242d90934927f15411719f431edcb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904505296
##########
hudi-common/src/main/java/org/apache/hudi/common/util/ReflectionUtils.java:
##########
@@ -61,6 +63,10 @@ public static Class<?> getClass(String clazzName) {
return CLAZZ_CACHE.get(clazzName);
}
+ private static Object getInstance(String clazzName) {
+ return INSTANCE_CACHE.get(clazzName);
+ }
Review Comment:
method removed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1164045651
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 073ca5cf638176264ef5a09a4ea083be6780d2b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 98a75b36c814c85acd058a636830d627357beee1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161074785
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401)
* 42c66b7aed8242d90934927f15411719f431edcb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r901565754
##########
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/table/action/commit/FlinkWriteHelper.java:
##########
@@ -87,20 +88,21 @@ protected List<HoodieRecord<T>> tag(List<HoodieRecord<T>> dedupedRecords, Hoodie
@Override
public List<HoodieRecord<T>> deduplicateRecords(
- List<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism) {
+ List<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism, HoodieMerge hoodieMerge) {
// If index used is global, then records are expected to differ in their partitionPath
Map<Object, List<HoodieRecord<T>>> keyedRecords = records.stream()
.collect(Collectors.groupingBy(record -> record.getKey().getRecordKey()));
return keyedRecords.values().stream().map(x -> x.stream().reduce((rec1, rec2) -> {
- @SuppressWarnings("unchecked") final HoodieRecord reducedRec = rec2.preCombine(rec1);
+ @SuppressWarnings("unchecked")
+ final HoodieRecord reducedData = hoodieMerge.preCombine(rec1, rec2);
// we cannot allow the user to change the key or partitionPath, since that will affect
// everything
// so pick it from one of the records.
- boolean choosePrev = rec1 == reducedRec;
+ boolean choosePrev = rec1 == reducedData;
Review Comment:
yeah you are right.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1160556060
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 88bfb7612b10d46fd752c1caed2572ba72f5d773 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r902396136
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -123,6 +124,12 @@ public class HoodieWriteConfig extends HoodieConfig {
.withDocumentation("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting. "
+ "This will render any value set for PRECOMBINE_FIELD_OPT_VAL in-effective");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
Review Comment:
Yeah, we provide a BWC bridge called 'HoodieAvroRecordMerge', that will be using user-defined subclass of `HoodieRecordPayload` to combine the records.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1130278520
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0b30db620e174195a03d499a36aa7a22b2c77c54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749)
* 7af9bab093e7dffc60aece12ea9d0ed819ad90e5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168579546
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167184825
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* b61c6fff92835625283c20136e8ee5e6fd9a8e49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific record type
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169546715
> Can we update PR title and description based on the new HoodieMerge design
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909074357
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -123,6 +124,12 @@ public class HoodieWriteConfig extends HoodieConfig {
.withDocumentation("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting. "
+ "This will render any value set for PRECOMBINE_FIELD_OPT_VAL in-effective");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
Review Comment:
Ack. left some comment on the migration path on the new review. resolving this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909195782
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +106,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ this.hoodieMerge = HoodieRecordUtils.loadHoodieMerge(config.getMergeClass());
Review Comment:
Let's rename: merge？ So consistent with other `HoodieMerge` variable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909196760
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable<?> orderingVal;
Review Comment:
Maybe `orderingVal` is more accurate, because not only the time field sorting, but also other fields will be defined as sorting fields，such as `version`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1140835985
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d7ed9f43b3c10763e02169cd4b48fcde17afa8b2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840)
* 0a85e7128839206b82f16b74cac84855ab9774af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r913173208
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java:
##########
@@ -95,6 +99,7 @@ protected HoodieMergedLogRecordScanner(FileSystem fs, String basePath, List<Stri
this.records = new ExternalSpillableMap<>(maxMemorySizeInBytes, spillableMapBasePath, new DefaultSizeEstimator(),
new HoodieRecordSizeEstimator(readerSchema), diskMapType, isBitCaskDiskMapCompressionEnabled);
this.maxMemorySizeInBytes = maxMemorySizeInBytes;
+ this.merge = HoodieRecordUtils.loadMerge(getMergeClassFQN());
Review Comment:
throughout the codebase i've seen `FQCN`, and `className` being used. Here is another variety (FQN). in step 3 you may change this to `className` which appears most, for alignment. @wulei0302
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914359119
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.merge.class")
+ .defaultValue(HoodieAvroRecordMerge.class.getName())
+ .withDocumentation("Merge class provide stateless component interface for merging records, and support various HoodieRecord "
Review Comment:
I'm -1 for a separate merge clazz that is only for merging, can we elaborate a little more for just reusing the merge clazz for write path ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914352505
##########
hudi-client/hudi-client-common/src/test/java/org/apache/hudi/testutils/HoodieWriteableTestTable.java:
##########
@@ -44,13 +50,6 @@
import org.apache.hudi.io.storage.HoodieOrcConfig;
import org.apache.hudi.io.storage.HoodieParquetConfig;
import org.apache.hudi.metadata.HoodieTableMetadataWriter;
-
-import org.apache.avro.Schema;
-import org.apache.avro.generic.GenericRecord;
-import org.apache.avro.generic.IndexedRecord;
Review Comment:
unnecessary change, please revert it back ~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917604689
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.merge.class")
+ .defaultValue(HoodieAvroRecordMerge.class.getName())
+ .withDocumentation("Merge class provide stateless component interface for merging records, and support various HoodieRecord "
Review Comment:
I'm also confused about config such as write config and compact config. At present, I write it after imitating payload class. Wait for unified reconfiguration later?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1170796869
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"triggerType" : "PUSH"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "1170776695",
"triggerType" : "MANUAL"
}, {
"hash" : "ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9647",
"triggerID" : "ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617)
* ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9647)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1170793344
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"triggerType" : "PUSH"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "1170776695",
"triggerType" : "MANUAL"
}, {
"hash" : "ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617)
* ebd49eeb0cafb7ff6ee218766595bf8a43a19ed6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r916424745
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -283,6 +284,13 @@ private FlinkOptions() {
.withDescription("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting.\n"
+ "This will render any value set for the option in-effective");
+ public static final ConfigOption<String> MERGE_CLASS_NAME = ConfigOptions
+ .key("write.merge.class")
+ .stringType()
Review Comment:
i see, i will change it in step 3. nice advice
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154654525
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1140798237
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d7ed9f43b3c10763e02169cd4b48fcde17afa8b2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840)
* 0a85e7128839206b82f16b74cac84855ab9774af UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1133886468
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 7af9bab093e7dffc60aece12ea9d0ed819ad90e5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1134084482
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* d7ed9f43b3c10763e02169cd4b48fcde17afa8b2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1134147164
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* d7ed9f43b3c10763e02169cd4b48fcde17afa8b2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1133888070
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7af9bab093e7dffc60aece12ea9d0ed819ad90e5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751)
* 0167efc3be6b046a7dae9e50b869305d8eb246a6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r876967106
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##########
@@ -234,6 +235,12 @@ public class HoodieCompactionConfig extends HoodieConfig {
+ "the record payload class to merge records in the log against each other, merge again with the base file and "
+ "produce the final record to be written after compaction.");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
+ .key("hoodie.combine.engine.class")
Review Comment:
`hoodie.compaction.combine.engine.class`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1164342184
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 247df2328bfdc55400c16aca7e3d031a2217049e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r901564389
##########
hudi-client/hudi-java-client/src/main/java/org/apache/hudi/table/action/commit/JavaWriteHelper.java:
##########
@@ -65,11 +67,12 @@ public List<HoodieRecord<T>> deduplicateRecords(
return keyedRecords.values().stream().map(x -> x.stream().map(Pair::getRight).reduce((rec1, rec2) -> {
@SuppressWarnings("unchecked")
- HoodieRecord reducedRec = rec2.preCombine(rec1);
+ HoodieRecord reducedRecord = hoodieMerge.preCombine(rec1,rec2);
+
// we cannot allow the user to change the key or partitionPath, since that will affect
// everything
// so pick it from one of the records.
- return (HoodieRecord<T>) reducedRec.newInstance(rec1.getKey());
+ return (HoodieRecord<T>) new HoodieAvroRecord(reducedRecord);
Review Comment:
done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1163028576
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 073ca5cf638176264ef5a09a4ea083be6780d2b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904514756
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldElementType = oldSchema.asInstanceOf[ArrayType].elementType
+ val oldArray = oldRecord.asInstanceOf[ArrayData]
+ val newElementType = targetSchema.elementType
+ val newArray = new GenericArrayData(Array.fill(oldArray.numElements())(null).asInstanceOf[Array[Any]])
+ fieldNames.push("element")
+ oldArray.toSeq[Any](oldElementType).zipWithIndex.foreach { case (value, i) => newArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldElementType, newElementType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newArray
+ case targetSchema: MapType =>
+ if (!oldRecord.isInstanceOf[MapData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldValueType = oldSchema.asInstanceOf[MapType].valueType
+ val oldKeyType = oldSchema.asInstanceOf[MapType].keyType
+ val oldMap = oldRecord.asInstanceOf[MapData]
+ val newValueType = targetSchema.valueType
+ val newKeyArray = new GenericArrayData(Array.fill(oldMap.keyArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newValueArray = new GenericArrayData(Array.fill(oldMap.valueArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newMap = new ArrayBasedMapData(newKeyArray, newValueArray)
+ fieldNames.push("value")
+ oldMap.keyArray().toSeq[Any](oldKeyType).zipWithIndex.foreach { case (value, i) => newKeyArray.update(i, value) }
+ oldMap.valueArray().toSeq[Any](oldValueType).zipWithIndex.foreach { case (value, i) => newValueArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldValueType, newValueType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newMap
+ case _ => rewritePrimaryType(oldRecord, oldSchema, newSchema)
+ }
+ }
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecord(record, oldSchema, newSchema)
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteEvolutionRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteEvolutionRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecordWithNewSchema(record, oldSchema, newSchema, new util.HashMap[String, String]())
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ def getCacheSchema(schema: Schema): StructType = {
+ if (!schemaMap.contains(schema)) {
+ schemaMap.synchronized {
+ if (!schemaMap.contains(schema)) {
+ val structType = AvroConversionUtils.convertAvroSchemaToStructType(schema)
+ schemaMap.put(schema, structType)
+ }
+ }
+ }
+ schemaMap.get(schema)
+ }
+
+ private def getCacheProjection(from: StructType, to: StructType): Projection = {
+ val schemaPair = (from, to)
+ if (!projectionMap.contains(schemaPair)) {
+ projectionMap.synchronized {
+ if (!projectionMap.contains(schemaPair)) {
+ val projection = generateMutableProjection(from, to)
+ projectionMap.put(schemaPair, projection)
+ }
+ }
+ }
+ projectionMap.get(schemaPair)
+ }
+
+ def getCacheSchemaPosMap(schema: StructType): Map[String, (StructField, Int)] = {
+ if (!SchemaPosMap.contains(schema)) {
+ SchemaPosMap.synchronized {
+ if (!SchemaPosMap.contains(schema)) {
+ val fieldMap = schema.fields.zipWithIndex.map { case (field, i) => (field.name, (field, i)) }.toMap
+ SchemaPosMap.put(schema, fieldMap)
+ }
+ }
+ }
+ SchemaPosMap.get(schema)
+ }
+
+ private def rewritePrimaryType(oldValue: Any, oldSchema: DataType, newSchema: DataType): Any = {
+ if (oldSchema.equals(newSchema) || (oldSchema.isInstanceOf[DecimalType] && newSchema.isInstanceOf[DecimalType])) {
+ oldSchema match {
+ case NullType | BooleanType | IntegerType | LongType | FloatType | DoubleType | StringType | DateType | TimestampType | BinaryType =>
+ oldValue
+ case DecimalType() =>
+ Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ case _ =>
+ throw new HoodieException("Unknown schema type: " + newSchema)
+ }
+ } else {
+ rewritePrimaryTypeWithDiffSchemaType(oldValue, oldSchema, newSchema)
+ }
+ }
+
+ private def rewritePrimaryTypeWithDiffSchemaType(oldValue: Any, oldSchema: DataType, newSchema: DataType): Any = {
+ val value = newSchema match {
+ case NullType | BooleanType =>
+ case DateType if oldSchema.equals(StringType) =>
+ fromJavaDate(java.sql.Date.valueOf(oldValue.toString))
+ case LongType =>
+ oldSchema match {
+ case IntegerType => oldValue.asInstanceOf[Int].longValue()
+ case _ =>
+ }
+ case FloatType =>
+ oldSchema match {
+ case IntegerType => oldValue.asInstanceOf[Int].floatValue()
+ case LongType => oldValue.asInstanceOf[Long].floatValue()
+ case _ =>
+ }
+ case DoubleType =>
+ oldSchema match {
+ case IntegerType => oldValue.asInstanceOf[Int].doubleValue()
+ case LongType => oldValue.asInstanceOf[Long].doubleValue()
+ case FloatType => java.lang.Double.valueOf(oldValue.asInstanceOf[Float] + "")
Review Comment:
java float cannot convert to double directly, deal with float precision change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904511545
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wzx140 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wzx140 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904515630
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSparkRecordMerge.java:
##########
@@ -0,0 +1,48 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.model.HoodieRecord;
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.util.Properties;
+
+public class HoodieSparkRecordMerge implements HoodieMerge {
+
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
+ if (older.getData() == null) {
+ // use natural order for delete record
+ return older;
+ }
+ if (older.getOrderingValue().compareTo(newer.getOrderingValue()) > 0) {
+ return older;
+ } else {
+ return newer;
+ }
+ }
+
+ @Override
+ public Option<HoodieRecord> combineAndGetUpdateValue(HoodieRecord older, HoodieRecord newer, Schema schema, Properties props) throws IOException {
+ return Option.of(newer);
+ }
Review Comment:
Yes, it finished in step3.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r901565179
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieWriteHelper.java:
##########
@@ -49,19 +50,17 @@ protected HoodieData<HoodieRecord<T>> tag(HoodieData<HoodieRecord<T>> dedupedRec
@Override
public HoodieData<HoodieRecord<T>> deduplicateRecords(
- HoodieData<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism) {
+ HoodieData<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism, HoodieMerge hoodieMerge) {
boolean isIndexingGlobal = index.isGlobal();
return records.mapToPair(record -> {
HoodieKey hoodieKey = record.getKey();
- // If index used is global, then records are expected to differ in their partitionPath
+ // If index used is global,x then records are expected to differ in their partitionPath
Review Comment:
Sorry, it`s Typo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161596678
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ef9f638b283a9fd8ace9349f3ba461d229bc68ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1166824287
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 9a490b40fac476c1dd9652b9e5b87b0599ca8ba5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909204683
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala:
##########
@@ -303,7 +305,12 @@ class HoodieMergeOnReadRDD(@transient sc: SparkContext,
private def merge(curAvroRecord: GenericRecord, newRecord: HoodieRecord[_ <: HoodieRecordPayload[_]]): Option[IndexedRecord] = {
// NOTE: We have to pass in Avro Schema used to read from Delta Log file since we invoke combining API
// on the record from the Delta Log
- toScalaOption(newRecord.getData.combineAndGetUpdateValue(curAvroRecord, logFileReaderAvroSchema, payloadProps))
+ val combinedRecord = hoodieMerge.combineAndGetUpdateValue(new HoodieAvroIndexedRecord(curAvroRecord), newRecord, logFileReaderAvroSchema, payloadProps)
Review Comment:
Sure, it will be done in Step3.
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala:
##########
@@ -303,7 +305,12 @@ class HoodieMergeOnReadRDD(@transient sc: SparkContext,
private def merge(curAvroRecord: GenericRecord, newRecord: HoodieRecord[_ <: HoodieRecordPayload[_]]): Option[IndexedRecord] = {
// NOTE: We have to pass in Avro Schema used to read from Delta Log file since we invoke combining API
// on the record from the Delta Log
- toScalaOption(newRecord.getData.combineAndGetUpdateValue(curAvroRecord, logFileReaderAvroSchema, payloadProps))
+ val combinedRecord = hoodieMerge.combineAndGetUpdateValue(new HoodieAvroIndexedRecord(curAvroRecord), newRecord, logFileReaderAvroSchema, payloadProps)
Review Comment:
cc @wzx140
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1170790420
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"triggerType" : "PUSH"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1170776695",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167610974
@wulei0302 seems like CI caught some bug
```
2022-06-27T15:52:42.0821073Z [ERROR] testSchemaEvolutionForTableType{String}[1] Time elapsed: 14.556 s <<< ERROR!
2022-06-27T15:52:42.0821677Z org.apache.spark.sql.AnalysisException:
2022-06-27T15:52:42.0822277Z Intersect can only be performed on tables with the same number of columns, but the first table has 4 columns and the second table has 3 columns;;
2022-06-27T15:52:42.0823142Z 'Intersect false
2022-06-27T15:52:42.0823828Z :- LogicalRDD [_row_key#3974, partition#3975, ts#3976L, new_field#3977], false
2022-06-27T15:52:42.0824517Z +- Project [_row_key#3987, partition#3988, ts#3989L]
2022-06-27T15:52:42.0825448Z +- Project [_hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
2022-06-27T15:52:42.0826519Z +- Project [_hoodie_partition_path#3985, _hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
2022-06-27T15:52:42.0827447Z +- Project [_hoodie_record_key#3984, _hoodie_partition_path#3985, _hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
2022-06-27T15:52:42.0828459Z +- Project [_hoodie_commit_seqno#3983, _hoodie_record_key#3984, _hoodie_partition_path#3985, _hoodie_file_name#3986, _row_key#3987, partition#3988, ts#3989L]
2022-06-27T15:52:42.0829600Z +- Relation[_hoodie_commit_time#3982,_hoodie_commit_seqno#3983,_hoodie_record_key#3984,_hoodie_partition_path#3985,_hoodie_file_name#3986,_row_key#3987,partition#3988,ts#3989L] hoodie-parquet
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168551690
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909085146
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.combine.engine.class")
+ .defaultValue(HoodieAvroRecordCombiningEngine.class.getName())
Review Comment:
I updated the ticket. I feel `HoodieMerge` by itself should be designed as engine aware somehow
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168213718
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 427cbc6076f215419616df39deb4dceb54c1b6bc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168254547
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 870167d142cad0c0503176c8dc1b0910a996a096 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168380502
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168583798
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* a9e754fddfae3b86d0df81d6c03bd02d467e5228 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909195892
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
Review Comment:
ditto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909204223
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -123,6 +124,12 @@ public class HoodieWriteConfig extends HoodieConfig {
.withDocumentation("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting. "
+ "This will render any value set for PRECOMBINE_FIELD_OPT_VAL in-effective");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
Review Comment:
We are mainly consistent with payload, which is `hoodie.datasource.write.payload.class`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r913361785
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java:
##########
@@ -95,6 +99,7 @@ protected HoodieMergedLogRecordScanner(FileSystem fs, String basePath, List<Stri
this.records = new ExternalSpillableMap<>(maxMemorySizeInBytes, spillableMapBasePath, new DefaultSizeEstimator(),
new HoodieRecordSizeEstimator(readerSchema), diskMapType, isBitCaskDiskMapCompressionEnabled);
this.maxMemorySizeInBytes = maxMemorySizeInBytes;
+ this.merge = HoodieRecordUtils.loadMerge(getMergeClassFQN());
Review Comment:
I see. I'll change `FQN` to `className`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914360207
##########
hudi-common/src/main/java/org/apache/hudi/common/util/HoodieRecordUtils.java:
##########
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.model.HoodieRecordPayload;
+import org.apache.hudi.exception.HoodieException;
+
+import java.lang.reflect.InvocationTargetException;
+import java.util.HashMap;
+import java.util.Map;
+
+/**
+ * A utility class for HoodieRecord.
+ */
+public class HoodieRecordUtils {
+
+ private static final Map<String, Object> INSTANCE_CACHE = new HashMap<>();
+
+ /**
+ * Instantiate a given class with a record merge.
+ */
+ public static HoodieMerge loadMerge(String mergeClass) {
+ try {
+ HoodieMerge merge = (HoodieMerge) INSTANCE_CACHE.get(mergeClass);
Review Comment:
Why introducing another tool clazz for reflection ? We already have `ReflectionUtil`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914358079
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -169,15 +179,17 @@ public HoodieOperation getOperation() {
return operation;
}
+ public Comparable<?> getOrderingValue() {
+ return orderingVal;
+ }
+
public T getData() {
if (data == null) {
- throw new IllegalStateException("Payload already deflated for record.");
+ throw new IllegalStateException("HoodieRecord already deflated for record.");
}
Review Comment:
Why this change ? Please revert it back !!!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r894221653
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecordCombiningEngine.java:
##########
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+public interface HoodieRecordCombiningEngine extends Serializable {
Review Comment:
some javadoc here would be helpful
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1154143944
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 932911e7c61e35795e0a7d1076eabc4787df4972 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157167834
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9fc23fae5e466daa0df3a421483c6b79d29a9f90 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316)
* 39e3c420052f855de667c7f75c39bd6a7ee65bf2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161350999
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r903775726
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
Review Comment:
ok it's fine to stay consistent for now. the simplification can be done in later stage
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157143888
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9fc23fae5e466daa0df3a421483c6b79d29a9f90 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1157224265
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1160564398
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 88bfb7612b10d46fd752c1caed2572ba72f5d773 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329)
* 639cb4f0fe5e41029d461b3b7c41b507fda41de0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1161391541
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411)
* ef9f638b283a9fd8ace9349f3ba461d229bc68ea UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904506695
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadInputFormat.java:
##########
@@ -753,7 +761,9 @@ private Option<IndexedRecord> mergeRowWithLog(
String curKey) throws IOException {
final HoodieAvroRecord<?> record = (HoodieAvroRecord) scanner.getRecords().get(curKey);
GenericRecord historyAvroRecord = (GenericRecord) rowDataToAvroConverter.convert(tableSchema, curRow);
- return record.getData().combineAndGetUpdateValue(historyAvroRecord, tableSchema);
+ // TODO IndexedRecord to HoodieRecord
Review Comment:
At that time, `TODO` was because `HoodieFlinkRecord` was not implemented. Currently, Avro record is still used.
I will remove this `TODO` first, and wait for the later implementation of `HoodieFlinkRecord`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r904628542
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieInternalRowUtils.scala:
##########
@@ -0,0 +1,300 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import java.nio.charset.StandardCharsets
+import java.util
+import java.util.concurrent.ConcurrentHashMap
+import org.apache.avro.Schema
+import org.apache.hudi.AvroConversionUtils
+import org.apache.hudi.avro.HoodieAvroUtils.{createFullName, fromJavaDate, toJavaDate}
+import org.apache.hudi.common.model.HoodieRecord.HoodieMetadataField
+import org.apache.hudi.exception.HoodieException
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{GenericInternalRow, JoinedRow, MutableProjection, Projection}
+import org.apache.spark.sql.catalyst.util.{ArrayBasedMapData, ArrayData, GenericArrayData, MapData}
+import org.apache.spark.sql.hudi.ColumnStatsExpressionUtils.AllowedTransformationExpression.exprUtils.generateMutableProjection
+import org.apache.spark.sql.types._
+import scala.collection.mutable
+
+
+object HoodieInternalRowUtils {
+
+ val projectionMap = new ConcurrentHashMap[(StructType, StructType), MutableProjection]
+ val schemaMap = new ConcurrentHashMap[Schema, StructType]
+ val SchemaPosMap = new ConcurrentHashMap[StructType, Map[String, (StructField, Int)]]
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#stitchRecords(org.apache.avro.generic.GenericRecord, org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def stitchRecords(left: InternalRow, leftSchema: StructType, right: InternalRow, rightSchema: StructType, stitchedSchema: StructType): InternalRow = {
+ val mergeSchema = StructType(leftSchema.fields ++ rightSchema.fields)
+ val row = new JoinedRow(left, right)
+ val projection = getCacheProjection(mergeSchema, stitchedSchema)
+ projection(row)
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecord(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema)
+ */
+ def rewriteRecord(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType): InternalRow = {
+ val newRow = new GenericInternalRow(Array.fill(newSchema.fields.length)(null).asInstanceOf[Array[Any]])
+
+ val oldFieldMap = getCacheSchemaPosMap(oldSchema)
+ for ((field, pos) <- newSchema.fields.zipWithIndex) {
+ var oldValue: AnyRef = null
+ if (oldFieldMap.contains(field.name)) {
+ val (oldField, oldPos) = oldFieldMap(field.name)
+ oldValue = oldRecord.get(oldPos, oldField.dataType)
+ }
+ if (oldValue != null) {
+ field.dataType match {
+ case structType: StructType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[StructType]
+ rewriteRecord(oldValue.asInstanceOf[InternalRow], oldField, structType)
+ case decimalType: DecimalType =>
+ val oldField = oldFieldMap(field.name)._1.asInstanceOf[DecimalType]
+ if (decimalType.scale != oldField.scale || decimalType.precision != oldField.precision) {
+ newRow.update(pos, Decimal.fromDecimal(oldValue.asInstanceOf[Decimal].toBigDecimal.setScale(newSchema.asInstanceOf[DecimalType].scale))
+ )
+ } else {
+ newRow.update(pos, oldValue)
+ }
+ case _ =>
+ newRow.update(pos, oldValue)
+ }
+ } else {
+ // TODO default value in newSchema
+ }
+ }
+
+ newRow
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(org.apache.avro.generic.IndexedRecord, org.apache.avro.Schema, java.util.Map)
+ */
+ def rewriteRecordWithNewSchema(oldRecord: InternalRow, oldSchema: StructType, newSchema: StructType, renameCols: util.Map[String, String]): InternalRow = {
+ rewriteRecordWithNewSchema(oldRecord, oldSchema, newSchema, renameCols, new util.LinkedList[String]).asInstanceOf[InternalRow]
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithNewSchema(java.lang.Object, org.apache.avro.Schema, org.apache.avro.Schema, java.util.Map, java.util.Deque)
+ */
+ private def rewriteRecordWithNewSchema(oldRecord: Any, oldSchema: DataType, newSchema: DataType, renameCols: util.Map[String, String], fieldNames: util.Deque[String]): Any = {
+ if (oldRecord == null) {
+ null
+ } else {
+ newSchema match {
+ case targetSchema: StructType =>
+ if (!oldRecord.isInstanceOf[InternalRow]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldRow = oldRecord.asInstanceOf[InternalRow]
+ val helper = mutable.Map[Integer, Any]()
+
+ val oldSchemaPos = getCacheSchemaPosMap(oldSchema.asInstanceOf[StructType])
+ targetSchema.fields.zipWithIndex.foreach { case (field, i) =>
+ fieldNames.push(field.name)
+ if (oldSchemaPos.contains(field.name)) {
+ val (oldField, oldPos) = oldSchemaPos(field.name)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ } else {
+ val fieldFullName = createFullName(fieldNames)
+ val colNamePartsFromOldSchema = renameCols.getOrDefault(fieldFullName, "").split("\\.")
+ val lastColNameFromOldSchema = colNamePartsFromOldSchema(colNamePartsFromOldSchema.length - 1)
+ // deal with rename
+ if (!oldSchemaPos.contains(field.name) && oldSchemaPos.contains(lastColNameFromOldSchema)) {
+ // find rename
+ val (oldField, oldPos) = oldSchemaPos(lastColNameFromOldSchema)
+ helper(i) = rewriteRecordWithNewSchema(oldRow.get(oldPos, oldField.dataType), oldField.dataType, field.dataType, renameCols, fieldNames)
+ }
+ }
+ fieldNames.pop()
+ }
+ val newRow = new GenericInternalRow(Array.fill(targetSchema.length)(null).asInstanceOf[Array[Any]])
+ targetSchema.fields.zipWithIndex.foreach { case (_, i) =>
+ if (helper.contains(i)) {
+ newRow.update(i, helper(i))
+ } else {
+ // TODO add default val
+ newRow.update(i, null)
+ }
+ }
+
+ newRow
+ case targetSchema: ArrayType =>
+ if (!oldRecord.isInstanceOf[ArrayData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldElementType = oldSchema.asInstanceOf[ArrayType].elementType
+ val oldArray = oldRecord.asInstanceOf[ArrayData]
+ val newElementType = targetSchema.elementType
+ val newArray = new GenericArrayData(Array.fill(oldArray.numElements())(null).asInstanceOf[Array[Any]])
+ fieldNames.push("element")
+ oldArray.toSeq[Any](oldElementType).zipWithIndex.foreach { case (value, i) => newArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldElementType, newElementType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newArray
+ case targetSchema: MapType =>
+ if (!oldRecord.isInstanceOf[MapData]) {
+ throw new IllegalArgumentException("cannot rewrite record with different type")
+ }
+ val oldValueType = oldSchema.asInstanceOf[MapType].valueType
+ val oldKeyType = oldSchema.asInstanceOf[MapType].keyType
+ val oldMap = oldRecord.asInstanceOf[MapData]
+ val newValueType = targetSchema.valueType
+ val newKeyArray = new GenericArrayData(Array.fill(oldMap.keyArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newValueArray = new GenericArrayData(Array.fill(oldMap.valueArray().numElements())(null).asInstanceOf[Array[Any]])
+ val newMap = new ArrayBasedMapData(newKeyArray, newValueArray)
+ fieldNames.push("value")
+ oldMap.keyArray().toSeq[Any](oldKeyType).zipWithIndex.foreach { case (value, i) => newKeyArray.update(i, value) }
+ oldMap.valueArray().toSeq[Any](oldValueType).zipWithIndex.foreach { case (value, i) => newValueArray.update(i, rewriteRecordWithNewSchema(value.asInstanceOf[AnyRef], oldValueType, newValueType, renameCols, fieldNames)) }
+ fieldNames.pop()
+
+ newMap
+ case _ => rewritePrimaryType(oldRecord, oldSchema, newSchema)
+ }
+ }
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecord(record, oldSchema, newSchema)
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ /**
+ * @see org.apache.hudi.avro.HoodieAvroUtils#rewriteEvolutionRecordWithMetadata(org.apache.avro.generic.GenericRecord, org.apache.avro.Schema, java.lang.String)
+ */
+ def rewriteEvolutionRecordWithMetadata(record: InternalRow, oldSchema: StructType, newSchema: StructType, fileName: String): InternalRow = {
+ val newRecord = rewriteRecordWithNewSchema(record, oldSchema, newSchema, new util.HashMap[String, String]())
+ newRecord.update(HoodieMetadataField.FILENAME_METADATA_FIELD.ordinal, fileName)
+
+ newRecord
+ }
+
+ def getCacheSchema(schema: Schema): StructType = {
Review Comment:
All `Cache` to `Cached` done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1156330534
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275)
* 9fc23fae5e466daa0df3a421483c6b79d29a9f90 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r901041090
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseWriteHelper.java:
##########
@@ -81,9 +83,10 @@ public I combineOnCondition(
*/
public I deduplicateRecords(
I records, HoodieTable<T, I, K, O> table, int parallelism) {
- return deduplicateRecords(records, table.getIndex(), parallelism);
+ HoodieMerge hoodieMerge = ReflectionUtils.loadHoodieMerge(table.getConfig().getMergeClass());
Review Comment:
Ditto
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +105,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ hoodieMerge = ReflectionUtils.loadHoodieMerge(config.getMergeClass());
Review Comment:
Reflection impacts performance greatly. Can we optimize the instantiation here?
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieWriteHelper.java:
##########
@@ -49,19 +50,17 @@ protected HoodieData<HoodieRecord<T>> tag(HoodieData<HoodieRecord<T>> dedupedRec
@Override
public HoodieData<HoodieRecord<T>> deduplicateRecords(
- HoodieData<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism) {
+ HoodieData<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism, HoodieMerge hoodieMerge) {
boolean isIndexingGlobal = index.isGlobal();
return records.mapToPair(record -> {
HoodieKey hoodieKey = record.getKey();
- // If index used is global, then records are expected to differ in their partitionPath
+ // If index used is global,x then records are expected to differ in their partitionPath
Review Comment:
Typo?
##########
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/table/action/commit/FlinkWriteHelper.java:
##########
@@ -87,20 +88,21 @@ protected List<HoodieRecord<T>> tag(List<HoodieRecord<T>> dedupedRecords, Hoodie
@Override
public List<HoodieRecord<T>> deduplicateRecords(
- List<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism) {
+ List<HoodieRecord<T>> records, HoodieIndex<?, ?> index, int parallelism, HoodieMerge hoodieMerge) {
// If index used is global, then records are expected to differ in their partitionPath
Map<Object, List<HoodieRecord<T>>> keyedRecords = records.stream()
.collect(Collectors.groupingBy(record -> record.getKey().getRecordKey()));
return keyedRecords.values().stream().map(x -> x.stream().reduce((rec1, rec2) -> {
- @SuppressWarnings("unchecked") final HoodieRecord reducedRec = rec2.preCombine(rec1);
+ @SuppressWarnings("unchecked")
+ final HoodieRecord reducedData = hoodieMerge.preCombine(rec1, rec2);
// we cannot allow the user to change the key or partitionPath, since that will affect
// everything
// so pick it from one of the records.
- boolean choosePrev = rec1 == reducedRec;
+ boolean choosePrev = rec1 == reducedData;
Review Comment:
reducedRec sounds more precise. Why rename?
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
Review Comment:
This duplicates the other config?
##########
hudi-client/hudi-java-client/src/main/java/org/apache/hudi/table/action/commit/JavaWriteHelper.java:
##########
@@ -65,11 +67,12 @@ public List<HoodieRecord<T>> deduplicateRecords(
return keyedRecords.values().stream().map(x -> x.stream().map(Pair::getRight).reduce((rec1, rec2) -> {
@SuppressWarnings("unchecked")
- HoodieRecord reducedRec = rec2.preCombine(rec1);
+ HoodieRecord reducedRecord = hoodieMerge.preCombine(rec1,rec2);
+
// we cannot allow the user to change the key or partitionPath, since that will affect
// everything
// so pick it from one of the records.
- return (HoodieRecord<T>) reducedRec.newInstance(rec1.getKey());
+ return (HoodieRecord<T>) new HoodieAvroRecord(reducedRecord);
Review Comment:
Why not using the newInstance API?
##########
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala:
##########
@@ -181,6 +181,8 @@ private[sql] class AvroDeserializer(rootAvroType: Schema,
case b: ByteBuffer =>
val bytes = new Array[Byte](b.remaining)
b.get(bytes)
+ // Do not forget to reset the position
+ b.rewind()
Review Comment:
An existing bug? Maybe file a separate jira and land in master first?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141312191
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141941513
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73ddb4331b1c753db4862eb226a7e3248422b666 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008)
* 932911e7c61e35795e0a7d1076eabc4787df4972 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1141159695
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0a85e7128839206b82f16b74cac84855ab9774af Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005)
* 73ddb4331b1c753db4862eb226a7e3248422b666 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r894227763
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##########
@@ -154,6 +155,12 @@ public class HoodieTableConfig extends HoodieConfig {
.withDocumentation("Payload class to use for performing compactions, i.e merge delta logs with current base file and then "
+ " produce a new base file.");
+ public static final ConfigProperty<String> COMBINE_ENGINE_CLASS_NAME = ConfigProperty
+ .key("hoodie.compaction.combine.engine.class")
+ .defaultValue(HoodieAvroRecordCombiningEngine.class.getName())
Review Comment:
@vinothchandar to confirm, you meant when users choose to query with hive for e.g., the config can detect it and choose hive combining engine automatically instead of the default avro-based one?
@wulei0302 @wzx140 we can file ticket to follow up on implementing this detection.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1166787722
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1167546331
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 5c34cb62dac887b1adb4ea9ff8c3873f3680818b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1130180419
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0b30db620e174195a03d499a36aa7a22b2c77c54 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1134082800
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* d7ed9f43b3c10763e02169cd4b48fcde17afa8b2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1134082070
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1130227616
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0b30db620e174195a03d499a36aa7a22b2c77c54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749)
* 7af9bab093e7dffc60aece12ea9d0ed819ad90e5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909033492
##########
hudi-common/src/main/java/org/apache/hudi/common/util/HoodieRecordUtils.java:
##########
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.model.HoodieRecordPayload;
+import org.apache.hudi.exception.HoodieException;
+
+import java.lang.reflect.InvocationTargetException;
+import java.util.HashMap;
+import java.util.Map;
+
+/**
+ * A utility class for HoodieRecord.
+ */
+public class HoodieRecordUtils {
Review Comment:
UTs for this class, if not exists
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -59,6 +61,7 @@
*/
protected final Schema tableSchema;
protected final Schema tableSchemaWithMetaFields;
+ protected final HoodieMerge hoodieMerge;
Review Comment:
just `merge` ?
##########
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java:
##########
@@ -791,6 +792,11 @@ public PropertyBuilder setPayloadClassName(String payloadClassName) {
return this;
}
+ public PropertyBuilder setMergeClassName(String mergeClassName) {
Review Comment:
What's our migration plan ? do we replace built payloads with equivalent merge classes? We can ask the community how painful it'll be to just port over their custom payloads?
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable<?> orderingVal;
Review Comment:
cc @danny0405 for comments
##########
hudi-common/src/main/java/org/apache/hudi/common/util/HoodieRecordUtils.java:
##########
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.model.HoodieRecordPayload;
+import org.apache.hudi.exception.HoodieException;
+
+import java.lang.reflect.InvocationTargetException;
+import java.util.HashMap;
+import java.util.Map;
+
+/**
+ * A utility class for HoodieRecord.
+ */
+public class HoodieRecordUtils {
+
+ private static final Map<String, Object> INSTANCE_CACHE = new HashMap<>();
Review Comment:
would n't ReflectUtils already do this? Can we reuse that
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSparkRecord.java:
##########
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi;
+
+import org.apache.hudi.common.config.TypedProperties;
+import org.apache.hudi.common.model.HoodieKey;
+import org.apache.hudi.common.model.HoodieOperation;
+import org.apache.hudi.common.model.HoodieRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.keygen.BaseKeyGenerator;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.spark.sql.catalyst.InternalRow;
+import org.apache.spark.sql.types.StructType;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+
+import static org.apache.spark.sql.types.DataTypes.BooleanType;
+
+/**
+ * Spark Engine-specific Implementations of `HoodieRecord`.
+ */
+public class HoodieSparkRecord extends HoodieRecord<InternalRow> {
Review Comment:
Add UT for this if not exists?
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable<?> orderingVal;
Review Comment:
wondering if we should call this `eventTime` (instantTime/commitTime is arrival time), then the concepts become clearer
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##########
@@ -234,6 +235,12 @@ public class HoodieCompactionConfig extends HoodieConfig {
+ "the record payload class to merge records in the log against each other, merge again with the base file and "
+ "produce the final record to be written after compaction.");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
Review Comment:
looks great
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala:
##########
@@ -303,7 +305,12 @@ class HoodieMergeOnReadRDD(@transient sc: SparkContext,
private def merge(curAvroRecord: GenericRecord, newRecord: HoodieRecord[_ <: HoodieRecordPayload[_]]): Option[IndexedRecord] = {
// NOTE: We have to pass in Avro Schema used to read from Delta Log file since we invoke combining API
// on the record from the Delta Log
- toScalaOption(newRecord.getData.combineAndGetUpdateValue(curAvroRecord, logFileReaderAvroSchema, payloadProps))
+ val combinedRecord = hoodieMerge.combineAndGetUpdateValue(new HoodieAvroIndexedRecord(curAvroRecord), newRecord, logFileReaderAvroSchema, payloadProps)
Review Comment:
we should do some sanity checks on performance
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
can we have a single API that can handle both?
```
Option<HoodieRecord> merge(Option<HoodieRecord> older, Option<HoodieRecord> newer) {
}
```
So for CreateHandle/AppendHandle, where we do inserts we can actually have `older=Option.Empty` and in case the merge implementation wants to delete the skip, it can return `Option.Empty` .
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroRecordMerge.java:
##########
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.metadata.HoodieMetadataPayload;
+
+import java.io.IOException;
+import java.util.Properties;
+
+import static org.apache.hudi.TypeUtils.unsafeCast;
+
+public class HoodieAvroRecordMerge implements HoodieMerge {
+ @Override
+ public HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer) {
Review Comment:
Hmmm. one reason why need separate `preCombine` and `combineAndGetUpdateValue` seems to be for supporting the payload API fallback? Would love to have a single simple merge() method if possible, let me mull this over more
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:
##########
@@ -301,6 +301,12 @@ object DataSourceWriteOptions {
*/
val PAYLOAD_CLASS_NAME = HoodieWriteConfig.WRITE_PAYLOAD_CLASS_NAME
+ /**
+ * HoodieMerge will replace the payload to process the merge of data
+ * and provide the same capabilities as the payload
+ */
+ val MERGE_CLASS_NAME = HoodieWriteConfig.MERGE_CLASS_NAME
Review Comment:
do we need a config to control whether we do `SparkRecord` based writing or avro based writing? is Avro (old behavior the default still?)
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +106,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ this.hoodieMerge = HoodieRecordUtils.loadHoodieMerge(config.getMergeClass());
Review Comment:
rename: `loadMerge` ? we can drop the `hoodie` from methods
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -123,6 +124,12 @@ public class HoodieWriteConfig extends HoodieConfig {
.withDocumentation("Payload class used. Override this, if you like to roll your own merge logic, when upserting/inserting. "
+ "This will render any value set for PRECOMBINE_FIELD_OPT_VAL in-effective");
+ public static final ConfigProperty<String> MERGE_CLASS_NAME = ConfigProperty
Review Comment:
we can make this just `hoodie.merge.class` . the datasource naming below is probably not a good one if you are basing off that
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914361663
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadInputFormat.java:
##########
@@ -649,7 +656,8 @@ static class MergeIterator implements RecordIterator {
int[] requiredPos,
boolean emitDelete,
int operationPos,
- ParquetColumnarRowSplitReader reader) { // the reader should be with full schema
+ ParquetColumnarRowSplitReader reader, // the reader should be with full schema
+ String mergeClass) {
this.tableSchema = tableSchema;
Review Comment:
Do we need to pass around the `mergeClass` explicitly ? You can fetch that through the `flinkConf` right ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
xushiyan commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1174046222
@wulei0302 @wzx140 will land this as e2e tests passed. Please go through the comments for follow-ups. Some can be tackled in step3. some can be done in later PRs.
In Step3 we should at least get API unification done for spark record, and leave the legacy APIs with avro record for compatibility (mark for deprecation so we can remove it in future versions).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914081837
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
@wulei0302 i think we need to make sure that we wrap up RFC-46 with the following artifacts on hands:
- New APIs (forward-looking, one unified merging API)
- Legacy APIs (backward-compatible, with `preCombine` and `combineAndGetUpdateValue`, necessary to facilitate the migration onto the new API)
That way, we can encourage folks to migrate from existing model where Legacy API will be providing compatibility out-of-the box onto a new API which we can call a standard and deprecate a legacy one in 0.13
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914359578
##########
hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java:
##########
@@ -160,6 +162,7 @@ protected AbstractHoodieLogRecordReader(FileSystem fs, String basePath, List<Str
HoodieTableConfig tableConfig = this.hoodieTableMetaClient.getTableConfig();
this.payloadClassFQN = tableConfig.getPayloadClass();
this.preCombineField = tableConfig.getPreCombineField();
+ this.mergeClassFQN = tableConfig.getMergeClass();
this.totalLogFiles.addAndGet(logFilePaths.size());
Review Comment:
What does `FQN` mean ? Please do not introduce meaningless abbreviation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r914357550
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -131,25 +131,35 @@ public String getFieldName() {
*/
private HoodieOperation operation;
+ /**
+ * For purposes of preCombining.
+ */
+ private Comparable<?> orderingVal;
Review Comment:
> eventTime
We can not make sure the field here is a timestamp type, even it is, the time maybe a processing time from source, so `orderingVal` is a more general case which just means the field is used for payload ordering.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169029853
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168371049",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168551690",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e754fddfae3b86d0df81d6c03bd02d467e5228",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9605",
"triggerID" : "1168754236",
"triggerType" : "MANUAL"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"triggerType" : "PUSH"
}, {
"hash" : "7e0eea449656a8c38897778f8b39e4400e36d11f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616",
"triggerID" : "1168997615",
"triggerType" : "MANUAL"
}, {
"hash" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617",
"triggerID" : "a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 7e0eea449656a8c38897778f8b39e4400e36d11f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9616)
* a64cb7797427b8c16ce4e7e4d2dd93fec5eb506f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9617)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909203276
##########
hudi-common/src/main/java/org/apache/hudi/common/util/HoodieRecordUtils.java:
##########
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import org.apache.hudi.common.model.HoodieMerge;
+import org.apache.hudi.common.model.HoodieRecordPayload;
+import org.apache.hudi.exception.HoodieException;
+
+import java.lang.reflect.InvocationTargetException;
+import java.util.HashMap;
+import java.util.Map;
+
+/**
+ * A utility class for HoodieRecord.
+ */
+public class HoodieRecordUtils {
+
+ private static final Map<String, Object> INSTANCE_CACHE = new HashMap<>();
Review Comment:
we remove loadMerge and loadPayload method out of ReflectionUtils, which is only meant for generic reflection helpers. we prefer to move them to a HoodieRecord specific util class.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r909195782
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java:
##########
@@ -103,6 +106,7 @@ protected HoodieWriteHandle(HoodieWriteConfig config, String instantTime, String
this.taskContextSupplier = taskContextSupplier;
this.writeToken = makeWriteToken();
schemaOnReadEnabled = !isNullOrEmpty(hoodieTable.getConfig().getInternalSchema());
+ this.hoodieMerge = HoodieRecordUtils.loadHoodieMerge(config.getMergeClass());
Review Comment:
Let's rename: merge？ So consistent with other `HoodieMerge` variable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r910521355
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
Review Comment:
"Merge" by itself is a very opaque term and when we call it `HoodieMerge` w/o contextualizing it it becomes hard to understand what it actually relates to.
I'd suggest to instead be a little more verbose in the name to make sure it's very clear what this component is intended to do, for ex something like `HoodieRecordMergingEngine`
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
And for us to actually be able to do that we have to enforce following properties onto the `merge` implementations:
- It'd be [associative operation](https://en.wikipedia.org/wiki/Associative_property): `f(a, f(b, c)) = f(f(a, b), c)` (which we can translate as having 3 versions A, B, C of the single record, both orders of operations applications have to yield the same result)
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMerge.java:
##########
@@ -0,0 +1,38 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.model;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.Option;
+
+import java.io.IOException;
+import java.io.Serializable;
+import java.util.Properties;
+
+/**
+ * HoodieMerge defines how to merge two records. It is a stateless component.
+ * It can implement the merging logic of HoodieRecord of different engines
+ * and avoid the performance consumption caused by the serialization/deserialization of Avro payload.
+ */
+public interface HoodieMerge extends Serializable {
+
+ HoodieRecord preCombine(HoodieRecord older, HoodieRecord newer);
Review Comment:
So, historically, this has been 2 different methods with (potentially) different semantics:
- `preCombine` is de-duplicating the input batch (before inserting it into the table
- `combineAndGet` is used to merge persisted version with the incoming (that could have been previously de-duplicated
I also don't see a reason for us to get hung up on this historical context and we should try to unify these historically (potentially) divergent methods into 1 providing a single avenue of merging records either inside a batch (when de-duping) or when combining persisted one with the incoming.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1169528775
> Made one pass, changes themselves look reasonable. Need to read SparkRecord and its utils closely. My understanding of this PR is
>
> * Wraps the payload completely using methods on the HoodieRecord abstraction
> * All code paths now just call HoodieRecord for merging, the old getInsertValue() is pushed into Record APIs as well.
>
> I would love to understand
>
> * What testing has been done? AFAICT the Spark datasource writer is still not working with SparkRecord?
> * any perf comparisons for the new SparkRecord based writes vs AvroRecord based writes.
> * My wishful thinking is that we eliminate `preCombine` as well somehow. This will make the end system very simple for implementation in various engines.
>
> I suggest @danny0405 to look at the changes from the Flink lens once as well.
- Yeah, The Testing and SparkRecordWriter/Reader has been completed in [Step3](https://github.com/apache/hudi/pull/5629)
- (comparisons)This is in progress on the basis of Step3
- Currently, Our guys think that `preCombine` acts between log files and `combineAndGetUpdateValue` acts between log and base files. There are some differences in definitions. Maybe from a higher abstraction, it can be merged into one API, but let's discuss this further, and mayby it can be completed in other pr
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wulei0302 commented on a diff in pull request #5627: [HUDI-3350][HUDI-3351] Support HoodieMerge API and Spark engine-specific HoodieRecord
Posted by GitBox <gi...@apache.org>.
wulei0302 commented on code in PR #5627:
URL: https://github.com/apache/hudi/pull/5627#discussion_r917605111
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -169,15 +179,17 @@ public HoodieOperation getOperation() {
return operation;
}
+ public Comparable<?> getOrderingValue() {
+ return orderingVal;
+ }
+
public T getData() {
if (data == null) {
- throw new IllegalStateException("Payload already deflated for record.");
+ throw new IllegalStateException("HoodieRecord already deflated for record.");
}
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168149120
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 5c34cb62dac887b1adb4ea9ff8c3873f3680818b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587)
* 427cbc6076f215419616df39deb4dceb54c1b6bc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5627: [HUDI-3350][HUDI-3351] Rebase Record combining semantic into `HoodieRecordCombiningEngine`
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5627:
URL: https://github.com/apache/hudi/pull/5627#issuecomment-1168307542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8749",
"triggerID" : "0b30db620e174195a03d499a36aa7a22b2c77c54",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"triggerType" : "PUSH"
}, {
"hash" : "7af9bab093e7dffc60aece12ea9d0ed819ad90e5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8751",
"triggerID" : "1133883627",
"triggerType" : "MANUAL"
}, {
"hash" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8833",
"triggerID" : "0167efc3be6b046a7dae9e50b869305d8eb246a6",
"triggerType" : "PUSH"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8840",
"triggerID" : "d7ed9f43b3c10763e02169cd4b48fcde17afa8b2",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1134082070",
"triggerType" : "MANUAL"
}, {
"hash" : "0a85e7128839206b82f16b74cac84855ab9774af",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9005",
"triggerID" : "0a85e7128839206b82f16b74cac84855ab9774af",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"triggerType" : "PUSH"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141272832",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141280698",
"triggerType" : "MANUAL"
}, {
"hash" : "73ddb4331b1c753db4862eb226a7e3248422b666",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9008",
"triggerID" : "1141606132",
"triggerType" : "MANUAL"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"triggerType" : "PUSH"
}, {
"hash" : "932911e7c61e35795e0a7d1076eabc4787df4972",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9014",
"triggerID" : "1154120371",
"triggerType" : "MANUAL"
}, {
"hash" : "25591a75e59756ae4112add59da0ef5063275804",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9265",
"triggerID" : "25591a75e59756ae4112add59da0ef5063275804",
"triggerType" : "PUSH"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9275",
"triggerID" : "ae0e6cf871bf8f0d3feb241dcce2ede2933d99b3",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1154632017",
"triggerType" : "MANUAL"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"triggerType" : "PUSH"
}, {
"hash" : "9fc23fae5e466daa0df3a421483c6b79d29a9f90",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9316",
"triggerID" : "1157143330",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"triggerType" : "PUSH"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157224265",
"triggerType" : "MANUAL"
}, {
"hash" : "39e3c420052f855de667c7f75c39bd6a7ee65bf2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9323",
"triggerID" : "1157265400",
"triggerType" : "MANUAL"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"triggerType" : "PUSH"
}, {
"hash" : "88bfb7612b10d46fd752c1caed2572ba72f5d773",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9329",
"triggerID" : "1160519469",
"triggerType" : "MANUAL"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"triggerType" : "PUSH"
}, {
"hash" : "639cb4f0fe5e41029d461b3b7c41b507fda41de0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9401",
"triggerID" : "1161062806",
"triggerType" : "MANUAL"
}, {
"hash" : "42c66b7aed8242d90934927f15411719f431edcb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9410",
"triggerID" : "42c66b7aed8242d90934927f15411719f431edcb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"triggerType" : "PUSH"
}, {
"hash" : "2abb5bfd7a2682651dc6a57aab7f5cedce8f35cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9411",
"triggerID" : "1161350999",
"triggerType" : "MANUAL"
}, {
"hash" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9423",
"triggerID" : "ef9f638b283a9fd8ace9349f3ba461d229bc68ea",
"triggerType" : "PUSH"
}, {
"hash" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9450",
"triggerID" : "073ca5cf638176264ef5a09a4ea083be6780d2b7",
"triggerType" : "PUSH"
}, {
"hash" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba",
"triggerType" : "PUSH"
}, {
"hash" : "98a75b36c814c85acd058a636830d627357beee1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9465",
"triggerID" : "98a75b36c814c85acd058a636830d627357beee1",
"triggerType" : "PUSH"
}, {
"hash" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9466",
"triggerID" : "247df2328bfdc55400c16aca7e3d031a2217049e",
"triggerType" : "PUSH"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9573",
"triggerID" : "9a490b40fac476c1dd9652b9e5b87b0599ca8ba5",
"triggerType" : "PUSH"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1166787722",
"triggerType" : "MANUAL"
}, {
"hash" : "b61c6fff92835625283c20136e8ee5e6fd9a8e49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9578",
"triggerID" : "1167226623",
"triggerType" : "MANUAL"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"triggerType" : "PUSH"
}, {
"hash" : "5c34cb62dac887b1adb4ea9ff8c3873f3680818b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9587",
"triggerID" : "1168142429",
"triggerType" : "MANUAL"
}, {
"hash" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9596",
"triggerID" : "427cbc6076f215419616df39deb4dceb54c1b6bc",
"triggerType" : "PUSH"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
}, {
"hash" : "870167d142cad0c0503176c8dc1b0910a996a096",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601",
"triggerID" : "870167d142cad0c0503176c8dc1b0910a996a096",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1168226795",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 5bb5dfd3ce756d53ba44e410165b81e17ba9d7ba UNKNOWN
* 870167d142cad0c0503176c8dc1b0910a996a096 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9601)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org