You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "alexeykudinkin (via GitHub)" <gi...@apache.org> on 2023/02/17 02:19:48 UTC
[GitHub] [hudi] alexeykudinkin opened a new pull request, #7987: [WIP] Record Keys Auto-gen Prototype
alexeykudinkin opened a new pull request, #7987:
URL: https://github.com/apache/hudi/pull/7987
### Change Logs
_Describe context and summary for this change. Highlight if any code was copied._
### Impact
_Describe any public API or user-facing feature change or any performance impact._
### Risk level (write none, low medium or high below)
_If medium or high, explain what verification was done to mitigate the risks._
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change_
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1442932367
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
}, {
"hash" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355",
"triggerID" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"triggerType" : "PUSH"
}, {
"hash" : "5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15380",
"triggerID" : "5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 70aa11e1869b46f7d97fc45de15abbad712868a5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355)
* 5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15380)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441162562
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1306b01c7b6025b26a64217498c00077dbe6e29 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar closed pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "vinothchandar (via GitHub)" <gi...@apache.org>.
vinothchandar closed pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
URL: https://github.com/apache/hudi/pull/7987
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "alexeykudinkin (via GitHub)" <gi...@apache.org>.
alexeykudinkin commented on code in PR #7987:
URL: https://github.com/apache/hudi/pull/7987#discussion_r1117812991
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/RecordKeyAutoGen.scala:
##########
@@ -0,0 +1,93 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi
+
+import org.apache.hudi.common.config.HoodieConfig
+import org.apache.hudi.common.model.{HoodiePayloadProps, HoodieRecord, WriteOperationType}
+import org.apache.hudi.common.table.HoodieTableConfig
+import org.apache.hudi.config.HoodieWriteConfig
+import org.apache.hudi.exception.HoodieException
+import org.apache.hudi.keygen.constant.KeyGeneratorOptions
+import org.apache.spark.sql.{Column, DataFrame}
+import org.apache.spark.sql.catalyst.expressions.AutoRecordKeyGenExpression
+
+import scala.collection.mutable
+import scala.jdk.CollectionConverters.mapAsScalaMapConverter
+
+object RecordKeyAutoGen {
+
+ /**
+ * Set of operations supporting record-key auto-gen (currently only [[WriteOperationType.INSERT]],
+ * [[WriteOperationType.BULK_INSERT]])
+ */
+ private val supportedOperations: Set[String] =
+ Set(WriteOperationType.INSERT, WriteOperationType.BULK_INSERT).map(_.value)
+
+ /**
+ * Set of operations compatible w/ record-key auto-gen (additionally to [[supportedOperations]]
+ * [[WriteOperationType.DELETE]] is a compatible operation)
+ */
+ private val compatibleOperations: Set[String] = supportedOperations ++
+ Set(WriteOperationType.DELETE).map(_.value)
+
+ def tryRecordKeyAutoGen(df: DataFrame, commitInstant: String, config: HoodieConfig): DataFrame = {
+ val shouldAutoGenRecordKeys = config.getBooleanOrDefault(HoodieTableConfig.AUTO_GEN_RECORD_KEYS)
+ val operation = config.getStringOrDefault(DataSourceWriteOptions.OPERATION)
+
+ if (shouldAutoGenRecordKeys && supportedOperations.contains(operation)) {
+ // TODO reorder to keep all meta-fields as first?
+ df.withColumn(HoodieRecord.AUTOGEN_ROW_KEY, new Column(AutoRecordKeyGenExpression(commitInstant)))
Review Comment:
It's a meta-field rather than a data-field, but you're bringing up a good point, we'd have 3 fields which'd look mostly identical (`_hoodie_record_key`, `_hoodie_seq_no` and the new one).
We should definitely try to optimize it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1443558232
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
}, {
"hash" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355",
"triggerID" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"triggerType" : "PUSH"
}, {
"hash" : "5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15380",
"triggerID" : "5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15380)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "vinothchandar (via GitHub)" <gi...@apache.org>.
vinothchandar commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1521775951
Closing in favor of #8107
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #7987:
URL: https://github.com/apache/hudi/pull/7987#discussion_r1117448184
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/RecordKeyAutoGen.scala:
##########
@@ -0,0 +1,93 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi
+
+import org.apache.hudi.common.config.HoodieConfig
+import org.apache.hudi.common.model.{HoodiePayloadProps, HoodieRecord, WriteOperationType}
+import org.apache.hudi.common.table.HoodieTableConfig
+import org.apache.hudi.config.HoodieWriteConfig
+import org.apache.hudi.exception.HoodieException
+import org.apache.hudi.keygen.constant.KeyGeneratorOptions
+import org.apache.spark.sql.{Column, DataFrame}
+import org.apache.spark.sql.catalyst.expressions.AutoRecordKeyGenExpression
+
+import scala.collection.mutable
+import scala.jdk.CollectionConverters.mapAsScalaMapConverter
+
+object RecordKeyAutoGen {
+
+ /**
+ * Set of operations supporting record-key auto-gen (currently only [[WriteOperationType.INSERT]],
+ * [[WriteOperationType.BULK_INSERT]])
+ */
+ private val supportedOperations: Set[String] =
+ Set(WriteOperationType.INSERT, WriteOperationType.BULK_INSERT).map(_.value)
+
+ /**
+ * Set of operations compatible w/ record-key auto-gen (additionally to [[supportedOperations]]
+ * [[WriteOperationType.DELETE]] is a compatible operation)
+ */
+ private val compatibleOperations: Set[String] = supportedOperations ++
+ Set(WriteOperationType.DELETE).map(_.value)
+
+ def tryRecordKeyAutoGen(df: DataFrame, commitInstant: String, config: HoodieConfig): DataFrame = {
+ val shouldAutoGenRecordKeys = config.getBooleanOrDefault(HoodieTableConfig.AUTO_GEN_RECORD_KEYS)
+ val operation = config.getStringOrDefault(DataSourceWriteOptions.OPERATION)
+
+ if (shouldAutoGenRecordKeys && supportedOperations.contains(operation)) {
+ // TODO reorder to keep all meta-fields as first?
+ df.withColumn(HoodieRecord.AUTOGEN_ROW_KEY, new Column(AutoRecordKeyGenExpression(commitInstant)))
Review Comment:
why do we need to add a new column? can't we keep it in memory(HoodieKey) and add it to our meta field (_hoodie_record_key) only? trying not to change the schema of table irrespective of whether auto gen is enabled or not.
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala:
##########
@@ -537,6 +544,21 @@ object HoodieSparkSqlWriter {
fullPartitions.distinct
}
+ def handleRecordKeyAutoGen(df: DataFrame, commitInstant: String, config: HoodieConfig): DataFrame = {
+ if (config.getBooleanOrDefault(HoodieTableConfig.AUTO_GEN_RECORD_KEYS)) {
+ val monotonicIdFormat = "#" * 19
+ val rowKeyExpr = Concat(Seq(
+ Literal(s"${commitInstant}_"),
+ FormatNumber(MonotonicallyIncreasingID(), Literal(monotonicIdFormat))
+ ))
+
+ // TODO reorder?
+ df.withColumn(HoodieRecord.AUTOGEN_ROW_KEY, new Column(rowKeyExpr))
Review Comment:
I don't think we can add a new data field. We already have a meta field for holding the record key (_hoodie_record_key). we should try to hold the auto genrated record key in memory (HoodieKey.recordkey) and let the writer write it to meta fields within write Handle.
Or we should drop the newly added data field (HoodieRecord.AUTOGEN_ROW_KEY) later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441166804
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1306b01c7b6025b26a64217498c00077dbe6e29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441297058
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
}, {
"hash" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8a5dd3249ed91fd70842ec274fc905d2e04bff07 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351)
* 70aa11e1869b46f7d97fc45de15abbad712868a5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1442908809
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
}, {
"hash" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355",
"triggerID" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"triggerType" : "PUSH"
}, {
"hash" : "5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 70aa11e1869b46f7d97fc45de15abbad712868a5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355)
* 5cfa69e4c1c487e5cedb4f8d7d3a4c7334cfe266 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441200660
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1306b01c7b6025b26a64217498c00077dbe6e29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350)
* 8a5dd3249ed91fd70842ec274fc905d2e04bff07 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441193620
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f1306b01c7b6025b26a64217498c00077dbe6e29 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350)
* 8a5dd3249ed91fd70842ec274fc905d2e04bff07 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441261059
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8a5dd3249ed91fd70842ec274fc905d2e04bff07 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441302794
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
}, {
"hash" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355",
"triggerID" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8a5dd3249ed91fd70842ec274fc905d2e04bff07 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351)
* 70aa11e1869b46f7d97fc45de15abbad712868a5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #7987:
URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441574567
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15350",
"triggerID" : "f1306b01c7b6025b26a64217498c00077dbe6e29",
"triggerType" : "PUSH"
}, {
"hash" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15351",
"triggerID" : "8a5dd3249ed91fd70842ec274fc905d2e04bff07",
"triggerType" : "PUSH"
}, {
"hash" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355",
"triggerID" : "70aa11e1869b46f7d97fc45de15abbad712868a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 70aa11e1869b46f7d97fc45de15abbad712868a5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15355)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org