You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/02 06:47:30 UTC
[GitHub] [hudi] jerryshao opened a new pull request, #5738: [HUDI-4168] Add Call Procedure for marker deletion
jerryshao opened a new pull request, #5738:
URL: https://github.com/apache/hudi/pull/5738
## What is the purpose of the pull request
This change add `DeleteMarker` procedure to Hudi Spark's call procedure supprot.
## Brief change log
- Add `DeleteMarkerProcedure` class to support `call delete_marker` SQL command.
## Verify this pull request
This change added tests and can be verified as follows:
- Added UT “Test Call delete_marker Procedure” in `TestCallProcedure`.
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144862113
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7aab2fa773bf9f87b374fc08f2bae7c1060f6a70 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049)
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144928860
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
XuQianJin-Stars commented on code in PR #5738:
URL: https://github.com/apache/hudi/pull/5738#discussion_r888520737
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/DeleteMarkerProcedure.scala:
##########
@@ -0,0 +1,78 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.table.HoodieSparkTable
+import org.apache.hudi.table.marker.WriteMarkersFactory
+import org.apache.spark.internal.Logging
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.util.function.Supplier
+import scala.util.{Failure, Success, Try}
+
+class DeleteMarkerProcedure extends BaseProcedure with ProcedureBuilder with Logging {
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType, None),
+ ProcedureParameter.required(1, "instant_Time", DataTypes.StringType, None)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("delete_marker_result", DataTypes.BooleanType, nullable = true, Metadata.empty))
+ )
+
+ def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ def outputType: StructType = OUTPUT_TYPE
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val instantTime = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[String]
+ val basePath = getBasePath(tableName)
+
+ val result = Try {
+ val client = createHoodieClient(jsc, basePath)
+ val config = client.getConfig
+ val context = client.getEngineContext
+ val table = HoodieSparkTable.create(config, context)
Review Comment:
It is better to refresh the timeline here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144759085
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 30652dbad744c9a55a159750f2bad42726e2204f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046)
* 7aab2fa773bf9f87b374fc08f2bae7c1060f6a70 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jerryshao commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
jerryshao commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144545294
Seems like some compiling issues that I didn't meet in local environment. Will fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1145064126
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
}, {
"hash" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052",
"triggerID" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"triggerType" : "PUSH"
}, {
"hash" : "f30348091539852dec6e86983800517a5ad70204",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f30348091539852dec6e86983800517a5ad70204",
"triggerType" : "PUSH"
}, {
"hash" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9053",
"triggerID" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 06846fd7270fbd0b93149bf524425c0cfd11ffe9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052)
* f30348091539852dec6e86983800517a5ad70204 UNKNOWN
* cc44bc0b5993b34b9269a2e3c3b691dcb7fde549 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9053)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
XuQianJin-Stars commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1146732439
Thanks for the @jerryshao contribution, I've merged it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144933525
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
}, {
"hash" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
* 06846fd7270fbd0b93149bf524425c0cfd11ffe9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144810109
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 30652dbad744c9a55a159750f2bad42726e2204f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046)
* 7aab2fa773bf9f87b374fc08f2bae7c1060f6a70 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049)
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144938388
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
}, {
"hash" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052",
"triggerID" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
* 06846fd7270fbd0b93149bf524425c0cfd11ffe9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144644460
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 30652dbad744c9a55a159750f2bad42726e2204f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars merged pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
XuQianJin-Stars merged PR #5738:
URL: https://github.com/apache/hudi/pull/5738
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144755287
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 30652dbad744c9a55a159750f2bad42726e2204f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046)
* 7aab2fa773bf9f87b374fc08f2bae7c1060f6a70 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1145003256
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
}, {
"hash" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052",
"triggerID" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"triggerType" : "PUSH"
}, {
"hash" : "f30348091539852dec6e86983800517a5ad70204",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f30348091539852dec6e86983800517a5ad70204",
"triggerType" : "PUSH"
}, {
"hash" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9053",
"triggerID" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
* 06846fd7270fbd0b93149bf524425c0cfd11ffe9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052)
* f30348091539852dec6e86983800517a5ad70204 UNKNOWN
* cc44bc0b5993b34b9269a2e3c3b691dcb7fde549 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9053)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144541734
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 30652dbad744c9a55a159750f2bad42726e2204f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jerryshao closed pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
jerryshao closed pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
URL: https://github.com/apache/hudi/pull/5738
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144951662
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
}, {
"hash" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052",
"triggerID" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"triggerType" : "PUSH"
}, {
"hash" : "f30348091539852dec6e86983800517a5ad70204",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f30348091539852dec6e86983800517a5ad70204",
"triggerType" : "PUSH"
}, {
"hash" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
* 06846fd7270fbd0b93149bf524425c0cfd11ffe9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052)
* f30348091539852dec6e86983800517a5ad70204 UNKNOWN
* cc44bc0b5993b34b9269a2e3c3b691dcb7fde549 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1145116436
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
}, {
"hash" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052",
"triggerID" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"triggerType" : "PUSH"
}, {
"hash" : "f30348091539852dec6e86983800517a5ad70204",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f30348091539852dec6e86983800517a5ad70204",
"triggerType" : "PUSH"
}, {
"hash" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9053",
"triggerID" : "cc44bc0b5993b34b9269a2e3c3b691dcb7fde549",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f30348091539852dec6e86983800517a5ad70204 UNKNOWN
* cc44bc0b5993b34b9269a2e3c3b691dcb7fde549 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9053)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] jerryshao commented on a diff in pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
jerryshao commented on code in PR #5738:
URL: https://github.com/apache/hudi/pull/5738#discussion_r889637847
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/DeleteMarkerProcedure.scala:
##########
@@ -0,0 +1,78 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.table.HoodieSparkTable
+import org.apache.hudi.table.marker.WriteMarkersFactory
+import org.apache.spark.internal.Logging
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.util.function.Supplier
+import scala.util.{Failure, Success, Try}
+
+class DeleteMarkerProcedure extends BaseProcedure with ProcedureBuilder with Logging {
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType, None),
+ ProcedureParameter.required(1, "instant_Time", DataTypes.StringType, None)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("delete_marker_result", DataTypes.BooleanType, nullable = true, Metadata.empty))
+ )
+
+ def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ def outputType: StructType = OUTPUT_TYPE
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val instantTime = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[String]
+ val basePath = getBasePath(tableName)
+
+ val result = Try {
+ val client = createHoodieClient(jsc, basePath)
+ val config = client.getConfig
+ val context = client.getEngineContext
+ val table = HoodieSparkTable.create(config, context)
Review Comment:
@XuQianJin-Stars the changes in #5716 remove the refresh mechanism.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144538157
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 30652dbad744c9a55a159750f2bad42726e2204f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
XuQianJin-Stars commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144518855
hi @jerryshao LGTM, When CI is pass.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144768450
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 30652dbad744c9a55a159750f2bad42726e2204f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046)
* 7aab2fa773bf9f87b374fc08f2bae7c1060f6a70 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049)
* 502872e258eb96365474001d6e04ddf193bc16fd UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5738: [HUDI-4168] Add Call Procedure for marker deletion
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5738:
URL: https://github.com/apache/hudi/pull/5738#issuecomment-1144943202
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "30652dbad744c9a55a159750f2bad42726e2204f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9046",
"triggerID" : "30652dbad744c9a55a159750f2bad42726e2204f",
"triggerType" : "PUSH"
}, {
"hash" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9049",
"triggerID" : "7aab2fa773bf9f87b374fc08f2bae7c1060f6a70",
"triggerType" : "PUSH"
}, {
"hash" : "502872e258eb96365474001d6e04ddf193bc16fd",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050",
"triggerID" : "502872e258eb96365474001d6e04ddf193bc16fd",
"triggerType" : "PUSH"
}, {
"hash" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052",
"triggerID" : "06846fd7270fbd0b93149bf524425c0cfd11ffe9",
"triggerType" : "PUSH"
}, {
"hash" : "f30348091539852dec6e86983800517a5ad70204",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f30348091539852dec6e86983800517a5ad70204",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 502872e258eb96365474001d6e04ddf193bc16fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9050)
* 06846fd7270fbd0b93149bf524425c0cfd11ffe9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9052)
* f30348091539852dec6e86983800517a5ad70204 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org