You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/08 08:27:45 UTC
[GitHub] [hudi] huberylee opened a new pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
huberylee opened a new pull request #4982:
URL: https://github.com/apache/hudi/pull/4982
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
Refactor `HoodieCommonUtils` to make code more reasonable
## Brief change log
- Move some codes brought by https://github.com/apache/hudi/pull/4901 back to `SparkHoodieTableFileIndex`, `BaseHoodieTableFileIndex` and `HoodieFileIndex`
- Move `resolveFilterExpr` method to `DataSkippingUtils`
- Rename `HoodieCommonUtils` to `HoodieCLIUtils`
- Using `HoodieFileIndex` to adapt partition pruning in `RunClusteringProcedure`
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063812043
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
* a63a357482f9740b4449dde375891d21dcaaa2d4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1065024812
> @huberylee thanks for cleaning things up!
@alexeykudinkin All comments have been addressed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061608879
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua merged pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
yihua merged pull request #4982:
URL: https://github.com/apache/hudi/pull/4982
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on a change in pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on a change in pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#discussion_r823278371
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/SparkHoodieTableFileIndex.scala
##########
@@ -110,16 +140,111 @@ class SparkHoodieTableFileIndex(spark: SparkSession,
*/
def listFileSlices(partitionFilters: Seq[Expression]): Map[String, Seq[FileSlice]] = {
// Prune the partition path by the partition filters
- val prunedPartitions = HoodieCommonUtils.prunePartition(partitionSchema,
- cachedAllInputFileSlices.asScala.keys.toSeq, partitionFilters)
+ val prunedPartitions = prunePartition(cachedAllInputFileSlices.asScala.keys.toSeq, partitionFilters)
prunedPartitions.map(partition => {
(partition.path, cachedAllInputFileSlices.get(partition).asScala)
}).toMap
}
+ /**
+ * Prune the partition by the filter.This implementation is fork from
+ * org.apache.spark.sql.execution.datasources.PartitioningAwareFileIndex#prunePartitions.
+ *
+ * @param partitionPaths All the partition paths.
+ * @param predicates The filter condition.
+ * @return The Pruned partition paths.
+ */
+ def prunePartition(partitionPaths: Seq[PartitionPath], predicates: Seq[Expression]): Seq[PartitionPath] = {
+ val partitionColumnNames = partitionSchema.fields.map(_.name).toSet
+ val partitionPruningPredicates = predicates.filter {
+ _.references.map(_.name).toSet.subsetOf(partitionColumnNames)
+ }
+ if (partitionPruningPredicates.nonEmpty) {
+ val predicate = partitionPruningPredicates.reduce(expressions.And)
+
+ val boundPredicate = InterpretedPredicate(predicate.transform {
+ case a: AttributeReference =>
+ val index = partitionSchema.indexWhere(a.name == _.name)
+ BoundReference(index, partitionSchema(index).dataType, nullable = true)
+ })
+
+ val prunedPartitionPaths = partitionPaths.filter {
+ partitionPath => boundPredicate.eval(InternalRow.fromSeq(partitionPath.values))
+ }
+
+ logInfo(s"Total partition size is: ${partitionPaths.size}," +
+ s" after partition prune size is: ${prunedPartitionPaths.size}")
+ prunedPartitionPaths
+ } else {
+ partitionPaths
+ }
+ }
+
protected def parsePartitionColumnValues(partitionColumns: Array[String], partitionPath: String): Array[Object] = {
- HoodieCommonUtils.parsePartitionColumnValues(sparkParsePartitionUtil, configProperties,
- basePath, partitionSchema, partitionColumns, partitionPath)
+ if (partitionColumns.length == 0) {
Review comment:
Yes, I just moving this code back with no additional changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063809564
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
* a63a357482f9740b4449dde375891d21dcaaa2d4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061600652
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061876968
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063948824
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63a357482f9740b4449dde375891d21dcaaa2d4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783)
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064678024
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
* 282ca401f8e2a93d7703f592041b854959291d41 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061785592
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697)
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063948824
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63a357482f9740b4449dde375891d21dcaaa2d4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783)
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061756084
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064716336
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061782998
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697)
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063945730
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63a357482f9740b4449dde375891d21dcaaa2d4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783)
* b59fae15f49b2488f89be85a202f999570a7272a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061880128
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064816693
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817",
"triggerID" : "1064734145",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064816693
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817",
"triggerID" : "1064734145",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064820630
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817",
"triggerID" : "1064734145",
"triggerType" : "MANUAL"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6827",
"triggerID" : "1064819324",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6827)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064734145
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062488092
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#discussion_r823040893
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
Review comment:
Let's create `HoodieCatalystExpressionUtils` and move `resolveFilterExpr` in there
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
+ hoodieFileIndex.partitionSchema)
+ val predicates = splitPredicates(partitionPredicate)
+ checkArgument(predicates._1.isEmpty, "Disjunctive predicate is not supported")
+
+ // Get all partitions and prune partition by predicates
+ val partitionPaths = hoodieFileIndex.getAllCachedPartitionPaths.asScala.toSeq
+ val prunedPartitions = hoodieFileIndex.prunePartition(partitionPaths, predicates._2)
Review comment:
Instead of invoking pruning here directly, let's encapsulate pruning w/in the Index itself and then expose following API
```
class SparkHoodieTableFileIndex {
def getPartitionPaths(List<Expression> predicates): Seq[PartitionPath] = {
// prune internally
}
}
```
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/SparkHoodieTableFileIndex.scala
##########
@@ -110,16 +140,111 @@ class SparkHoodieTableFileIndex(spark: SparkSession,
*/
def listFileSlices(partitionFilters: Seq[Expression]): Map[String, Seq[FileSlice]] = {
// Prune the partition path by the partition filters
- val prunedPartitions = HoodieCommonUtils.prunePartition(partitionSchema,
- cachedAllInputFileSlices.asScala.keys.toSeq, partitionFilters)
+ val prunedPartitions = prunePartition(cachedAllInputFileSlices.asScala.keys.toSeq, partitionFilters)
prunedPartitions.map(partition => {
(partition.path, cachedAllInputFileSlices.get(partition).asScala)
}).toMap
}
+ /**
+ * Prune the partition by the filter.This implementation is fork from
+ * org.apache.spark.sql.execution.datasources.PartitioningAwareFileIndex#prunePartitions.
+ *
+ * @param partitionPaths All the partition paths.
+ * @param predicates The filter condition.
+ * @return The Pruned partition paths.
+ */
+ def prunePartition(partitionPaths: Seq[PartitionPath], predicates: Seq[Expression]): Seq[PartitionPath] = {
Review comment:
Please check my comment above, and let's make this method private
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
+ hoodieFileIndex.partitionSchema)
+ val predicates = splitPredicates(partitionPredicate)
Review comment:
And there's actually util doing what you need `splitPartitionAndDataPredicates`
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
+ hoodieFileIndex.partitionSchema)
+ val predicates = splitPredicates(partitionPredicate)
Review comment:
I see that we're splitting but we don't separate b/w Data filters and Partition filters
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
+ hoodieFileIndex.partitionSchema)
+ val predicates = splitPredicates(partitionPredicate)
+ checkArgument(predicates._1.isEmpty, "Disjunctive predicate is not supported")
+
+ // Get all partitions and prune partition by predicates
+ val partitionPaths = hoodieFileIndex.getAllCachedPartitionPaths.asScala.toSeq
+ val prunedPartitions = hoodieFileIndex.prunePartition(partitionPaths, predicates._2)
+ prunedPartitions.map(partitionPath => partitionPath.getPath).toSet.mkString(",")
+ }
- // Filter partition by predicates
- val selectedPartitions = HoodieCommonUtils.prunePartition(
- partitionSchema, partitionPaths, partitionPredicate)
- selectedPartitions.map(partitionPath => partitionPath.getPath).toSet.mkString(",")
+ /**
+ * Split predicate to disjunctive predicates and conjunctive predicates
+ *
+ * @param condition Predicate to be split
+ * @return The pair of disjunctive predicates and conjunctive predicates
+ */
+ private def splitPredicates(condition: Expression): (Seq[Expression], Seq[Expression]) = {
+ condition match {
Review comment:
Please check my comment above regarding splitting
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/SparkHoodieTableFileIndex.scala
##########
@@ -110,16 +140,111 @@ class SparkHoodieTableFileIndex(spark: SparkSession,
*/
def listFileSlices(partitionFilters: Seq[Expression]): Map[String, Seq[FileSlice]] = {
// Prune the partition path by the partition filters
- val prunedPartitions = HoodieCommonUtils.prunePartition(partitionSchema,
- cachedAllInputFileSlices.asScala.keys.toSeq, partitionFilters)
+ val prunedPartitions = prunePartition(cachedAllInputFileSlices.asScala.keys.toSeq, partitionFilters)
prunedPartitions.map(partition => {
(partition.path, cachedAllInputFileSlices.get(partition).asScala)
}).toMap
}
+ /**
+ * Prune the partition by the filter.This implementation is fork from
+ * org.apache.spark.sql.execution.datasources.PartitioningAwareFileIndex#prunePartitions.
+ *
+ * @param partitionPaths All the partition paths.
+ * @param predicates The filter condition.
+ * @return The Pruned partition paths.
+ */
+ def prunePartition(partitionPaths: Seq[PartitionPath], predicates: Seq[Expression]): Seq[PartitionPath] = {
+ val partitionColumnNames = partitionSchema.fields.map(_.name).toSet
+ val partitionPruningPredicates = predicates.filter {
+ _.references.map(_.name).toSet.subsetOf(partitionColumnNames)
+ }
+ if (partitionPruningPredicates.nonEmpty) {
+ val predicate = partitionPruningPredicates.reduce(expressions.And)
+
+ val boundPredicate = InterpretedPredicate(predicate.transform {
+ case a: AttributeReference =>
+ val index = partitionSchema.indexWhere(a.name == _.name)
+ BoundReference(index, partitionSchema(index).dataType, nullable = true)
+ })
+
+ val prunedPartitionPaths = partitionPaths.filter {
+ partitionPath => boundPredicate.eval(InternalRow.fromSeq(partitionPath.values))
+ }
+
+ logInfo(s"Total partition size is: ${partitionPaths.size}," +
+ s" after partition prune size is: ${prunedPartitionPaths.size}")
+ prunedPartitionPaths
+ } else {
+ partitionPaths
+ }
+ }
+
protected def parsePartitionColumnValues(partitionColumns: Array[String], partitionPath: String): Array[Object] = {
- HoodieCommonUtils.parsePartitionColumnValues(sparkParsePartitionUtil, configProperties,
- basePath, partitionSchema, partitionColumns, partitionPath)
+ if (partitionColumns.length == 0) {
Review comment:
You just moving this code back, right? There's no additional changes, are there?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063839394
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
* a63a357482f9740b4449dde375891d21dcaaa2d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062520553
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063787416
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062489577
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061693133
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061785592
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697)
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061756084
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062489577
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061530032
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061982999
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063785349
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063945730
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63a357482f9740b4449dde375891d21dcaaa2d4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783)
* b59fae15f49b2488f89be85a202f999570a7272a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063839394
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
* a63a357482f9740b4449dde375891d21dcaaa2d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064734674
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817",
"triggerID" : "1064734145",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063785349
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064311801
@huberylee thanks for cleaning things up!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064177884
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061530032
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061782998
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697)
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061858906
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064678024
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
* 282ca401f8e2a93d7703f592041b854959291d41 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064716336
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061610766
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061976408
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062520553
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061976408
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061610766
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#discussion_r823966064
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/HoodieCatalystExpressionUtils.scala
##########
@@ -0,0 +1,89 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.spark.sql.hudi
Review comment:
Please move it to `org.apache.spark.sql` (so that we can access some package-private APIs)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064679369
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on a change in pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on a change in pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#discussion_r823451855
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
+ hoodieFileIndex.partitionSchema)
+ val predicates = splitPredicates(partitionPredicate)
Review comment:
Already use `HoodieDataSourceHelper#splitPartitionAndDataPredicates` method to split Data filters and Partition filters, and adding more tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063809564
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
* a63a357482f9740b4449dde375891d21dcaaa2d4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061527790
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061880128
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061876968
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062488092
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062075663
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061755250
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1062075663
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061984844
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061526962
@alexeykudinkin Could you help me to review this pr? Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061693133
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061527790
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061600652
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061858906
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ebf4d6c7bb25981d52c8dc822071ed47bd3b042c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061984844
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* dc60b26f8dfc256c078b0e37639a7dfbbf3f1217 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on a change in pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on a change in pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#discussion_r823276254
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
Review comment:
Done
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala
##########
@@ -120,37 +113,45 @@ class RunClusteringProcedure extends BaseProcedure with ProcedureBuilder with Sp
override def build: Procedure = new RunClusteringProcedure()
- def prunePartition(metaClient: HoodieTableMetaClient, partitionPredicate: Expression): String = {
- val partitionSchema = HoodieCommonUtils.getPartitionSchemaFromProperty(metaClient, None)
-
- // Get tableName meta data
- val engineContext = new HoodieSparkEngineContext(new JavaSparkContext(sparkSession.sparkContext))
- val properties = new Properties()
- properties.putAll(JavaConverters.mapAsJavaMapConverter(sparkSession.sessionState.conf.getAllConfs).asJava)
- val metadataConfig = HoodieMetadataConfig.newBuilder().fromProperties(properties).build()
- val tableMetadata = HoodieTableMetadata.create(engineContext, metadataConfig, metaClient.getBasePath,
- FileSystemViewStorageConfig.SPILLABLE_DIR.defaultValue)
-
- val sparkParsePartitionUtil = sparkAdapter.createSparkParsePartitionUtil(sparkSession.sessionState.conf)
- val typedProperties = HoodieCommonUtils.getConfigProperties(sparkSession, Map.empty)
-
- val partitionColumns = metaClient.getTableConfig.getPartitionFields.orElse(Array[String]())
-
- // Translate all partition path to {@code org.apache.hudi.BaseHoodieTableFileIndex.PartitionPath}
- val partitionPaths = tableMetadata.getAllPartitionPaths.asScala.map(partitionPath => {
- val partitionColumnValues = HoodieCommonUtils.parsePartitionColumnValues(
- sparkParsePartitionUtil, typedProperties, metaClient.getBasePath,
- partitionSchema, partitionColumns, partitionPath)
- new PartitionPath(partitionPath, partitionColumnValues)
- })
+ def prunePartition(metaClient: HoodieTableMetaClient, predicate: String): String = {
+ val options = Map(QUERY_TYPE.key() -> QUERY_TYPE_SNAPSHOT_OPT_VAL, "path" -> metaClient.getBasePath)
+ val hoodieFileIndex = HoodieFileIndex(sparkSession, metaClient, None, options,
+ FileStatusCache.getOrCreate(sparkSession))
+
+ // Resolve partition predicates, only conjunctive predicates are supported
+ val partitionPredicate = DataSkippingUtils.resolveFilterExpr(sparkSession, predicate,
+ hoodieFileIndex.partitionSchema)
+ val predicates = splitPredicates(partitionPredicate)
+ checkArgument(predicates._1.isEmpty, "Disjunctive predicate is not supported")
+
+ // Get all partitions and prune partition by predicates
+ val partitionPaths = hoodieFileIndex.getAllCachedPartitionPaths.asScala.toSeq
+ val prunedPartitions = hoodieFileIndex.prunePartition(partitionPaths, predicates._2)
Review comment:
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063787416
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716)
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1063812043
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a51a44ee1d22bce8c88630d2307dcac4d0ba4d68 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778)
* a63a357482f9740b4449dde375891d21dcaaa2d4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064177884
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064679369
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b59fae15f49b2488f89be85a202f999570a7272a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792)
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064734674
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817",
"triggerID" : "1064734145",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064820630
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817",
"triggerID" : "1064734145",
"triggerType" : "MANUAL"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6827",
"triggerID" : "1064819324",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6827)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
huberylee commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064819324
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4982:
URL: https://github.com/apache/hudi/pull/4982#issuecomment-1064953069
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6689",
"triggerID" : "b93d81349a970391fe8baff27130a322a0af8516",
"triggerType" : "PUSH"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6693",
"triggerID" : "1061608879",
"triggerType" : "MANUAL"
}, {
"hash" : "b93d81349a970391fe8baff27130a322a0af8516",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6697",
"triggerID" : "1061755250",
"triggerType" : "MANUAL"
}, {
"hash" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6698",
"triggerID" : "ebf4d6c7bb25981d52c8dc822071ed47bd3b042c",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6703",
"triggerID" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"triggerType" : "PUSH"
}, {
"hash" : "dc60b26f8dfc256c078b0e37639a7dfbbf3f1217",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6707",
"triggerID" : "1061982999",
"triggerType" : "MANUAL"
}, {
"hash" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6716",
"triggerID" : "c9dd2d8bd2879c49b6bf4d6807000c05dae16fb7",
"triggerType" : "PUSH"
}, {
"hash" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6778",
"triggerID" : "a51a44ee1d22bce8c88630d2307dcac4d0ba4d68",
"triggerType" : "PUSH"
}, {
"hash" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6783",
"triggerID" : "a63a357482f9740b4449dde375891d21dcaaa2d4",
"triggerType" : "PUSH"
}, {
"hash" : "b59fae15f49b2488f89be85a202f999570a7272a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6792",
"triggerID" : "b59fae15f49b2488f89be85a202f999570a7272a",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805",
"triggerID" : "282ca401f8e2a93d7703f592041b854959291d41",
"triggerType" : "PUSH"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817",
"triggerID" : "1064734145",
"triggerType" : "MANUAL"
}, {
"hash" : "282ca401f8e2a93d7703f592041b854959291d41",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6827",
"triggerID" : "1064819324",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 282ca401f8e2a93d7703f592041b854959291d41 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6805) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6817) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6827)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org