You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "fhan688 (via GitHub)" <gi...@apache.org> on 2025/08/25 12:59:28 UTC
[PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
fhan688 opened a new pull request, #13761:
URL: https://github.com/apache/hudi/pull/13761
### Change Logs
this PR supports specifying regex config in RunClusteringProcedure to choose partitions.
### Impact
hudi-spark-datasource
### Risk level (write none, low medium or high below)
low
### Documentation Update
### Contributor's checklist
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3220185747
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 48d2d31711792c5850b6f9e3a9bba95435965523 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3232125919
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3232117955",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3228040822
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 48d2d31711792c5850b6f9e3a9bba95435965523 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099)
* bc7f940dbe98f427c4b9dc8ab941f3afe1439419 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3231707018
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* bc7f940dbe98f427c4b9dc8ab941f3afe1439419 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176)
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3243525258
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3232117955",
"triggerType" : "MANUAL"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3233342189",
"triggerType" : "MANUAL"
}, {
"hash" : "472514557cd0a78d7eb69654f92e57886ccbb150",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8295",
"triggerID" : "472514557cd0a78d7eb69654f92e57886ccbb150",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
* 472514557cd0a78d7eb69654f92e57886ccbb150 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8295)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3243623655
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3232117955",
"triggerType" : "MANUAL"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3233342189",
"triggerType" : "MANUAL"
}, {
"hash" : "472514557cd0a78d7eb69654f92e57886ccbb150",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8295",
"triggerID" : "472514557cd0a78d7eb69654f92e57886ccbb150",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 472514557cd0a78d7eb69654f92e57886ccbb150 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8295)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3233349055
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3232117955",
"triggerType" : "MANUAL"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3233342189",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "zhangyue19921010 (via GitHub)" <gi...@apache.org>.
zhangyue19921010 commented on code in PR #13761:
URL: https://github.com/apache/hudi/pull/13761#discussion_r2302768931
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala:
##########
@@ -59,7 +59,8 @@ class RunClusteringProcedure extends BaseProcedure
ProcedureParameter.optional(7, "options", DataTypes.StringType),
ProcedureParameter.optional(8, "instants", DataTypes.StringType),
ProcedureParameter.optional(9, "selected_partitions", DataTypes.StringType),
- ProcedureParameter.optional(10, "limit", DataTypes.IntegerType)
+ ProcedureParameter.optional(10, "selected_partitions_reg", DataTypes.StringType),
Review Comment:
nit: selected_partitions_reg -> partition_regex_pattern, aline with the config name in HoodieClusteringConfig
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3233356526
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3232117955",
"triggerType" : "MANUAL"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3233342189",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3220518817
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 48d2d31711792c5850b6f9e3a9bba95435965523 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3228050025
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 48d2d31711792c5850b6f9e3a9bba95435965523 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099)
* bc7f940dbe98f427c4b9dc8ab941f3afe1439419 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3232136303
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3232117955",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3231820473
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3231711866
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* bc7f940dbe98f427c4b9dc8ab941f3afe1439419 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176)
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3220178077
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 48d2d31711792c5850b6f9e3a9bba95435965523 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "zhangyue19921010 (via GitHub)" <gi...@apache.org>.
zhangyue19921010 merged PR #13761:
URL: https://github.com/apache/hudi/pull/13761
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3243523290
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"triggerType" : "PUSH"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3232117955",
"triggerType" : "MANUAL"
}, {
"hash" : "66c1b310acc51cdb156f7bf5a7cce87c136ada3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195",
"triggerID" : "3233342189",
"triggerType" : "MANUAL"
}, {
"hash" : "472514557cd0a78d7eb69654f92e57886ccbb150",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "472514557cd0a78d7eb69654f92e57886ccbb150",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 66c1b310acc51cdb156f7bf5a7cce87c136ada3a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8195)
* 472514557cd0a78d7eb69654f92e57886ccbb150 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "zhangyue19921010 (via GitHub)" <gi...@apache.org>.
zhangyue19921010 commented on code in PR #13761:
URL: https://github.com/apache/hudi/pull/13761#discussion_r2302768931
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/RunClusteringProcedure.scala:
##########
@@ -59,7 +59,8 @@ class RunClusteringProcedure extends BaseProcedure
ProcedureParameter.optional(7, "options", DataTypes.StringType),
ProcedureParameter.optional(8, "instants", DataTypes.StringType),
ProcedureParameter.optional(9, "selected_partitions", DataTypes.StringType),
- ProcedureParameter.optional(10, "limit", DataTypes.IntegerType)
+ ProcedureParameter.optional(10, "selected_partitions_reg", DataTypes.StringType),
Review Comment:
nit: selected_partitions_reg -> partition_regex_pattern, consistent with the config name in HoodieClusteringConfig
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3228189662
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8099",
"triggerID" : "48d2d31711792c5850b6f9e3a9bba95435965523",
"triggerType" : "PUSH"
}, {
"hash" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176",
"triggerID" : "bc7f940dbe98f427c4b9dc8ab941f3afe1439419",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* bc7f940dbe98f427c4b9dc8ab941f3afe1439419 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8176)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "fhan688 (via GitHub)" <gi...@apache.org>.
fhan688 commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3232117955
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "fhan688 (via GitHub)" <gi...@apache.org>.
fhan688 commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3233342189
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-9703] Support Regex Config in RunClusteringProcedure [hudi]
Posted by "zhangyue19921010 (via GitHub)" <gi...@apache.org>.
zhangyue19921010 commented on PR #13761:
URL: https://github.com/apache/hudi/pull/13761#issuecomment-3235563946
`TestHoodieDeltaStreamer.testBulkInsertRowWriterContinuousModeWithAsyncClustering` keep failing. PTAL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org