You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/12/12 15:17:26 UTC
[GitHub] [hudi] Zouxxyy opened a new pull request, #7435: [MINOR] Fix parameter parsing in hudi utilities
Zouxxyy opened a new pull request, #7435:
URL: https://github.com/apache/hudi/pull/7435
### Change Logs
Some values may contain '=', such as the partition path, when using --hoodie-conf to add configuration, the verification will fail, for example:
```shell
spark-submit \
--class org.apache.hudi.utilities.HoodieClusteringJob \
hudi-utilities-bundle_2.11-0.12.0.jar \
--mode scheduleAndExecute \
--base-path xxx \
--table-name xxx \
--spark-memory 16g \
--hoodie-conf hoodie.clustering.plan.partition.filter.mode=SELECTED_PARTITIONS \
--hoodie-conf hoodie.clustering.plan.strategy.cluster.begin.partition=ds=2022-12-03/hour=21 \
--hoodie-conf hoodie.clustering.plan.strategy.cluster.end.partition=ds=2022-12-03/hour=21
```
`begin.partition` and `end.partition` will be verified as failed
### Impact
After adding the patch, hudi-utilities supports parsing the value containing '=' when using --hoodie-conf
### Risk level (write none, low medium or high below)
Low
### Documentation Update
None
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7435: [MINOR] Fix parameter parsing in hudi utilities
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7435:
URL: https://github.com/apache/hudi/pull/7435#issuecomment-1373197208
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649",
"triggerID" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"triggerType" : "PUSH"
}, {
"hash" : "245afd94e782ef12f9c70d3cd46b6d7172448852",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14130",
"triggerID" : "245afd94e782ef12f9c70d3cd46b6d7172448852",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 245afd94e782ef12f9c70d3cd46b6d7172448852 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14130)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron merged pull request #7435: [MINOR] Fix parameter parsing in hudi utilities
Posted by GitBox <gi...@apache.org>.
YannByron merged PR #7435:
URL: https://github.com/apache/hudi/pull/7435
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7435: [MINOR] Fix parameter parsing in hudi utilities
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7435:
URL: https://github.com/apache/hudi/pull/7435#issuecomment-1346704218
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649",
"triggerID" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 623c9a693d9056ecb77fa1d28d7e72f0b0d37295 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7435: [MINOR] Fix parameter parsing in hudi utilities
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7435:
URL: https://github.com/apache/hudi/pull/7435#issuecomment-1346692445
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 623c9a693d9056ecb77fa1d28d7e72f0b0d37295 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7435: [MINOR] Fix parameter parsing in hudi utilities
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7435:
URL: https://github.com/apache/hudi/pull/7435#issuecomment-1373102927
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649",
"triggerID" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"triggerType" : "PUSH"
}, {
"hash" : "245afd94e782ef12f9c70d3cd46b6d7172448852",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14130",
"triggerID" : "245afd94e782ef12f9c70d3cd46b6d7172448852",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 623c9a693d9056ecb77fa1d28d7e72f0b0d37295 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649)
* 245afd94e782ef12f9c70d3cd46b6d7172448852 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=14130)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7435: [MINOR] Fix parameter parsing in hudi utilities
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7435:
URL: https://github.com/apache/hudi/pull/7435#issuecomment-1347163029
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649",
"triggerID" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 623c9a693d9056ecb77fa1d28d7e72f0b0d37295 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #7435: [MINOR] Fix parameter parsing in hudi utilities
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #7435:
URL: https://github.com/apache/hudi/pull/7435#issuecomment-1373100332
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649",
"triggerID" : "623c9a693d9056ecb77fa1d28d7e72f0b0d37295",
"triggerType" : "PUSH"
}, {
"hash" : "245afd94e782ef12f9c70d3cd46b6d7172448852",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "245afd94e782ef12f9c70d3cd46b6d7172448852",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 623c9a693d9056ecb77fa1d28d7e72f0b0d37295 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=13649)
* 245afd94e782ef12f9c70d3cd46b6d7172448852 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org