You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/08/18 15:15:55 UTC
[GitHub] [hudi] nsivabalan opened a new pull request, #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
nsivabalan opened a new pull request, #6438:
URL: https://github.com/apache/hudi/pull/6438
### Change Logs
- Adding support to hudi-cli to repair deprecated partition. Until 0.12, fallback partition in hudi (if partition path value is null for a record), is "default". From 0.12, we have switched to "__HIVE_DEFAULT_PARTITION__". This cli support will assist users to rewrite data from the deprecated partition to "__HIVE_DEFAULT_PARTITION__" partition.
### Impact
Not sure how many have these sentinel partitions. So, may not be high for sure.
**Risk level: Low -> Medium.
_Choose one. If medium or high, explain what verification was done to mitigate the risks._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1227897904
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fea65135a8035ef70929759594da64dc985a2d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924)
* 9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1219737336
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1228037192
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1226069262
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810)
* fea65135a8035ef70929759594da64dc985a2d0a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1231756607
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "1231748436",
"triggerType" : "MANUAL"
}, {
"hash" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964)
* 552036203bc97b51514108ebc800cf5e8b7488e8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1226064753
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810)
* fea65135a8035ef70929759594da64dc985a2d0a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1231822258
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "1231748436",
"triggerType" : "MANUAL"
}, {
"hash" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054",
"triggerID" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964)
* 552036203bc97b51514108ebc800cf5e8b7488e8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on code in PR #6438:
URL: https://github.com/apache/hudi/pull/6438#discussion_r953460424
##########
hudi-cli/src/main/java/org/apache/hudi/cli/commands/RepairsCommand.java:
##########
@@ -263,4 +264,30 @@ public String migratePartitionMeta(
HoodieTableHeaderFields.HEADER_ACTION
}, rows);
}
+
+ @CliCommand(value = "repair deprecated partition",
+ help = "Repair deprecated partition (\"default\"). Re-writes data from the deprecated partition into " + PartitionPathEncodeUtils.DEFAULT_PARTITION_PATH)
Review Comment:
sg. will prioritize landing this and then adding more enchancements.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair deprecated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1234586705
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "1231748436",
"triggerType" : "MANUAL"
}, {
"hash" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054",
"triggerID" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"triggerType" : "PUSH"
}, {
"hash" : "fe4a6c683309bd075afc39cfa0ffbd79c7600e8e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fe4a6c683309bd075afc39cfa0ffbd79c7600e8e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 552036203bc97b51514108ebc800cf5e8b7488e8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054)
* fe4a6c683309bd075afc39cfa0ffbd79c7600e8e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a diff in pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
codope commented on code in PR #6438:
URL: https://github.com/apache/hudi/pull/6438#discussion_r950118698
##########
hudi-cli/src/main/java/org/apache/hudi/cli/commands/RepairsCommand.java:
##########
@@ -263,4 +264,30 @@ public String migratePartitionMeta(
HoodieTableHeaderFields.HEADER_ACTION
}, rows);
}
+
+ @CliCommand(value = "repair deprecated partition",
+ help = "Repair deprecated partition (\"default\"). Re-writes data from the deprecated partition into " + PartitionPathEncodeUtils.DEFAULT_PARTITION_PATH)
Review Comment:
HUDI-4648 for followup. Just in case if we want to land this first because some users might hit this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1226132397
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fea65135a8035ef70929759594da64dc985a2d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a diff in pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
codope commented on code in PR #6438:
URL: https://github.com/apache/hudi/pull/6438#discussion_r949841206
##########
hudi-cli/src/main/java/org/apache/hudi/cli/commands/RepairsCommand.java:
##########
@@ -263,4 +264,30 @@ public String migratePartitionMeta(
HoodieTableHeaderFields.HEADER_ACTION
}, rows);
}
+
+ @CliCommand(value = "repair deprecated partition",
+ help = "Repair deprecated partition (\"default\"). Re-writes data from the deprecated partition into " + PartitionPathEncodeUtils.DEFAULT_PARTITION_PATH)
Review Comment:
Overall looks good. But if we consider more generally, the functionality can essentially be used to rename partitions. So how about making it more like `mv <old_partition> <new_partition>` command?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair deprecated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1234592787
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "1231748436",
"triggerType" : "MANUAL"
}, {
"hash" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054",
"triggerID" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"triggerType" : "PUSH"
}, {
"hash" : "fe4a6c683309bd075afc39cfa0ffbd79c7600e8e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11094",
"triggerID" : "fe4a6c683309bd075afc39cfa0ffbd79c7600e8e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 552036203bc97b51514108ebc800cf5e8b7488e8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054)
* fe4a6c683309bd075afc39cfa0ffbd79c7600e8e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11094)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair deprecated partition
Posted by GitBox <gi...@apache.org>.
nsivabalan merged PR #6438:
URL: https://github.com/apache/hudi/pull/6438
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1232238086
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "1231748436",
"triggerType" : "MANUAL"
}, {
"hash" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054",
"triggerID" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 552036203bc97b51514108ebc800cf5e8b7488e8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair deprecated partition
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1234854465
CI is green.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1219676957
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1227900600
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fea65135a8035ef70929759594da64dc985a2d0a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924)
* 9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair deprecated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1234723451
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "1231748436",
"triggerType" : "MANUAL"
}, {
"hash" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11054",
"triggerID" : "552036203bc97b51514108ebc800cf5e8b7488e8",
"triggerType" : "PUSH"
}, {
"hash" : "fe4a6c683309bd075afc39cfa0ffbd79c7600e8e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11094",
"triggerID" : "fe4a6c683309bd075afc39cfa0ffbd79c7600e8e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fe4a6c683309bd075afc39cfa0ffbd79c7600e8e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11094)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1231749281
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
}, {
"hash" : "fea65135a8035ef70929759594da64dc985a2d0a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10924",
"triggerID" : "fea65135a8035ef70929759594da64dc985a2d0a",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964",
"triggerID" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"triggerType" : "PUSH"
}, {
"hash" : "9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1231748436",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 9cf4d2a70b355cdaa5463fc34ce72908cb5a8da3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10964)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1231748436
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6438: [HUDI-4642] Adding support to hudi-cli to repair depcrated partition
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6438:
URL: https://github.com/apache/hudi/pull/6438#issuecomment-1219682222
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810",
"triggerID" : "6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6e3fa8ca9ca7f5a72bfd9d8c4874183b9ff64586 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10810)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org