You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/07/19 04:14:18 UTC
[GitHub] [hudi] honeyaya opened a new pull request, #6139: HUDI-4396
honeyaya opened a new pull request, #6139:
URL: https://github.com/apache/hudi/pull/6139
## What is the purpose of the pull request
Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
## Brief change log
- Change module: hudi-hive-sync
## Verify this pull request
This pull request is already covered by existing tests, the default value of the the parameter is true
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1188586770
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3771774bb5c2f3db39d3ebe83e684f3c7ad5052a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1190998057
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0968b22a873c73c77ac5e1709b2d845fd57b1ead Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056)
* 3687a0a01a0d31a6792d95aaf0536706d12fec76 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1188714350
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3771774bb5c2f3db39d3ebe83e684f3c7ad5052a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050)
* 0968b22a873c73c77ac5e1709b2d845fd57b1ead Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] honeyaya closed pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
honeyaya closed pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
URL: https://github.com/apache/hudi/pull/6139
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1188934912
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0968b22a873c73c77ac5e1709b2d845fd57b1ead Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1223858704
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3687a0a01a0d31a6792d95aaf0536706d12fec76 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120)
* a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] honeyaya commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
honeyaya commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1190997734
@yihua could you help me review this pr? thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1188589513
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3771774bb5c2f3db39d3ebe83e684f3c7ad5052a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1191233391
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3687a0a01a0d31a6792d95aaf0536706d12fec76 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] honeyaya commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
honeyaya commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1196220377
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1190995685
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 0968b22a873c73c77ac5e1709b2d845fd57b1ead Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] honeyaya commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
honeyaya commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1190995087
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1228121019
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900",
"triggerID" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"triggerType" : "PUSH"
}, {
"hash" : "41c2a64f85fae05f3794412bb0bf668f5d1adc5c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "41c2a64f85fae05f3794412bb0bf668f5d1adc5c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900)
* 41c2a64f85fae05f3794412bb0bf668f5d1adc5c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1196243388
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 3687a0a01a0d31a6792d95aaf0536706d12fec76 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1228124552
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900",
"triggerID" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"triggerType" : "PUSH"
}, {
"hash" : "41c2a64f85fae05f3794412bb0bf668f5d1adc5c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10971",
"triggerID" : "41c2a64f85fae05f3794412bb0bf668f5d1adc5c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900)
* 41c2a64f85fae05f3794412bb0bf668f5d1adc5c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10971)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1228320272
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900",
"triggerID" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"triggerType" : "PUSH"
}, {
"hash" : "41c2a64f85fae05f3794412bb0bf668f5d1adc5c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10971",
"triggerID" : "41c2a64f85fae05f3794412bb0bf668f5d1adc5c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 41c2a64f85fae05f3794412bb0bf668f5d1adc5c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10971)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1188623271
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3771774bb5c2f3db39d3ebe83e684f3c7ad5052a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050)
* 0968b22a873c73c77ac5e1709b2d845fd57b1ead Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1188620315
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3771774bb5c2f3db39d3ebe83e684f3c7ad5052a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050)
* 0968b22a873c73c77ac5e1709b2d845fd57b1ead UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] honeyaya commented on a diff in pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
honeyaya commented on code in PR #6139:
URL: https://github.com/apache/hudi/pull/6139#discussion_r955694404
##########
hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncConfig.java:
##########
@@ -129,6 +129,8 @@ public static class HiveSyncConfigParams {
public Boolean createManagedTable;
@Parameter(names = {"--batch-sync-num"}, description = "The number of partitions one batch when synchronous partitions to hive")
public Integer batchSyncNum;
+ @Parameter(names = {"--partition-cascade"}, description = "Partition cascade when table columns change.")
+ public Boolean partitionCascade;
Review Comment:
Hi, good idea about the configs settings.
And the logic cascade could not be detected from schema/column changes as far as I think, but the **table parameters** might help set this config in my opinion, then the user needs to create/alter the table with TBLPROPERTIES: "hoodie.datasource.hive_sync.partition_cascade=false" through HiveSQL, and this is not directly to use.
If we compare these two plans, I prefer the original plan, then what's your opinion?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1191000316
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 0968b22a873c73c77ac5e1709b2d845fd57b1ead Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056)
* 3687a0a01a0d31a6792d95aaf0536706d12fec76 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] honeyaya commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
honeyaya commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1190995673
@hudi-bot `run azure`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1196240464
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 3687a0a01a0d31a6792d95aaf0536706d12fec76 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1223863942
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900",
"triggerID" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3687a0a01a0d31a6792d95aaf0536706d12fec76 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120)
* a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #6139:
URL: https://github.com/apache/hudi/pull/6139#discussion_r955237307
##########
hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncConfig.java:
##########
@@ -129,6 +129,8 @@ public static class HiveSyncConfigParams {
public Boolean createManagedTable;
@Parameter(names = {"--batch-sync-num"}, description = "The number of partitions one batch when synchronous partitions to hive")
public Integer batchSyncNum;
+ @Parameter(names = {"--partition-cascade"}, description = "Partition cascade when table columns change.")
+ public Boolean partitionCascade;
Review Comment:
in general we should avoid adding parameters/configs to tweak the logic inside the sync. There are so many configs already exposing the impl. details and making meta sync hard to use.
For this logic of determining cascade, can you figure out a way to detect it from schema/column changes?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6139: [HUDI-4396] Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6139:
URL: https://github.com/apache/hudi/pull/6139#issuecomment-1224092856
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10050",
"triggerID" : "3771774bb5c2f3db39d3ebe83e684f3c7ad5052a",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"triggerType" : "PUSH"
}, {
"hash" : "0968b22a873c73c77ac5e1709b2d845fd57b1ead",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10056",
"triggerID" : "1190995087",
"triggerType" : "MANUAL"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"triggerType" : "PUSH"
}, {
"hash" : "3687a0a01a0d31a6792d95aaf0536706d12fec76",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10120",
"triggerID" : "1196220377",
"triggerType" : "MANUAL"
}, {
"hash" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900",
"triggerID" : "a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a9e86bb7588ad10579e2ef02a0e41f1ce661aeaa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10900)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org