You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/07/01 01:59:39 UTC
[GitHub] [hudi] xiarixiaoyao opened a new pull request, #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields an…
xiarixiaoyao opened a new pull request, #6017:
URL: https://github.com/apache/hudi/pull/6017
…d add new fields.
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
Improve schema reconciliation to make it more flexible in presence of full schema evolution being enabled.
Desired behavior:
1) incoming data has missing columns that were already defined in the table –> null values will be injected into missing columns
2) incoming data contains new columns not defined yet in the table -> columns will be added to the table schema (incoming dataframe?)
3) incoming data has missing columns that are already defined in the table and new columns not yet defined in the table -> new columns will be added to the table schema, missing columns will be injected with null values
4) No column should be dropped when using hive sync utility when schema reconciliation is enabled.
5) support nested fields.
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
UT test
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1179177388
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178662763",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178691528",
"triggerType" : "MANUAL"
}, {
"hash" : "096cf9e861a5589ee57da2bc95e4e4cb28828431",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9788",
"triggerID" : "096cf9e861a5589ee57da2bc95e4e4cb28828431",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* 096cf9e861a5589ee57da2bc95e4e4cb28828431 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9788)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1171884433
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d03a0ee0695a640fcf0cbb3b6c074227415f06b5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658)
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 404cb3aff6702fbff66a6d8b37115c3650b75eca UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178691528
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao merged pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao merged PR #6017:
URL: https://github.com/apache/hudi/pull/6017
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] weimingdiit commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by "weimingdiit (via GitHub)" <gi...@apache.org>.
weimingdiit commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1661601755
@xiarixiaoyao Does this pr only support dataframe ? Does it support spark sql?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1177836741
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178736414
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178662763",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178691528",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1174712573
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 404cb3aff6702fbff66a6d8b37115c3650b75eca Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661)
* d98c0e31e8d401014fe7338207e45879e5828f99 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1175294900
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* 26f78b05748846a5724c2153d52a695cba641759 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1177708225
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1179284265
ci passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178692017
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178662763",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1178691528",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1175158251
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* d98c0e31e8d401014fe7338207e45879e5828f99 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726)
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* 26f78b05748846a5724c2153d52a695cba641759 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178802903
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178662763",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178691528",
"triggerType" : "MANUAL"
}, {
"hash" : "096cf9e861a5589ee57da2bc95e4e4cb28828431",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "096cf9e861a5589ee57da2bc95e4e4cb28828431",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
* 096cf9e861a5589ee57da2bc95e4e4cb28828431 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1171886617
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d03a0ee0695a640fcf0cbb3b6c074227415f06b5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658)
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 404cb3aff6702fbff66a6d8b37115c3650b75eca Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1171916374
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 404cb3aff6702fbff66a6d8b37115c3650b75eca Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1175730234
@leesf fixed the comment and UT. could you pls help review again, thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1177357708
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* 26f78b05748846a5724c2153d52a695cba641759 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732)
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1175153262
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* d98c0e31e8d401014fe7338207e45879e5828f99 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726)
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] leesf commented on a diff in pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
leesf commented on code in PR #6017:
URL: https://github.com/apache/hudi/pull/6017#discussion_r912308590
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java:
##########
@@ -276,15 +276,21 @@ private void saveInternalSchema(HoodieTable table, String instantTime, HoodieCom
TableSchemaResolver schemaUtil = new TableSchemaResolver(table.getMetaClient());
String historySchemaStr = schemaUtil.getTableHistorySchemaStrFromCommitMetadata().orElse("");
FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(table.getMetaClient());
- if (!historySchemaStr.isEmpty()) {
- InternalSchema internalSchema = InternalSchemaUtils.searchSchema(Long.parseLong(instantTime),
- SerDeHelper.parseSchemas(historySchemaStr));
+ if (!historySchemaStr.isEmpty() || Boolean.parseBoolean(config.getString("hoodie.datasource.write.reconcile.schema"))) {
Review Comment:
would use RECONCILE_SCHEMA.key() to replace the `"hoodie.datasource.write.reconcile.schema"`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178679504
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178662763",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1174767563
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 404cb3aff6702fbff66a6d8b37115c3650b75eca Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661)
* d98c0e31e8d401014fe7338207e45879e5828f99 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1175163203
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* d98c0e31e8d401014fe7338207e45879e5828f99 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726)
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* 26f78b05748846a5724c2153d52a695cba641759 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #6017:
URL: https://github.com/apache/hudi/pull/6017#discussion_r956400078
##########
hudi-client/hudi-spark-client/src/main/scala/org/apache/hudi/HoodieSparkUtils.scala:
##########
@@ -162,11 +163,11 @@ object HoodieSparkUtils extends SparkAdapterSupport {
if (rows.isEmpty) {
Iterator.empty
} else {
+ val readerAvroSchema = new Schema.Parser().parse(readerAvroSchemaStr)
val transform: GenericRecord => GenericRecord =
if (sameSchema) identity
else {
- val readerAvroSchema = new Schema.Parser().parse(readerAvroSchemaStr)
- rewriteRecord(_, readerAvroSchema)
Review Comment:
BTW, one miss for the new API is that previously `rewriteRecord` was validating that the record adheres to the new schema while new method doesn't do that (this obscures the issues when conversion is not following Avro evolution rules)
##########
hudi-client/hudi-spark-client/src/main/scala/org/apache/hudi/HoodieSparkUtils.scala:
##########
@@ -162,11 +163,11 @@ object HoodieSparkUtils extends SparkAdapterSupport {
if (rows.isEmpty) {
Iterator.empty
} else {
+ val readerAvroSchema = new Schema.Parser().parse(readerAvroSchemaStr)
val transform: GenericRecord => GenericRecord =
if (sameSchema) identity
else {
- val readerAvroSchema = new Schema.Parser().parse(readerAvroSchemaStr)
- rewriteRecord(_, readerAvroSchema)
Review Comment:
@xiarixiaoyao since we're changing this, shall we also revisit all the other places that use `rewriteRecord` and consider rebasing them onto the new methods?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178675330
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1178662763",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1177303983
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* 26f78b05748846a5724c2153d52a695cba641759 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732)
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1171852778
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d03a0ee0695a640fcf0cbb3b6c074227415f06b5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658)
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1177910863
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178662763
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1177841150
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1178806870
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
}, {
"hash" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65d15683ec3b8084330a6df7e121ca4218b83b2f",
"triggerType" : "PUSH"
}, {
"hash" : "26f78b05748846a5724c2153d52a695cba641759",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9732",
"triggerID" : "26f78b05748846a5724c2153d52a695cba641759",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"triggerType" : "PUSH"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1177836741",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178662763",
"triggerType" : "MANUAL"
}, {
"hash" : "dd5bce9cad8c64f5afb7d31663e9f281eee866c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763",
"triggerID" : "1178691528",
"triggerType" : "MANUAL"
}, {
"hash" : "096cf9e861a5589ee57da2bc95e4e4cb28828431",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9788",
"triggerID" : "096cf9e861a5589ee57da2bc95e4e4cb28828431",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* 65d15683ec3b8084330a6df7e121ca4218b83b2f UNKNOWN
* dd5bce9cad8c64f5afb7d31663e9f281eee866c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9763)
* 096cf9e861a5589ee57da2bc95e4e4cb28828431 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9788)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6017: [HUDI-4276] Reconcile schema-inject null values for missing fields and add new fields
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6017:
URL: https://github.com/apache/hudi/pull/6017#issuecomment-1174904095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9658",
"triggerID" : "d03a0ee0695a640fcf0cbb3b6c074227415f06b5",
"triggerType" : "PUSH"
}, {
"hash" : "572b3bd83c499348795f380004520f880506cf86",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "572b3bd83c499348795f380004520f880506cf86",
"triggerType" : "PUSH"
}, {
"hash" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9661",
"triggerID" : "404cb3aff6702fbff66a6d8b37115c3650b75eca",
"triggerType" : "PUSH"
}, {
"hash" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726",
"triggerID" : "d98c0e31e8d401014fe7338207e45879e5828f99",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 572b3bd83c499348795f380004520f880506cf86 UNKNOWN
* d98c0e31e8d401014fe7338207e45879e5828f99 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9726)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org