You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/02/25 12:46:47 UTC
[GitHub] [hudi] xiarixiaoyao opened a new pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
xiarixiaoyao opened a new pull request #4910:
URL: https://github.com/apache/hudi/pull/4910
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
Support full schema evolution for hoodie:
1) support spark3 DDL. include:
alter statement:
ALTER TABLE table1 ALTER COLUMN a.b.c TYPE bigint
support follow types
int => long/float/double/string
long => float/double/string
float => double/String
double => String/Decimal
Decimal => Decimal/String
String => date/decimal
date => String
ALTER TABLE table1 ALTER COLUMN a.b.c SET NOT NULL
ALTER TABLE table1 ALTER COLUMN a.b.c DROP NOT NULL
ALTER TABLE table1 ALTER COLUMN a.b.c COMMENT 'new comment'
ALTER TABLE table1 ALTER COLUMN a.b.c FIRST
ALTER TABLE table1 ALTER COLUMN a.b.c AFTER x
add statement:
ALTER TABLE table1 ADD COLUMNS (col_name data_type [COMMENT col_comment], ...);
rename:
ALTER TABLE table1 RENAME COLUMN a.b.c TO x
drop:
ALTER TABLE table1 DROP COLUMN a.b.c
ALTER TABLE table1 DROP COLUMNS a.b.c, x, y
set/unset Properties:
ALTER TABLE table SET TBLPROPERTIES ('table_property' = 'property_value');
ALTER TABLE table UNSET TBLPROPERTIES [IF EXISTS] ('comment', 'key');
2) support mor(incremental/realtime/optimize) read/write
3) support cow (incremental/realtime) read/write
4) support mor compaction
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1053981830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* 4ff0d57275e8f907d945c60bd93c2bef227c7c3d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355)
* cb8c6f4233cb1bac50aa67de4145df8458499f6d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1059925465
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1061369238
@xiarixiaoyao 'Cause this pr is so huge. So please help me to sort the implement out.
1. do the `SerDeHelper.LATESTSCHEMA` attribute of one commit file and the `SAVE_SCHEMA_ACTION` file save the same thing, or can they convert each other?
2. if enable `hoodie.schema.evolution.enable`, will every commit persist `SerDeHelper.LATESTSCHEMA` in meta file ?
3. When will commit the `SAVE_SCHEMA_ACTION` file? Once that schema is changed ?
4. How to make the Hudi Table with old version like 0.10 compatible with this ? If enable `hoodie.schema.evolution.enable` on an existed old-version hudi table, what will happen? Or we are not about to make them compatible, then how to refuse this.
5. this pr can work when enable `hoodie.metadata.enable` ?
6. why we need to separate Spark3.1 and Spark3.2?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1059017207
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 059686f6b26f16b4ce1e9def3087f8b7d860a778 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535)
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r828026842
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkMergeHelper.java
##########
@@ -77,14 +89,39 @@ public void runMerge(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD<HoodieKey>
readSchema = mergeHandle.getWriterSchemaWithMetaFields();
}
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ Boolean needToReWriteRecord = false;
+ // to do support bootstrap
Review comment:
Can you elaborate on this TODO ?
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/RunCompactionActionExecutor.java
##########
@@ -70,6 +73,14 @@ public RunCompactionActionExecutor(HoodieEngineContext context,
HoodieCompactionPlan compactionPlan =
CompactionUtils.getCompactionPlan(table.getMetaClient(), instantTime);
+ // try to load internalSchema to support schema Evolution
+ Pair<Option<String>, Option<String>> schemaPair = TableInternalSchemaUtils
+ .getInternalSchemaAndAvroSchemaForClusteringAndCompaction(table.getMetaClient(), instantTime);
+ if (schemaPair.getLeft().isPresent() && schemaPair.getRight().isPresent()) {
+ config.setInternalSchemaString(schemaPair.getLeft().get());
Review comment:
Instead of setting this directly to existing write config, can we clone the writeConfig and pass it. This would prevent unnecessary worry about side-effects for future runs from the same client.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830502461
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
Review comment:
will rewrite all help class tomorrow, thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1059925465
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1074667834
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r832097237
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/block/HoodieAvroDataBlock.java
##########
@@ -147,17 +159,22 @@ private RecordIterator(Schema readerSchema, Schema writerSchema, byte[] content)
int version = this.dis.readInt();
HoodieAvroDataBlockVersion logBlockVersion = new HoodieAvroDataBlockVersion(version);
- this.reader = new GenericDatumReader<>(writerSchema, readerSchema);
+ Schema finalReadSchema = readerSchema;
+ if (!internalSchema.isEmptySchema()) {
+ finalReadSchema = writerSchema;
Review comment:
Can you add a descriptive comment mentioning why we set to writeSchema in this case ?
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkInternalSchemaConverter.java
##########
@@ -0,0 +1,500 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.client.utils;
+
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.ArrayType;
+import org.apache.spark.sql.types.ArrayType$;
+import org.apache.spark.sql.types.BinaryType;
+import org.apache.spark.sql.types.BinaryType$;
+import org.apache.spark.sql.types.BooleanType;
+import org.apache.spark.sql.types.BooleanType$;
+import org.apache.spark.sql.types.ByteType;
+import org.apache.spark.sql.types.CharType;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.DateType;
+import org.apache.spark.sql.types.DateType$;
+import org.apache.spark.sql.types.Decimal;
+import org.apache.spark.sql.types.DecimalType;
+import org.apache.spark.sql.types.DecimalType$;
+import org.apache.spark.sql.types.DoubleType;
+import org.apache.spark.sql.types.DoubleType$;
+import org.apache.spark.sql.types.FloatType;
+import org.apache.spark.sql.types.FloatType$;
+import org.apache.spark.sql.types.IntegerType;
+import org.apache.spark.sql.types.IntegerType$;
+import org.apache.spark.sql.types.LongType;
+import org.apache.spark.sql.types.LongType$;
+import org.apache.spark.sql.types.MapType;
+import org.apache.spark.sql.types.MapType$;
+import org.apache.spark.sql.types.Metadata;
+import org.apache.spark.sql.types.ShortType;
+import org.apache.spark.sql.types.StringType;
+import org.apache.spark.sql.types.StringType$;
+import org.apache.spark.sql.types.StructField;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.types.StructType$;
+import org.apache.spark.sql.types.TimestampType;
+import org.apache.spark.sql.types.TimestampType$;
+import org.apache.spark.sql.types.UserDefinedType;
+import org.apache.spark.sql.types.VarcharType;
+
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class SparkInternalSchemaConverter {
+ private SparkInternalSchemaConverter() {
+
+ }
+
+ public static final String HOODIE_QUERY_SCHEMA = "hoodie.schema.internal.querySchema";
+ public static final String HOODIE_TABLE_PATH = "hoodie.tablePath";
+ /**
+ * Converts a spark schema to an hudi internal schema. Fields without IDs are kept and assigned fallback IDs.
+ *
+ * @param sparkSchema a spark schema
+ * @return a matching internal schema for the provided spark schema
+ */
+ public static InternalSchema convertStructTypeToInternalSchema(StructType sparkSchema) {
+ Type newType = buildTypeFromStructType(sparkSchema, true, new AtomicInteger(0));
+ return new InternalSchema(((Types.RecordType)newType).fields());
+ }
+
+ public static Type buildTypeFromStructType(DataType sparkType, Boolean firstVisitRoot, AtomicInteger nextId) {
+ if (sparkType instanceof StructType) {
+ StructField[] fields = ((StructType) sparkType).fields();
+ int nextAssignId = firstVisitRoot ? 0 : nextId.get();
+ nextId.set(nextAssignId + fields.length);
+ List<Type> newTypes = new ArrayList<>();
+ for (StructField f : fields) {
+ newTypes.add(buildTypeFromStructType(f.dataType(), false, nextId));
+ }
+ List<Types.Field> newFields = new ArrayList<>();
+ for (int i = 0; i < newTypes.size(); i++) {
+ StructField f = fields[i];
+ newFields.add(Types.Field.get(nextAssignId + i, f.nullable(), f.name(), newTypes.get(i),
+ f.getComment().isDefined() ? f.getComment().get() : null));
+ }
+ return Types.RecordType.get(newFields);
+ } else if (sparkType instanceof MapType) {
+ MapType map = (MapType) sparkType;
+ DataType keyType = map.keyType();
+ DataType valueType = map.valueType();
+ int keyId = nextId.get();
+ int valueId = keyId + 1;
+ nextId.set(valueId + 1);
+ return Types.MapType.get(keyId, valueId, buildTypeFromStructType(keyType, false, nextId),
+ buildTypeFromStructType(valueType, false, nextId), map.valueContainsNull());
+ } else if (sparkType instanceof ArrayType) {
+ ArrayType array = (ArrayType) sparkType;
+ DataType et = array.elementType();
+ int elementId = nextId.get();
+ nextId.set(elementId + 1);
+ return Types.ArrayType.get(elementId, array.containsNull(), buildTypeFromStructType(et, false, nextId));
+ } else if (sparkType instanceof UserDefinedType) {
+ throw new UnsupportedOperationException("User-defined types are not supported");
+ } else if (sparkType instanceof BooleanType) {
+ return Types.BooleanType.get();
+ } else if (sparkType instanceof IntegerType
+ || sparkType instanceof ShortType
+ || sparkType instanceof ByteType) {
+ return Types.IntType.get();
+ } else if (sparkType instanceof LongType) {
+ return Types.LongType.get();
+ } else if (sparkType instanceof FloatType) {
+ return Types.FloatType.get();
+ } else if (sparkType instanceof DoubleType) {
+ return Types.DoubleType.get();
+ } else if (sparkType instanceof StringType
+ || sparkType instanceof CharType
+ || sparkType instanceof VarcharType) {
+ return Types.StringType.get();
+ } else if (sparkType instanceof DateType) {
+ return Types.DateType.get();
+ // spark 3.3.0 support TimeStampNTZ, to do support spark3.3.0
+ } else if (sparkType instanceof TimestampType) {
+ return Types.TimestampType.get();
+ } else if (sparkType instanceof DecimalType) {
+ return Types.DecimalType.get(
+ ((DecimalType) sparkType).precision(),
+ ((DecimalType) sparkType).scale());
+ } else if (sparkType instanceof BinaryType) {
+ return Types.BinaryType.get();
+ } else {
+ throw new UnsupportedOperationException(String.format("Not a supported type: %s", sparkType.catalogString()));
+ }
+ }
+
+ /**
+ * Converts a spark schema to an hudi internal schema, and prunes fields.
Review comment:
nit: Change doc to "Converts Spark schema to Hudi internal schema, and prune fields."
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/io/AbstractInternalSchemaStorageManager.java
##########
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.io;
+
+import org.apache.hudi.common.util.Option;
+
+abstract class AbstractInternalSchemaStorageManager {
+
+ /**
+ * persist history schema str.
+ */
+ public abstract void persistHistorySchemaStr(String instantTime, String historySchemaStr);
+
+ /**
+ * get latest history schema string.
+ */
+ public abstract String getHistorySchemaStr();
+
+ /**
+ * Bulk Insert a batch of new records into Hoodie table at the supplied instantTime.
Review comment:
The Javadoc is wrong. Need to fix this.
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/io/FileBasedInternalSchemaStorageManager.java
##########
@@ -0,0 +1,170 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.io;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieActiveTimeline;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.util.FileIOUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.exception.HoodieIOException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import org.apache.log4j.LogManager;
+import org.apache.log4j.Logger;
+
+import java.io.IOException;
+import java.nio.charset.StandardCharsets;
+import java.util.Arrays;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+import static org.apache.hudi.common.table.timeline.HoodieTimeline.SAVE_SCHEMA_ACTION;
+
+public class FileBasedInternalSchemaStorageManager extends AbstractInternalSchemaStorageManager {
+ private static final Logger LOG = LogManager.getLogger(FileBasedInternalSchemaStorageManager.class);
+
+ public static final String SCHEMA_NAME = ".schema";
+ private final Path baseSchemaPath;
+ private Configuration conf;
+ private HoodieTableMetaClient metaClient;
+
+ public FileBasedInternalSchemaStorageManager(Configuration conf, Path baseTablePath) {
+ Path metaPath = new Path(baseTablePath, ".hoodie");
+ this.baseSchemaPath = new Path(metaPath, SCHEMA_NAME);
+ this.conf = conf;
+ this.metaClient = HoodieTableMetaClient.builder().setBasePath(metaPath.getParent().toString()).setConf(conf).build();
+ }
+
+ public FileBasedInternalSchemaStorageManager(HoodieTableMetaClient metaClient) {
+ Path metaPath = new Path(metaClient.getBasePath(), ".hoodie");
+ this.baseSchemaPath = new Path(metaPath, SCHEMA_NAME);
+ this.conf = metaClient.getHadoopConf();
+ this.metaClient = metaClient;
+ }
+
+ @Override
+ public void persistHistorySchemaStr(String instantTime, String historySchemaStr) {
+ cleanResidualFiles();
+ HoodieActiveTimeline timeline = metaClient.getActiveTimeline();
+ HoodieInstant hoodieInstant = new HoodieInstant(HoodieInstant.State.REQUESTED, SAVE_SCHEMA_ACTION, instantTime);
+ timeline.createNewInstant(hoodieInstant);
+ byte[] writeContent = historySchemaStr.getBytes(StandardCharsets.UTF_8);
+ timeline.transitionRequestedToInflight(hoodieInstant, Option.empty());
+ timeline.saveAsComplete(new HoodieInstant(HoodieInstant.State.INFLIGHT, hoodieInstant.getAction(), hoodieInstant.getTimestamp()), Option.of(writeContent));
+ LOG.info(String.format("persist history schema success on commit time: %s", instantTime));
+ }
+
+ private void cleanResidualFiles() {
+ List<String> validateCommits = getValidInstants();
+ try {
+ FileSystem fs = baseSchemaPath.getFileSystem(conf);
+ if (fs.exists(baseSchemaPath)) {
+ List<String> candidateSchemaFiles = Arrays.stream(fs.listStatus(baseSchemaPath)).filter(f -> f.isFile())
+ .map(file -> file.getPath().getName()).collect(Collectors.toList());
+ List<String> residualSchemaFiles = candidateSchemaFiles.stream().filter(f -> !validateCommits.contains(f.split("\\.")[0])).collect(Collectors.toList());
+ // clean residual files
+ residualSchemaFiles.forEach(f -> {
+ try {
+ fs.delete(new Path(metaClient.getSchemaFolderName(), f));
+ } catch (IOException o) {
+ throw new HoodieException(o);
+ }
+ });
+ }
+ } catch (IOException e) {
+ throw new HoodieException(e);
+ }
+ }
+
+ public void cleanOldFiles(List<String> validateCommits) {
+ try {
+ FileSystem fs = baseSchemaPath.getFileSystem(conf);
+ if (fs.exists(baseSchemaPath)) {
+ List<String> candidateSchemaFiles = Arrays.stream(fs.listStatus(baseSchemaPath)).filter(f -> f.isFile())
+ .map(file -> file.getPath().getName()).collect(Collectors.toList());
+ List<String> validateSchemaFiles = candidateSchemaFiles.stream().filter(f -> validateCommits.contains(f.split("\\.")[0])).collect(Collectors.toList());
+ for (int i = 0; i < validateSchemaFiles.size(); i++) {
+ fs.delete(new Path(validateSchemaFiles.get(i)));
+ }
+ }
+ } catch (IOException e) {
+ throw new HoodieException(e);
+ }
+ }
+
+ private List<String> getValidInstants() {
+ metaClient.reloadActiveTimeline();
+ return metaClient.getCommitsTimeline()
+ .filterCompletedInstants().getInstants().map(f -> f.getTimestamp()).collect(Collectors.toList());
+ }
+
+ @Override
+ public String getHistorySchemaStr() {
+ List<String> validateCommits = getValidInstants();
Review comment:
Rename validateCommits to validCommits everywhere
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieDataSourceHelper.scala
##########
@@ -46,7 +49,7 @@ object HoodieDataSourceHelper extends PredicateHelper {
options: Map[String, String],
hadoopConf: Configuration): PartitionedFile => Iterator[InternalRow] = {
- val readParquetFile: PartitionedFile => Iterator[Any] = new ParquetFileFormat().buildReaderWithPartitionValues(
+ val readParquetFile: PartitionedFile => Iterator[Any] = sparkAdapter.createHoodieParquetFileFormat().get.buildReaderWithPartitionValues(
Review comment:
Do we need to adapt ParquetFileFormat based on Spark versions ?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/AlterHoodieTableAddColumnsCommand.scala
##########
@@ -110,15 +110,15 @@ object AlterHoodieTableAddColumnsCommand {
HoodieWriterUtils.parametersWithWriteDefaults(hoodieCatalogTable.catalogProperties).asJava
)
- val commitActionType = CommitUtils.getCommitActionType(WriteOperationType.INSERT, hoodieCatalogTable.tableType)
+ val commitActionType = CommitUtils.getCommitActionType(WriteOperationType.ALTER_SCHEMA, hoodieCatalogTable.tableType)
Review comment:
This is changing the existing behavior but aligns with other changes. We should document this in release notes as commit metadata will show the operation type to be ALTER_SCHEMA
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkInternalSchemaConverter.java
##########
@@ -0,0 +1,500 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.client.utils;
+
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.ArrayType;
+import org.apache.spark.sql.types.ArrayType$;
+import org.apache.spark.sql.types.BinaryType;
+import org.apache.spark.sql.types.BinaryType$;
+import org.apache.spark.sql.types.BooleanType;
+import org.apache.spark.sql.types.BooleanType$;
+import org.apache.spark.sql.types.ByteType;
+import org.apache.spark.sql.types.CharType;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.DateType;
+import org.apache.spark.sql.types.DateType$;
+import org.apache.spark.sql.types.Decimal;
+import org.apache.spark.sql.types.DecimalType;
+import org.apache.spark.sql.types.DecimalType$;
+import org.apache.spark.sql.types.DoubleType;
+import org.apache.spark.sql.types.DoubleType$;
+import org.apache.spark.sql.types.FloatType;
+import org.apache.spark.sql.types.FloatType$;
+import org.apache.spark.sql.types.IntegerType;
+import org.apache.spark.sql.types.IntegerType$;
+import org.apache.spark.sql.types.LongType;
+import org.apache.spark.sql.types.LongType$;
+import org.apache.spark.sql.types.MapType;
+import org.apache.spark.sql.types.MapType$;
+import org.apache.spark.sql.types.Metadata;
+import org.apache.spark.sql.types.ShortType;
+import org.apache.spark.sql.types.StringType;
+import org.apache.spark.sql.types.StringType$;
+import org.apache.spark.sql.types.StructField;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.types.StructType$;
+import org.apache.spark.sql.types.TimestampType;
+import org.apache.spark.sql.types.TimestampType$;
+import org.apache.spark.sql.types.UserDefinedType;
+import org.apache.spark.sql.types.VarcharType;
+
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class SparkInternalSchemaConverter {
+ private SparkInternalSchemaConverter() {
+
+ }
+
+ public static final String HOODIE_QUERY_SCHEMA = "hoodie.schema.internal.querySchema";
+ public static final String HOODIE_TABLE_PATH = "hoodie.tablePath";
+ /**
+ * Converts a spark schema to an hudi internal schema. Fields without IDs are kept and assigned fallback IDs.
+ *
+ * @param sparkSchema a spark schema
+ * @return a matching internal schema for the provided spark schema
+ */
+ public static InternalSchema convertStructTypeToInternalSchema(StructType sparkSchema) {
+ Type newType = buildTypeFromStructType(sparkSchema, true, new AtomicInteger(0));
+ return new InternalSchema(((Types.RecordType)newType).fields());
+ }
+
+ public static Type buildTypeFromStructType(DataType sparkType, Boolean firstVisitRoot, AtomicInteger nextId) {
+ if (sparkType instanceof StructType) {
+ StructField[] fields = ((StructType) sparkType).fields();
+ int nextAssignId = firstVisitRoot ? 0 : nextId.get();
+ nextId.set(nextAssignId + fields.length);
+ List<Type> newTypes = new ArrayList<>();
+ for (StructField f : fields) {
+ newTypes.add(buildTypeFromStructType(f.dataType(), false, nextId));
+ }
+ List<Types.Field> newFields = new ArrayList<>();
+ for (int i = 0; i < newTypes.size(); i++) {
+ StructField f = fields[i];
+ newFields.add(Types.Field.get(nextAssignId + i, f.nullable(), f.name(), newTypes.get(i),
+ f.getComment().isDefined() ? f.getComment().get() : null));
+ }
+ return Types.RecordType.get(newFields);
+ } else if (sparkType instanceof MapType) {
+ MapType map = (MapType) sparkType;
+ DataType keyType = map.keyType();
+ DataType valueType = map.valueType();
+ int keyId = nextId.get();
+ int valueId = keyId + 1;
+ nextId.set(valueId + 1);
+ return Types.MapType.get(keyId, valueId, buildTypeFromStructType(keyType, false, nextId),
+ buildTypeFromStructType(valueType, false, nextId), map.valueContainsNull());
+ } else if (sparkType instanceof ArrayType) {
+ ArrayType array = (ArrayType) sparkType;
+ DataType et = array.elementType();
+ int elementId = nextId.get();
+ nextId.set(elementId + 1);
+ return Types.ArrayType.get(elementId, array.containsNull(), buildTypeFromStructType(et, false, nextId));
+ } else if (sparkType instanceof UserDefinedType) {
+ throw new UnsupportedOperationException("User-defined types are not supported");
+ } else if (sparkType instanceof BooleanType) {
+ return Types.BooleanType.get();
+ } else if (sparkType instanceof IntegerType
+ || sparkType instanceof ShortType
+ || sparkType instanceof ByteType) {
+ return Types.IntType.get();
+ } else if (sparkType instanceof LongType) {
+ return Types.LongType.get();
+ } else if (sparkType instanceof FloatType) {
+ return Types.FloatType.get();
+ } else if (sparkType instanceof DoubleType) {
+ return Types.DoubleType.get();
+ } else if (sparkType instanceof StringType
+ || sparkType instanceof CharType
+ || sparkType instanceof VarcharType) {
+ return Types.StringType.get();
+ } else if (sparkType instanceof DateType) {
+ return Types.DateType.get();
+ // spark 3.3.0 support TimeStampNTZ, to do support spark3.3.0
+ } else if (sparkType instanceof TimestampType) {
+ return Types.TimestampType.get();
+ } else if (sparkType instanceof DecimalType) {
+ return Types.DecimalType.get(
+ ((DecimalType) sparkType).precision(),
+ ((DecimalType) sparkType).scale());
+ } else if (sparkType instanceof BinaryType) {
+ return Types.BinaryType.get();
+ } else {
+ throw new UnsupportedOperationException(String.format("Not a supported type: %s", sparkType.catalogString()));
+ }
+ }
+
+ /**
+ * Converts a spark schema to an hudi internal schema, and prunes fields.
+ * Fields without IDs are kept and assigned fallback IDs.
+ *
+ * @param sparkSchema a pruned spark schema
+ * @param originSchema a internal schema for hoodie table
+ * @return a pruned internal schema for the provided spark schema
+ */
+ public static InternalSchema convertAndPruneStructTypeToInternalSchema(StructType sparkSchema, InternalSchema originSchema) {
+ List<String> pruneNames = collectColNamesFromSparkStruct(sparkSchema);
+ return InternalSchemaUtils.pruneInternalSchema(originSchema, pruneNames);
+ }
+
+ /**
+ * collect all the leaf nodes names.
+ *
+ * @param sparkSchema a spark schema
+ * @return leaf nodes full names.
+ */
+ public static List<String> collectColNamesFromSparkStruct(StructType sparkSchema) {
+ List<String> result = new ArrayList<>();
+ collectColNamesFromStructType(sparkSchema, new LinkedList<>(), result);
+ return result;
+ }
+
+ private static void collectColNamesFromStructType(DataType sparkType, Deque<String> fieldNames, List<String> resultSet) {
+ if (sparkType instanceof StructType) {
+ StructField[] fields = ((StructType) sparkType).fields();
+ for (StructField f : fields) {
+ fieldNames.push(f.name());
+ collectColNamesFromStructType(f.dataType(), fieldNames, resultSet);
+ fieldNames.pop();
+ addFullName(f.dataType(), f.name(), fieldNames, resultSet);
+ }
+ } else if (sparkType instanceof MapType) {
+ MapType map = (MapType) sparkType;
+ DataType keyType = map.keyType();
+ DataType valueType = map.valueType();
+ // key
+ fieldNames.push("key");
+ collectColNamesFromStructType(keyType, fieldNames, resultSet);
+ fieldNames.pop();
+ addFullName(keyType,"key", fieldNames, resultSet);
+ // value
+ fieldNames.push("value");
+ collectColNamesFromStructType(valueType, fieldNames, resultSet);
+ fieldNames.poll();
+ addFullName(valueType,"value", fieldNames, resultSet);
+ } else if (sparkType instanceof ArrayType) {
+ ArrayType array = (ArrayType) sparkType;
+ DataType et = array.elementType();
+ fieldNames.push("element");
+ collectColNamesFromStructType(et, fieldNames, resultSet);
+ fieldNames.pop();
+ addFullName(et, "element", fieldNames, resultSet);
+ } else if (sparkType instanceof UserDefinedType) {
+ throw new UnsupportedOperationException("User-defined types are not supported");
+ } else {
+ // do nothings
+ }
+ }
+
+ private static void addFullName(DataType sparkType, String name, Deque<String> fieldNames, List<String> resultSet) {
+ if (!(sparkType instanceof StructType) && !(sparkType instanceof ArrayType) && !(sparkType instanceof MapType)) {
+ resultSet.add(InternalSchemaUtils.createFullName(name, fieldNames));
+ }
+ }
+
+ public static StructType mergeSchema(InternalSchema fileSchema, InternalSchema querySchema) {
+ InternalSchema schema = new InternalSchemaMerger(fileSchema, querySchema, true, true).mergeSchema();
+ return constructSparkSchemaFromInternalSchema(schema);
+ }
+
+ public static Map<Integer, Pair<DataType, DataType>> collectTypeChangedCols(InternalSchema schema, InternalSchema other) {
+ return InternalSchemaUtils
+ .collectTypeChangedCols(schema, other)
+ .entrySet()
+ .stream()
+ .collect(Collectors.toMap(e -> e.getKey(), e -> Pair.of(constructSparkSchemaFromType(e.getValue().getLeft()), constructSparkSchemaFromType(e.getValue().getRight()))));
+ }
+
+ public static StructType constructSparkSchemaFromInternalSchema(InternalSchema schema) {
+ return (StructType) constructSparkSchemaFromType(schema.getRecord());
+ }
+
+ private static DataType constructSparkSchemaFromType(Type type) {
+ switch (type.typeId()) {
+ case RECORD:
+ Types.RecordType record = (Types.RecordType) type;
+ List<Types.Field> fields = record.fields();
+ List<StructField> structFields = new ArrayList<>();
+ for (Types.Field f : fields) {
+ DataType dataType = constructSparkSchemaFromType(f.type());
+ StructField structField = StructField.apply(f.name(), dataType, f.isOptional(), Metadata.empty());
+ structField = f.doc() == null ? structField : structField.withComment(f.doc());
+ structFields.add(structField);
+ }
+ return StructType$.MODULE$.apply(structFields);
+ case ARRAY:
+ Types.ArrayType array = (Types.ArrayType) type;
+ DataType elementType = constructSparkSchemaFromType(array.elementType());
+ return ArrayType$.MODULE$.apply(elementType, array.isElementOptional());
+ case MAP:
+ Types.MapType map = (Types.MapType) type;
+ DataType keyDataType = constructSparkSchemaFromType(map.keyType());
+ DataType valueDataType = constructSparkSchemaFromType(map.valueType());
+ return MapType$.MODULE$.apply(keyDataType, valueDataType, map.isValueOptional());
+ case BOOLEAN:
+ return BooleanType$.MODULE$;
+ case INT:
+ return IntegerType$.MODULE$;
+ case LONG:
+ return LongType$.MODULE$;
+ case FLOAT:
+ return FloatType$.MODULE$;
+ case DOUBLE:
+ return DoubleType$.MODULE$;
+ case DATE:
+ return DateType$.MODULE$;
+ case TIME:
+ throw new UnsupportedOperationException(String.format("cannot convert %s type to Spark", type));
+ case TIMESTAMP:
+ // todo support TimeStampNTZ
+ return TimestampType$.MODULE$;
+ case STRING:
+ return StringType$.MODULE$;
+ case UUID:
+ return StringType$.MODULE$;
+ case FIXED:
+ return BinaryType$.MODULE$;
+ case BINARY:
+ return BinaryType$.MODULE$;
+ case DECIMAL:
+ Types.DecimalType decimal = (Types.DecimalType) type;
+ return DecimalType$.MODULE$.apply(decimal.precision(), decimal.scale());
+ default:
+ throw new UnsupportedOperationException(String.format("cannot convert unknown type: %s to Spark", type));
+ }
+ }
+
+ /**
+ * Convert Int/long type to other Type.
+ * Now only support int/long -> long/float/double/string
+ * TODO: support more types
+ */
+ private static boolean convertIntLongType(WritableColumnVector oldV, WritableColumnVector newV, DataType newType, int len) {
+ boolean isInt = oldV.dataType() instanceof IntegerType;
+ if (newType instanceof LongType || newType instanceof FloatType
+ || newType instanceof DoubleType || newType instanceof StringType || newType instanceof DecimalType) {
+ for (int i = 0; i < len; i++) {
+ if (oldV.isNullAt(i)) {
+ newV.putNull(i);
+ continue;
+ }
+ // int/long -> long/float/double/string/decimal
+ if (newType instanceof LongType) {
+ newV.putLong(i, isInt ? oldV.getInt(i) : oldV.getLong(i));
+ } else if (newType instanceof FloatType) {
+ newV.putFloat(i, isInt ? oldV.getInt(i) : oldV.getLong(i));
+ } else if (newType instanceof DoubleType) {
+ newV.putDouble(i, isInt ? oldV.getInt(i) : oldV.getLong(i));
+ } else if (newType instanceof StringType) {
+ newV.putByteArray(i, ((isInt ? oldV.getInt(i) : oldV.getLong(i)) + "").getBytes(StandardCharsets.UTF_8));
+ } else if (newType instanceof DecimalType) {
+ Decimal oldDecimal = Decimal.apply(isInt ? oldV.getInt(i) : oldV.getLong(i));
+ oldDecimal.changePrecision(((DecimalType) newType).precision(), ((DecimalType) newType).scale());
+ newV.putDecimal(i, oldDecimal, ((DecimalType) newType).precision());
+ }
+ }
+ return true;
+ }
+ return false;
+ }
+
+ /**
+ * Convert float type to other Type.
+ * Now only support float -> double/String
+ * TODO: support more types
+ */
+ private static boolean convertFloatType(WritableColumnVector oldV, WritableColumnVector newV, DataType newType, int len) {
+ if (newType instanceof DoubleType || newType instanceof StringType || newType instanceof DecimalType) {
+ for (int i = 0; i < len; i++) {
+ if (oldV.isNullAt(i)) {
+ newV.putNull(i);
+ continue;
+ }
+ // float -> double/string/decimal
+ if (newType instanceof DoubleType) {
+ newV.putDouble(i, Double.valueOf(oldV.getFloat(i) + ""));
+ } else if (newType instanceof StringType) {
+ newV.putByteArray(i, (oldV.getFloat(i) + "").getBytes(StandardCharsets.UTF_8));
+ } else if (newType instanceof DecimalType) {
+ Decimal oldDecimal = Decimal.apply(oldV.getFloat(i));
+ oldDecimal.changePrecision(((DecimalType) newType).precision(), ((DecimalType) newType).scale());
+ newV.putDecimal(i, oldDecimal, ((DecimalType) newType).precision());
+ }
+ }
+ return true;
+ }
+ return false;
+ }
+
+ /**
+ * Convert double type to other Type.
+ * Now only support Double -> Decimal/String
Review comment:
Can you describe what needs to be supported here ?
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/action/InternalSchemaMerger.java
##########
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.util.ArrayList;
+import java.util.List;
+
+/**
+ * auxiliary class.
+ * help to merge file schema and query schema to produce final read schema for avro/parquet file
+ */
+public class InternalSchemaMerger {
+ private final InternalSchema fileSchema;
+ private final InternalSchema querySchema;
+ // now there exist some bugs when we use spark update/merge api,
+ // those operation will change col nullability from optional to required which is wrong.
+ // Before that bug is fixed, we need to do adapt.
+ // if mergeRequiredFiledForce is true, we will ignore the col's required attribute.
+ private final boolean ignoreRequiredAttribute;
+ // Whether to use column Type from file schema to read files when we find some column type has changed.
Review comment:
When will this case arise ?
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkInternalSchemaConverter.java
##########
@@ -0,0 +1,500 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.client.utils;
+
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.ArrayType;
+import org.apache.spark.sql.types.ArrayType$;
+import org.apache.spark.sql.types.BinaryType;
+import org.apache.spark.sql.types.BinaryType$;
+import org.apache.spark.sql.types.BooleanType;
+import org.apache.spark.sql.types.BooleanType$;
+import org.apache.spark.sql.types.ByteType;
+import org.apache.spark.sql.types.CharType;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.DateType;
+import org.apache.spark.sql.types.DateType$;
+import org.apache.spark.sql.types.Decimal;
+import org.apache.spark.sql.types.DecimalType;
+import org.apache.spark.sql.types.DecimalType$;
+import org.apache.spark.sql.types.DoubleType;
+import org.apache.spark.sql.types.DoubleType$;
+import org.apache.spark.sql.types.FloatType;
+import org.apache.spark.sql.types.FloatType$;
+import org.apache.spark.sql.types.IntegerType;
+import org.apache.spark.sql.types.IntegerType$;
+import org.apache.spark.sql.types.LongType;
+import org.apache.spark.sql.types.LongType$;
+import org.apache.spark.sql.types.MapType;
+import org.apache.spark.sql.types.MapType$;
+import org.apache.spark.sql.types.Metadata;
+import org.apache.spark.sql.types.ShortType;
+import org.apache.spark.sql.types.StringType;
+import org.apache.spark.sql.types.StringType$;
+import org.apache.spark.sql.types.StructField;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.types.StructType$;
+import org.apache.spark.sql.types.TimestampType;
+import org.apache.spark.sql.types.TimestampType$;
+import org.apache.spark.sql.types.UserDefinedType;
+import org.apache.spark.sql.types.VarcharType;
+
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class SparkInternalSchemaConverter {
+ private SparkInternalSchemaConverter() {
+
+ }
+
+ public static final String HOODIE_QUERY_SCHEMA = "hoodie.schema.internal.querySchema";
+ public static final String HOODIE_TABLE_PATH = "hoodie.tablePath";
+ /**
+ * Converts a spark schema to an hudi internal schema. Fields without IDs are kept and assigned fallback IDs.
+ *
+ * @param sparkSchema a spark schema
+ * @return a matching internal schema for the provided spark schema
+ */
+ public static InternalSchema convertStructTypeToInternalSchema(StructType sparkSchema) {
+ Type newType = buildTypeFromStructType(sparkSchema, true, new AtomicInteger(0));
+ return new InternalSchema(((Types.RecordType)newType).fields());
+ }
+
+ public static Type buildTypeFromStructType(DataType sparkType, Boolean firstVisitRoot, AtomicInteger nextId) {
+ if (sparkType instanceof StructType) {
+ StructField[] fields = ((StructType) sparkType).fields();
+ int nextAssignId = firstVisitRoot ? 0 : nextId.get();
+ nextId.set(nextAssignId + fields.length);
+ List<Type> newTypes = new ArrayList<>();
+ for (StructField f : fields) {
+ newTypes.add(buildTypeFromStructType(f.dataType(), false, nextId));
+ }
+ List<Types.Field> newFields = new ArrayList<>();
+ for (int i = 0; i < newTypes.size(); i++) {
+ StructField f = fields[i];
+ newFields.add(Types.Field.get(nextAssignId + i, f.nullable(), f.name(), newTypes.get(i),
+ f.getComment().isDefined() ? f.getComment().get() : null));
+ }
+ return Types.RecordType.get(newFields);
+ } else if (sparkType instanceof MapType) {
+ MapType map = (MapType) sparkType;
+ DataType keyType = map.keyType();
+ DataType valueType = map.valueType();
+ int keyId = nextId.get();
+ int valueId = keyId + 1;
+ nextId.set(valueId + 1);
+ return Types.MapType.get(keyId, valueId, buildTypeFromStructType(keyType, false, nextId),
+ buildTypeFromStructType(valueType, false, nextId), map.valueContainsNull());
+ } else if (sparkType instanceof ArrayType) {
+ ArrayType array = (ArrayType) sparkType;
+ DataType et = array.elementType();
+ int elementId = nextId.get();
+ nextId.set(elementId + 1);
+ return Types.ArrayType.get(elementId, array.containsNull(), buildTypeFromStructType(et, false, nextId));
+ } else if (sparkType instanceof UserDefinedType) {
+ throw new UnsupportedOperationException("User-defined types are not supported");
+ } else if (sparkType instanceof BooleanType) {
+ return Types.BooleanType.get();
+ } else if (sparkType instanceof IntegerType
+ || sparkType instanceof ShortType
+ || sparkType instanceof ByteType) {
+ return Types.IntType.get();
+ } else if (sparkType instanceof LongType) {
+ return Types.LongType.get();
+ } else if (sparkType instanceof FloatType) {
+ return Types.FloatType.get();
+ } else if (sparkType instanceof DoubleType) {
+ return Types.DoubleType.get();
+ } else if (sparkType instanceof StringType
+ || sparkType instanceof CharType
+ || sparkType instanceof VarcharType) {
+ return Types.StringType.get();
+ } else if (sparkType instanceof DateType) {
+ return Types.DateType.get();
+ // spark 3.3.0 support TimeStampNTZ, to do support spark3.3.0
+ } else if (sparkType instanceof TimestampType) {
+ return Types.TimestampType.get();
+ } else if (sparkType instanceof DecimalType) {
+ return Types.DecimalType.get(
+ ((DecimalType) sparkType).precision(),
+ ((DecimalType) sparkType).scale());
+ } else if (sparkType instanceof BinaryType) {
+ return Types.BinaryType.get();
+ } else {
+ throw new UnsupportedOperationException(String.format("Not a supported type: %s", sparkType.catalogString()));
+ }
+ }
+
+ /**
+ * Converts a spark schema to an hudi internal schema, and prunes fields.
+ * Fields without IDs are kept and assigned fallback IDs.
+ *
+ * @param sparkSchema a pruned spark schema
+ * @param originSchema a internal schema for hoodie table
+ * @return a pruned internal schema for the provided spark schema
+ */
+ public static InternalSchema convertAndPruneStructTypeToInternalSchema(StructType sparkSchema, InternalSchema originSchema) {
+ List<String> pruneNames = collectColNamesFromSparkStruct(sparkSchema);
+ return InternalSchemaUtils.pruneInternalSchema(originSchema, pruneNames);
+ }
+
+ /**
+ * collect all the leaf nodes names.
Review comment:
nit: Can you look at all javadocs in this PR and ensure the first word starts with capital letter
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaEvolutionUtils.java
##########
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+/**
+ * Util methods to support evolve old avro schema based on a given schema.
+ */
+public class AvroSchemaEvolutionUtils {
+ private AvroSchemaEvolutionUtils() {
+ }
+
+ /**
+ * support evolution from a new avroSchema.
Review comment:
support -> Support
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/io/FileBasedInternalSchemaStorageManager.java
##########
@@ -0,0 +1,170 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.io;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieActiveTimeline;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.util.FileIOUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.exception.HoodieIOException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import org.apache.log4j.LogManager;
+import org.apache.log4j.Logger;
+
+import java.io.IOException;
+import java.nio.charset.StandardCharsets;
+import java.util.Arrays;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+import static org.apache.hudi.common.table.timeline.HoodieTimeline.SAVE_SCHEMA_ACTION;
+
+public class FileBasedInternalSchemaStorageManager extends AbstractInternalSchemaStorageManager {
+ private static final Logger LOG = LogManager.getLogger(FileBasedInternalSchemaStorageManager.class);
+
+ public static final String SCHEMA_NAME = ".schema";
+ private final Path baseSchemaPath;
+ private Configuration conf;
+ private HoodieTableMetaClient metaClient;
+
+ public FileBasedInternalSchemaStorageManager(Configuration conf, Path baseTablePath) {
+ Path metaPath = new Path(baseTablePath, ".hoodie");
+ this.baseSchemaPath = new Path(metaPath, SCHEMA_NAME);
+ this.conf = conf;
+ this.metaClient = HoodieTableMetaClient.builder().setBasePath(metaPath.getParent().toString()).setConf(conf).build();
+ }
+
+ public FileBasedInternalSchemaStorageManager(HoodieTableMetaClient metaClient) {
+ Path metaPath = new Path(metaClient.getBasePath(), ".hoodie");
+ this.baseSchemaPath = new Path(metaPath, SCHEMA_NAME);
+ this.conf = metaClient.getHadoopConf();
+ this.metaClient = metaClient;
+ }
+
+ @Override
+ public void persistHistorySchemaStr(String instantTime, String historySchemaStr) {
+ cleanResidualFiles();
+ HoodieActiveTimeline timeline = metaClient.getActiveTimeline();
+ HoodieInstant hoodieInstant = new HoodieInstant(HoodieInstant.State.REQUESTED, SAVE_SCHEMA_ACTION, instantTime);
+ timeline.createNewInstant(hoodieInstant);
+ byte[] writeContent = historySchemaStr.getBytes(StandardCharsets.UTF_8);
+ timeline.transitionRequestedToInflight(hoodieInstant, Option.empty());
+ timeline.saveAsComplete(new HoodieInstant(HoodieInstant.State.INFLIGHT, hoodieInstant.getAction(), hoodieInstant.getTimestamp()), Option.of(writeContent));
+ LOG.info(String.format("persist history schema success on commit time: %s", instantTime));
+ }
+
+ private void cleanResidualFiles() {
+ List<String> validateCommits = getValidInstants();
+ try {
+ FileSystem fs = baseSchemaPath.getFileSystem(conf);
+ if (fs.exists(baseSchemaPath)) {
+ List<String> candidateSchemaFiles = Arrays.stream(fs.listStatus(baseSchemaPath)).filter(f -> f.isFile())
+ .map(file -> file.getPath().getName()).collect(Collectors.toList());
+ List<String> residualSchemaFiles = candidateSchemaFiles.stream().filter(f -> !validateCommits.contains(f.split("\\.")[0])).collect(Collectors.toList());
+ // clean residual files
+ residualSchemaFiles.forEach(f -> {
+ try {
+ fs.delete(new Path(metaClient.getSchemaFolderName(), f));
+ } catch (IOException o) {
+ throw new HoodieException(o);
+ }
+ });
+ }
+ } catch (IOException e) {
+ throw new HoodieException(e);
+ }
+ }
+
+ public void cleanOldFiles(List<String> validateCommits) {
+ try {
+ FileSystem fs = baseSchemaPath.getFileSystem(conf);
+ if (fs.exists(baseSchemaPath)) {
+ List<String> candidateSchemaFiles = Arrays.stream(fs.listStatus(baseSchemaPath)).filter(f -> f.isFile())
+ .map(file -> file.getPath().getName()).collect(Collectors.toList());
+ List<String> validateSchemaFiles = candidateSchemaFiles.stream().filter(f -> validateCommits.contains(f.split("\\.")[0])).collect(Collectors.toList());
+ for (int i = 0; i < validateSchemaFiles.size(); i++) {
+ fs.delete(new Path(validateSchemaFiles.get(i)));
+ }
+ }
+ } catch (IOException e) {
+ throw new HoodieException(e);
+ }
+ }
+
+ private List<String> getValidInstants() {
+ metaClient.reloadActiveTimeline();
+ return metaClient.getCommitsTimeline()
+ .filterCompletedInstants().getInstants().map(f -> f.getTimestamp()).collect(Collectors.toList());
+ }
+
+ @Override
+ public String getHistorySchemaStr() {
+ List<String> validateCommits = getValidInstants();
+ try {
+ if (metaClient.getFs().exists(baseSchemaPath)) {
+ List<String> validateSchemaFiles = Arrays.stream(metaClient.getFs().listStatus(baseSchemaPath))
Review comment:
validateSchemaFiles -> validSchemaFiles
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/io/FileBasedInternalSchemaStorageManager.java
##########
@@ -0,0 +1,170 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.io;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieActiveTimeline;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.util.FileIOUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.exception.HoodieIOException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import org.apache.log4j.LogManager;
+import org.apache.log4j.Logger;
+
+import java.io.IOException;
+import java.nio.charset.StandardCharsets;
+import java.util.Arrays;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+import static org.apache.hudi.common.table.timeline.HoodieTimeline.SAVE_SCHEMA_ACTION;
+
+public class FileBasedInternalSchemaStorageManager extends AbstractInternalSchemaStorageManager {
+ private static final Logger LOG = LogManager.getLogger(FileBasedInternalSchemaStorageManager.class);
+
+ public static final String SCHEMA_NAME = ".schema";
+ private final Path baseSchemaPath;
+ private Configuration conf;
+ private HoodieTableMetaClient metaClient;
+
+ public FileBasedInternalSchemaStorageManager(Configuration conf, Path baseTablePath) {
+ Path metaPath = new Path(baseTablePath, ".hoodie");
+ this.baseSchemaPath = new Path(metaPath, SCHEMA_NAME);
+ this.conf = conf;
+ this.metaClient = HoodieTableMetaClient.builder().setBasePath(metaPath.getParent().toString()).setConf(conf).build();
+ }
+
+ public FileBasedInternalSchemaStorageManager(HoodieTableMetaClient metaClient) {
+ Path metaPath = new Path(metaClient.getBasePath(), ".hoodie");
+ this.baseSchemaPath = new Path(metaPath, SCHEMA_NAME);
+ this.conf = metaClient.getHadoopConf();
+ this.metaClient = metaClient;
+ }
+
+ @Override
+ public void persistHistorySchemaStr(String instantTime, String historySchemaStr) {
+ cleanResidualFiles();
+ HoodieActiveTimeline timeline = metaClient.getActiveTimeline();
+ HoodieInstant hoodieInstant = new HoodieInstant(HoodieInstant.State.REQUESTED, SAVE_SCHEMA_ACTION, instantTime);
+ timeline.createNewInstant(hoodieInstant);
+ byte[] writeContent = historySchemaStr.getBytes(StandardCharsets.UTF_8);
+ timeline.transitionRequestedToInflight(hoodieInstant, Option.empty());
+ timeline.saveAsComplete(new HoodieInstant(HoodieInstant.State.INFLIGHT, hoodieInstant.getAction(), hoodieInstant.getTimestamp()), Option.of(writeContent));
+ LOG.info(String.format("persist history schema success on commit time: %s", instantTime));
+ }
+
+ private void cleanResidualFiles() {
+ List<String> validateCommits = getValidInstants();
+ try {
+ FileSystem fs = baseSchemaPath.getFileSystem(conf);
+ if (fs.exists(baseSchemaPath)) {
+ List<String> candidateSchemaFiles = Arrays.stream(fs.listStatus(baseSchemaPath)).filter(f -> f.isFile())
+ .map(file -> file.getPath().getName()).collect(Collectors.toList());
+ List<String> residualSchemaFiles = candidateSchemaFiles.stream().filter(f -> !validateCommits.contains(f.split("\\.")[0])).collect(Collectors.toList());
+ // clean residual files
+ residualSchemaFiles.forEach(f -> {
+ try {
+ fs.delete(new Path(metaClient.getSchemaFolderName(), f));
+ } catch (IOException o) {
+ throw new HoodieException(o);
+ }
+ });
+ }
+ } catch (IOException e) {
+ throw new HoodieException(e);
+ }
+ }
+
+ public void cleanOldFiles(List<String> validateCommits) {
+ try {
+ FileSystem fs = baseSchemaPath.getFileSystem(conf);
+ if (fs.exists(baseSchemaPath)) {
+ List<String> candidateSchemaFiles = Arrays.stream(fs.listStatus(baseSchemaPath)).filter(f -> f.isFile())
+ .map(file -> file.getPath().getName()).collect(Collectors.toList());
+ List<String> validateSchemaFiles = candidateSchemaFiles.stream().filter(f -> validateCommits.contains(f.split("\\.")[0])).collect(Collectors.toList());
+ for (int i = 0; i < validateSchemaFiles.size(); i++) {
+ fs.delete(new Path(validateSchemaFiles.get(i)));
+ }
+ }
+ } catch (IOException e) {
+ throw new HoodieException(e);
+ }
+ }
+
+ private List<String> getValidInstants() {
+ metaClient.reloadActiveTimeline();
Review comment:
This is a costly operation and we are doing this every time we are calling getHistorySchemaStr(). Can we avoid this call ?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,158 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
+ HoodieTableMetaClient metaClient = HoodieTableMetaClient.builder().setBasePath(tablePath).setConf(hadoopConf).build();
+ return searchSchemaAndCache(versionID, metaClient);
+ }
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param metaClient current hoodie metaClient
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient) {
+ Option<InternalSchema> candidateSchema = searchSchema(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
Review comment:
Can you give us as a scenario in this context where segment lock would reduce contention. Do we expect this call to concurrently happen ?
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SerDeHelper.java
##########
@@ -0,0 +1,351 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import com.fasterxml.jackson.core.JsonFactory;
+import com.fasterxml.jackson.core.JsonGenerator;
+import com.fasterxml.jackson.databind.JsonNode;
+import com.fasterxml.jackson.databind.ObjectMapper;
+
+import org.apache.hadoop.hbase.exceptions.IllegalArgumentIOException;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.io.IOException;
+import java.io.StringWriter;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Locale;
+import java.util.TreeMap;
+import java.util.regex.Matcher;
+import java.util.regex.Pattern;
+
+public class SerDeHelper {
+ private SerDeHelper() {
+
+ }
+
+ public static final String LATEST_SCHEMA = "latestSchema";
Review comment:
Also change the constant latestSchema to latest_schema to make it consistent
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SerDeHelper.java
##########
@@ -0,0 +1,351 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import com.fasterxml.jackson.core.JsonFactory;
+import com.fasterxml.jackson.core.JsonGenerator;
+import com.fasterxml.jackson.databind.JsonNode;
+import com.fasterxml.jackson.databind.ObjectMapper;
+
+import org.apache.hadoop.hbase.exceptions.IllegalArgumentIOException;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.io.IOException;
+import java.io.StringWriter;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Locale;
+import java.util.TreeMap;
+import java.util.regex.Matcher;
+import java.util.regex.Pattern;
+
+public class SerDeHelper {
+ private SerDeHelper() {
+
+ }
+
+ public static final String LATEST_SCHEMA = "latestSchema";
+ public static final String SCHEMAS = "schemas";
+ private static final String MAX_COLUMN_ID = "max_column_id";
+ private static final String VERSION_ID = "version-id";
Review comment:
In the constants, lets use underscore "_" everywhere instead of mixing with "-".
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaEvolutionUtils.java
##########
@@ -0,0 +1,146 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+/**
+ * Util methods to support evolve old avro schema based on a given schema.
+ */
+public class AvroSchemaEvolutionUtils {
+ private AvroSchemaEvolutionUtils() {
+ }
+
+ /**
+ * support evolution from a new avroSchema.
+ * notice: this is not a universal method,
+ * now hoodie support implicitly add columns when hoodie write operation,
+ * This ability needs to be preserved, so implicitly evolution for internalSchema should supported.
+ *
+ * @param evolvedSchema implicitly evolution of avro when hoodie write operation
+ * @param oldSchema old internalSchema
+ * @param supportPositionReorder support position reorder
+ * @return evolution Schema
+ */
+ public static InternalSchema evolveSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema, Boolean supportPositionReorder) {
+ InternalSchema evolvedInternalSchema = AvroInternalSchemaConverter.convert(evolvedSchema);
+ // do check, only support add column evolution
+ List<String> colNamesFromEvolved = evolvedInternalSchema.getAllColsFullName();
+ List<String> colNamesFromOldSchema = oldSchema.getAllColsFullName();
+ List<String> diffFromOldSchema = colNamesFromOldSchema.stream().filter(f -> !colNamesFromEvolved.contains(f)).collect(Collectors.toList());
+ List<Types.Field> newFields = new ArrayList<>();
+ if (colNamesFromEvolved.size() == colNamesFromOldSchema.size() && diffFromOldSchema.size() == 0) {
+ // no changes happen
+ if (supportPositionReorder) {
+ evolvedInternalSchema.getRecord().fields().forEach(f -> newFields.add(oldSchema.getRecord().field(f.name())));
+ return new InternalSchema(newFields);
+ }
+ return oldSchema;
+ }
+ // try to find all added columns
+ if (diffFromOldSchema.size() != 0) {
+ throw new UnsupportedOperationException("Cannot evolve schema implicitly, find delete/rename operation");
+ }
+
+ List<String> diffFromEvolutionSchema = colNamesFromEvolved.stream().filter(f -> !colNamesFromOldSchema.contains(f)).collect(Collectors.toList());
+ // Remove redundancy from diffFromEvolutionSchema.
+ // for example, now we add a struct col in evolvedSchema, the struct col is " user struct<name:string, age:int> "
+ // when we do diff operation: user, user.name, user.age will appeared in the resultSet which is redundancy, user.name and user.age should be excluded.
+ // deal with add operation
+ TreeMap<Integer, String> finalAddAction = new TreeMap<>();
+ for (int i = 0; i < diffFromEvolutionSchema.size(); i++) {
+ String name = diffFromEvolutionSchema.get(i);
+ int splitPoint = name.lastIndexOf(".");
+ String parentName = splitPoint > 0 ? name.substring(0, splitPoint) : "";
+ if (!parentName.isEmpty() && diffFromEvolutionSchema.contains(parentName)) {
+ // find redundancy, skip it
+ continue;
+ }
+ finalAddAction.put(evolvedInternalSchema.findIdByName(name), name);
+ }
+
+ TableChanges.ColumnAddChange addChange = TableChanges.ColumnAddChange.get(oldSchema);
+ finalAddAction.entrySet().stream().forEach(f -> {
+ String name = f.getValue();
+ int splitPoint = name.lastIndexOf(".");
+ String parentName = splitPoint > 0 ? name.substring(0, splitPoint) : "";
+ String rawName = splitPoint > 0 ? name.substring(splitPoint + 1) : name;
+ addChange.addColumns(parentName, rawName, evolvedInternalSchema.findType(name), null);
+ });
+
+ InternalSchema res = SchemaChangeUtils.applyTableChanges2Schema(oldSchema, addChange);
+ if (supportPositionReorder) {
+ evolvedInternalSchema.getRecord().fields().forEach(f -> newFields.add(oldSchema.getRecord().field(f.name())));
+ return new InternalSchema(newFields);
+ } else {
+ return res;
+ }
+ }
+
+ public static InternalSchema evolveSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema) {
+ return evolveSchemaFromNewAvroSchema(evolvedSchema, oldSchema, false);
+ }
+
+ /**
+ * canonical the nullability.
Review comment:
canonical -> Canonicalize
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SchemaChangeUtils.java
##########
@@ -0,0 +1,305 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.action.TableChangesHelper;
+
+import java.util.ArrayList;
+import java.util.List;
+
+/**
+ * Helper methods for schema Change.
+ */
+public class SchemaChangeUtils {
Review comment:
Can we move InternalSchemaChangeApplier to this package and merge the methods in this class to the new class. They both seem to be changing internal schema.
##########
File path: hudi-common/src/test/java/org/apache/hudi/internal/schema/action/TestMergeSchema.java
##########
@@ -0,0 +1,66 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+
+import org.apache.hudi.internal.schema.utils.SchemaChangeUtils;
+import org.junit.jupiter.api.Test;
+
+import java.util.Arrays;
+
+public class TestMergeSchema {
+
+ @Test
+ public void testPrimitiveMerge() {
+ Types.RecordType record = Types.RecordType.get(Arrays.asList(new Types.Field[] {
+ Types.Field.get(0, "col1", Types.BooleanType.get()),
+ Types.Field.get(1, "col2", Types.IntType.get()),
+ Types.Field.get(2, "col3", Types.LongType.get()),
+ Types.Field.get(3, "col4", Types.FloatType.get())}));
+
+ InternalSchema oldSchema = new InternalSchema(record.fields());
+ // add c1 after 'col1', and c2 before 'col3'
+ TableChanges.ColumnAddChange addChange = TableChanges.ColumnAddChange.get(oldSchema);
+ addChange.addColumns("c1", Types.BooleanType.get(), "add c1 after col1");
+ addChange.addPositionChange("c1", "col1", "after");
+ addChange.addColumns("c2", Types.IntType.get(), "add c2 before col3");
+ addChange.addPositionChange("c2", "col3", "before");
+ InternalSchema newAddSchema = SchemaChangeUtils.applyTableChanges2Schema(oldSchema, addChange);
+ TableChanges.ColumnDeleteChange deleteChange = TableChanges.ColumnDeleteChange.get(newAddSchema);
+ deleteChange.deleteColumn("col1");
+ deleteChange.deleteColumn("col3");
+ InternalSchema newDeleteSchema = SchemaChangeUtils.applyTableChanges2Schema(newAddSchema, deleteChange);
+
+ TableChanges.ColumnUpdateChange updateChange = TableChanges.ColumnUpdateChange.get(newDeleteSchema);
+ updateChange.updateColumnType("col2", Types.LongType.get())
+ .updateColumnComment("col2", "alter col2 comments")
+ .renameColumn("col2", "colx").addPositionChange("col2",
+ "col4", "after");
+ InternalSchema updateSchema = SchemaChangeUtils.applyTableChanges2Schema(newDeleteSchema, updateChange);
+
+ // add col1 again
+ TableChanges.ColumnAddChange addChange1 = TableChanges.ColumnAddChange.get(updateSchema);
+ addChange1.addColumns("col1", Types.BooleanType.get(), "add new col1");
+ InternalSchema finalSchema = SchemaChangeUtils.applyTableChanges2Schema(updateSchema, addChange1);
+ InternalSchema mergeSchema = new InternalSchemaMerger(oldSchema, finalSchema, true, false).mergeSchema();
Review comment:
Can we assert on the state of mergeSchema ?
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/InternalSchemaUtils.java
##########
@@ -0,0 +1,856 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalType;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.HoodieSchemaException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+import org.apache.hudi.internal.schema.visitor.InternalSchemaVisitor;
+import org.apache.hudi.internal.schema.visitor.NameToIDVisitor;
+
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.HashMap;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class InternalSchemaUtils {
Review comment:
The class is still InternalSchemaUtils. Can you check again ?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,158 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
Review comment:
Are you referring to reloadActiveTimeline() call in
FileBasedInternalSchemaStorageManager.getValidInstants() ?
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/RunCompactionActionExecutor.java
##########
@@ -70,6 +73,14 @@ public RunCompactionActionExecutor(HoodieEngineContext context,
HoodieCompactionPlan compactionPlan =
CompactionUtils.getCompactionPlan(table.getMetaClient(), instantTime);
+ // try to load internalSchema to support schema Evolution
+ Pair<Option<String>, Option<String>> schemaPair = TableInternalSchemaUtils
+ .getInternalSchemaAndAvroSchemaForClusteringAndCompaction(table.getMetaClient(), instantTime);
+ if (schemaPair.getLeft().isPresent() && schemaPair.getRight().isPresent()) {
+ config.setInternalSchemaString(schemaPair.getLeft().get());
Review comment:
I still see that we are not cloning the config. Is it fixed elsewhere?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister
##########
@@ -16,4 +16,5 @@
# limitations under the License.
-org.apache.hudi.DefaultSource
\ No newline at end of file
+org.apache.hudi.DefaultSource
+org.apache.spark.sql.execution.datasources.parquet.SparkHoodieParquetFileFormat
Review comment:
What is the reason for adding this class name ?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala
##########
@@ -107,8 +113,21 @@ class DefaultSource extends RelationProvider
case (COPY_ON_WRITE, QUERY_TYPE_SNAPSHOT_OPT_VAL, false) |
(COPY_ON_WRITE, QUERY_TYPE_READ_OPTIMIZED_OPT_VAL, false) |
(MERGE_ON_READ, QUERY_TYPE_READ_OPTIMIZED_OPT_VAL, false) =>
- new BaseFileOnlyRelation(sqlContext, metaClient, parameters, userSchema, globPaths)
-
+ val internalSchema = new TableSchemaResolver(metaClient).getTableInternalSchemaFromCommitMetadata
+ val sparkSchema = SchemaConverters.toSqlType(new TableSchemaResolver(metaClient).getTableAvroSchema).dataType.asInstanceOf[StructType]
+ val newParameters = parameters ++ Map(SparkInternalSchemaConverter.HOODIE_QUERY_SCHEMA -> SerDeHelper.toJson(internalSchema.orElse(null)),
+ SparkInternalSchemaConverter.HOODIE_TABLE_PATH -> metaClient.getBasePath)
+ if (internalSchema.isPresent) {
+ // Use the HoodieFileIndex only if the 'path' is not globbed.
+ // Or else we use the original way to read hoodie table.
Review comment:
Why does "*" need to be handled differently ? Can't we just rely on refresh table if new partitions got added ?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,158 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
Review comment:
The caller in AbstractHoodieLogRecordReader and IncrementalRelation can both be changed to pass HoodieTableMetaClient as they have instance of HoodieTableMetaClient created.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076148897
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 35845665ddbfb2c176c80ddbe30404422f01cfac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216)
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r833462132
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/TableInternalSchemaUtils.java
##########
@@ -0,0 +1,140 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class TableInternalSchemaUtils {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
Review comment:
yes, already removed and introduce a new config to control the cache, default value is false
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076364462
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* b52e9b156c672288291ba319c822dabf98a55e3a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079000367
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276)
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077383545
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1081013352
> Otherwise, if the internal schema cannot be found, the engine will directly fall back to the original logic of Hudi, which may lead to data reading failure
This should be ok.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077006690
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* 1c95fe08a4c7e03188a98c531817294555d41505 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250)
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835152599
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
Review comment:
not all fields in InternalSchema will be used，so use lazy initialization mode
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r837013939
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,291 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getEmptyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isEmptySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ idToName = cols.isEmpty() ? new HashMap<>() : InternalSchemaBuilder.getBuilder().buildIdToName(record);
+ nameToId = cols.isEmpty() ? new HashMap<>() : idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ maxColumnId = idToName.isEmpty() ? -1 : idToName.keySet().stream().max(Comparator.comparing(Integer::valueOf)).get();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, List<Field> cols) {
+ this.maxColumnId = maxColumnId;
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ buildIdToName();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, Field... cols) {
+ this(versionId, maxColumnId, Arrays.asList(cols));
+ }
+
+ public RecordType getRecord() {
+ return record;
+ }
+
+ private Map<Integer, String> buildIdToName() {
+ if (idToName == null) {
+ idToName = InternalSchemaBuilder.getBuilder().buildIdToName(record);
+ }
+ return idToName;
+ }
+
+ private Map<String, Integer> buildNameToId() {
+ if (nameToId == null) {
+ if (idToName != null && !idToName.isEmpty()) {
+ nameToId = idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ return nameToId;
+ }
+ nameToId = InternalSchemaBuilder.getBuilder().buildNameToId(record);
+ }
+ return nameToId;
+ }
+
+ private Map<Integer, Field> buildIdToField() {
+ if (idToField == null) {
+ idToField = InternalSchemaBuilder.getBuilder().buildIdToField(record);
+ }
+ return idToField;
+ }
+
+ /**
+ * Get all columns full name.
+ */
+ public List<String> getAllColsFullName() {
+ if (nameToId == null) {
+ nameToId = InternalSchemaBuilder.getBuilder().buildNameToId(record);
+ }
+ return Arrays.asList(nameToId.keySet().toArray(new String[0]));
+ }
+
+ /**
+ * Set the version ID for this schema.
+ */
+ public InternalSchema setSchemaId(long versionId) {
+ this.versionId = versionId;
+ return this;
+ }
+
+ /**
+ * Returns the version ID for this schema.
+ */
+ public long schemaId() {
+ return this.versionId;
+ }
+
+ /**
+ * Set the version ID for this schema.
+ */
+ public void setMax_column_id(int maxColumnId) {
Review comment:
I'm very sorry for the mistake
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079141828
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* 544b64a34f4ba19ef742e606e23d8986284be43f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373)
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079620172
@bvaradar finished all comments,
1) remove old hudi relation
2) add check for bootstrap table
could you pls help me review again, thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r837339831
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,291 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getEmptyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isEmptySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ idToName = cols.isEmpty() ? new HashMap<>() : InternalSchemaBuilder.getBuilder().buildIdToName(record);
+ nameToId = cols.isEmpty() ? new HashMap<>() : idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ maxColumnId = idToName.isEmpty() ? -1 : idToName.keySet().stream().max(Comparator.comparing(Integer::valueOf)).get();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, List<Field> cols) {
+ this.maxColumnId = maxColumnId;
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ buildIdToName();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, Field... cols) {
+ this(versionId, maxColumnId, Arrays.asList(cols));
+ }
+
+ public RecordType getRecord() {
+ return record;
+ }
+
+ private Map<Integer, String> buildIdToName() {
+ if (idToName == null) {
+ idToName = InternalSchemaBuilder.getBuilder().buildIdToName(record);
+ }
+ return idToName;
+ }
+
+ private Map<String, Integer> buildNameToId() {
+ if (nameToId == null) {
+ if (idToName != null && !idToName.isEmpty()) {
+ nameToId = idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ return nameToId;
+ }
+ nameToId = InternalSchemaBuilder.getBuilder().buildNameToId(record);
+ }
+ return nameToId;
+ }
+
+ private Map<Integer, Field> buildIdToField() {
+ if (idToField == null) {
+ idToField = InternalSchemaBuilder.getBuilder().buildIdToField(record);
+ }
+ return idToField;
+ }
+
+ /**
+ * Get all columns full name.
+ */
+ public List<String> getAllColsFullName() {
+ if (nameToId == null) {
+ nameToId = InternalSchemaBuilder.getBuilder().buildNameToId(record);
+ }
+ return Arrays.asList(nameToId.keySet().toArray(new String[0]));
+ }
+
+ /**
+ * Set the version ID for this schema.
+ */
+ public InternalSchema setSchemaId(long versionId) {
+ this.versionId = versionId;
+ return this;
+ }
+
+ /**
+ * Returns the version ID for this schema.
+ */
+ public long schemaId() {
+ return this.versionId;
+ }
+
+ /**
+ * Set the version ID for this schema.
+ */
+ public void setMax_column_id(int maxColumnId) {
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084328808
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084416859
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082563171
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* ccb5902d740a98ce9cbcbb09a26e344400a3cc17 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537)
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085519020
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1081965935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* aeaa837dd208456b9bb0ad07f1675f7d9ea1c175 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082559744
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* aeaa837dd208456b9bb0ad07f1675f7d9ea1c175 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509)
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* ccb5902d740a98ce9cbcbb09a26e344400a3cc17 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537)
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082561316
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* ccb5902d740a98ce9cbcbb09a26e344400a3cc17 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537)
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085008143
ack. kicked off a run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840176540
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/HoodieCompactor.java
##########
@@ -117,8 +120,10 @@ public abstract void preCompact(
// log file.That is because in the case of MergeInto, the config.getSchema may not
// the same with the table schema.
try {
- Schema readerSchema = schemaResolver.getTableAvroSchema(false);
- config.setSchema(readerSchema.toString());
+ if (StringUtils.isNullOrEmpty(config.getInternalSchema())) {
Review comment:
yes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085371993
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634)
* 1f3a776922f8821917ee08adc51c097f3606fabc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084325330
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840599932
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
##########
@@ -231,8 +237,14 @@ object HoodieSparkSqlWriter {
Array(classOf[org.apache.avro.generic.GenericData],
classOf[org.apache.avro.Schema]))
var schema = AvroConversionUtils.convertStructTypeToAvroSchema(df.schema, structName, nameSpace)
+ val lastestSchema = getLatestTableSchema(fs, basePath, sparkContext, schema)
if (reconcileSchema) {
- schema = getLatestTableSchema(fs, basePath, sparkContext, schema)
+ schema = lastestSchema
+ }
+ schema = {
Review comment:
@xiarixiaoyao : Do we need to do this for all cases ? Is it safe to do this only cases where internalSchema is not empty ?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala
##########
@@ -74,7 +75,7 @@ class BaseFileOnlyRelation(sqlContext: SQLContext,
options = optParams,
// NOTE: We have to fork the Hadoop Config here as Spark will be modifying it
// to configure Parquet reader appropriately
- hadoopConf = new Configuration(conf)
+ hadoopConf = HoodieDataSourceHelper.getConfigurationForInternalSchema(new Configuration(conf), requiredSchema.internalSchema, metaClient.getBasePath, validCommits)
Review comment:
nit: getConfigurationForInternalSchema to getConfigurationWithInternalSchema
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085962556
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
}, {
"hash" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"triggerType" : "PUSH"
}, {
"hash" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705",
"triggerID" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"triggerType" : "PUSH"
}, {
"hash" : "c7c98b00d24280081192f7e133b2e1b44e532392",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c7c98b00d24280081192f7e133b2e1b44e532392",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a85abe9d8517f591f43201d61b729066939b99a1 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699)
* a66629f12e982bc3eb1fc0c17420004ee3de2033 UNKNOWN
* e28e7f2e100c377fe92d1ae89983d97c424b630a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705)
* c7c98b00d24280081192f7e133b2e1b44e532392 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1086466759
> LGTM @xiarixiaoyao . This is awesome work. Thanks a lot for contributing this feature and waiting for the review patiently.
>
> To have users understand how to utilize schema on read feature, can you add a section in Spark Guide in the next PR which we can land independently.
>
> We still have few more PRs to go for this feature after 0.11 - Hive, Concurrency, Trino, Flink... Looking forward to reviewing them.
yes，let me add a new section in Spark Guide
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050826865
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c09a928506e41a69dd5e48f1cc2f7815216db1e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051540581
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e04e2076296e16e1b5b60b510ed85d536873a93 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316)
* e909b66fb05a4cdad405b144b041554f45664d3e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051704555
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e909b66fb05a4cdad405b144b041554f45664d3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340)
* 6ba1413ff8b09ec39ec823ae2e3816cd217df553 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051701135
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e909b66fb05a4cdad405b144b041554f45664d3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340)
* 6ba1413ff8b09ec39ec823ae2e3816cd217df553 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1052203919
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* 4ff0d57275e8f907d945c60bd93c2bef227c7c3d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830501318
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getDummyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isDummySchema() {
Review comment:
fixed
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/TableInternalSchemaUtils.java
##########
@@ -0,0 +1,140 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class TableInternalSchemaUtils {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
+ HoodieTableMetaClient metaClient = HoodieTableMetaClient.builder().setBasePath(tablePath).setConf(hadoopConf).build();
+ return searchSchemaAndCache(versionID, metaClient);
+ }
+
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient) {
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830501517
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkMergeHelper.java
##########
@@ -77,14 +89,39 @@ public void runMerge(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD<HoodieKey>
readSchema = mergeHandle.getWriterSchemaWithMetaFields();
}
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ Boolean needToReWriteRecord = false;
+ // to do support bootstrap
+ if (querySchemaOpt.isPresent() && !baseFile.getBootstrapBaseFile().isPresent()) {
+ // check implicitly add columns, and position reorder(spark sql may change cols order)
+ InternalSchema querySchema = AvroSchemaUtil.evolutionSchemaFromNewAvroSchema(readSchema, querySchemaOpt.get(), true);
+ long commitTime = Long.valueOf(FSUtils.getCommitTime(mergeHandle.getOldFilePath().getName()));
+ InternalSchema writeInternalSchema = TableInternalSchemaUtils.searchSchemaAndCache(commitTime, table.getMetaClient());
+ List<String> colNamesFromQuerySchema = querySchema.getAllColsFullName();
+ List<String> colNamesFromWriteSchema = writeInternalSchema.getAllColsFullName();
+ List<String> diffCols = colNamesFromWriteSchema.stream()
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830501716
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkMergeHelper.java
##########
@@ -77,14 +89,39 @@ public void runMerge(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD<HoodieKey>
readSchema = mergeHandle.getWriterSchemaWithMetaFields();
}
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ Boolean needToReWriteRecord = false;
+ // to do support bootstrap
+ if (querySchemaOpt.isPresent() && !baseFile.getBootstrapBaseFile().isPresent()) {
+ // check implicitly add columns, and position reorder(spark sql may change cols order)
+ InternalSchema querySchema = AvroSchemaUtil.evolutionSchemaFromNewAvroSchema(readSchema, querySchemaOpt.get(), true);
Review comment:
fixed, yes, we use needToReWriteRecord to control the execution logic without affecting the original code logic
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r832215484
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,158 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
+ HoodieTableMetaClient metaClient = HoodieTableMetaClient.builder().setBasePath(tablePath).setConf(hadoopConf).build();
+ return searchSchemaAndCache(versionID, metaClient);
+ }
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param metaClient current hoodie metaClient
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient) {
+ Option<InternalSchema> candidateSchema = searchSchema(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
Review comment:
Yes, when spark is used as a service to provide ad-hoc services, there will be concurrent execution of read tasks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1074231650
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* def92ac982683bbef7ec8ecac85ea1bf97e24e2c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127)
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1073049097
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 066450fb1940cc6640afc0911e5416c1a827ba67 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093)
* 9fc0b7d6bde89a857aaa98e8b322b9854ff5279f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094)
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1074180964
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* def92ac982683bbef7ec8ecac85ea1bf97e24e2c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127)
* 8b468258eb102a5ff0accbb3431785a705f92eb4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830504437
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java
##########
@@ -361,15 +372,38 @@ private boolean isNewInstantBlock(HoodieLogBlock logBlock) {
*/
private void processDataBlock(HoodieDataBlock dataBlock, Option<List<String>> keys) throws Exception {
try (ClosableIterator<IndexedRecord> recordItr = dataBlock.getRecordItr(keys.orElse(Collections.emptyList()))) {
+ boolean headRecord = true;
Review comment:
already fixed, thanks very much
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075079635
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152)
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1073068736
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8a4ef3a507ee3b4483c409e5a3af76eb0c421e40 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076285463
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* d16fb4953f49ca231f49247924760cbb7a3efcb6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231)
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* b52e9b156c672288291ba319c822dabf98a55e3a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r829084301
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -226,6 +239,30 @@ protected void commit(HoodieTable table, String commitActionType, String instant
HoodieActiveTimeline activeTimeline = table.getActiveTimeline();
// Finalize write
finalizeWrite(table, instantTime, stats);
+ // do save internal schema to support Implicitly add columns in write process
+ if (!metadata.getExtraMetadata().containsKey(SerDeHelper.LATESTSCHEMA)
Review comment:
nit: Rename LATESTSCHEMA to LATEST_SCHEMA
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
Review comment:
General comment for all the new classes that was added as part of this diff - Can you kindly specify the main responsibilities for each of the classes. It would help us identify role of the class and also identify methods which should not be there in the class.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r829101083
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
+ private AvroSchemaUtil() {
+ }
+
+ private static final long MILLIS_PER_DAY = 86400000L;
+
+ //Export for test
+ public static final Conversions.DecimalConversion DECIMAL_CONVERSION = new Conversions.DecimalConversion();
+
+ /**
+ * Given a avro record with a given schema, rewrites it into the new schema while setting fields only from the new schema.
+ * support deep rewrite for nested record.
+ * This particular method does the following things :
+ * a) Create a new empty GenericRecord with the new schema.
+ * b) For GenericRecord, copy over the data from the old schema to the new schema or set default values for all fields of this transformed schema
+ *
+ * @param oldRecord oldRecord to be rewrite
Review comment:
nit: rewrite -> rewritten
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051780334
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ba1413ff8b09ec39ec823ae2e3816cd217df553 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342)
* 758d417cc8f02537d8174f19c904c062b0873646 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1052133893
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348)
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* 4ff0d57275e8f907d945c60bd93c2bef227c7c3d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051759517
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ba1413ff8b09ec39ec823ae2e3816cd217df553 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342)
* 758d417cc8f02537d8174f19c904c062b0873646 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051829166
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 758d417cc8f02537d8174f19c904c062b0873646 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343)
* 2685177494a54601e91a21d849d2ffd6e284f4ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao edited a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao edited a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050837239
@bvaradar @codope @vinothchandar @xushiyan
could you pls help me review this pr, this pr stacked on hudi-2569, all sql support can be find in TestSpark3DDL.scala
support for hive and flink will come soon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835261890
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaEvolutionUtils.java
##########
@@ -0,0 +1,145 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+/**
+ * Util methods to support evolve old avro schema based on a given schema.
+ */
+public class AvroSchemaEvolutionUtils {
+ private AvroSchemaEvolutionUtils() {
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079590948
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
* b61ba72e253a02c3176b1687eba89a22024b580b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079591680
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
* b61ba72e253a02c3176b1687eba89a22024b580b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079624873
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b61ba72e253a02c3176b1687eba89a22024b580b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389)
* 5357ce8bff9b47bfe50816b178c267efed1d3b0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835267037
##########
File path: hudi-common/src/test/java/org/apache/hudi/internal/schema/action/TestMergeSchema.java
##########
@@ -0,0 +1,66 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+
+import org.apache.hudi.internal.schema.utils.SchemaChangeUtils;
+import org.junit.jupiter.api.Test;
+
+import java.util.Arrays;
+
+public class TestMergeSchema {
+
+ @Test
+ public void testPrimitiveMerge() {
+ Types.RecordType record = Types.RecordType.get(Arrays.asList(new Types.Field[] {
+ Types.Field.get(0, "col1", Types.BooleanType.get()),
+ Types.Field.get(1, "col2", Types.IntType.get()),
+ Types.Field.get(2, "col3", Types.LongType.get()),
+ Types.Field.get(3, "col4", Types.FloatType.get())}));
+
+ InternalSchema oldSchema = new InternalSchema(record.fields());
+ // add c1 after 'col1', and c2 before 'col3'
+ TableChanges.ColumnAddChange addChange = TableChanges.ColumnAddChange.get(oldSchema);
+ addChange.addColumns("c1", Types.BooleanType.get(), "add c1 after col1");
+ addChange.addPositionChange("c1", "col1", "after");
+ addChange.addColumns("c2", Types.IntType.get(), "add c2 before col3");
+ addChange.addPositionChange("c2", "col3", "before");
+ InternalSchema newAddSchema = SchemaChangeUtils.applyTableChanges2Schema(oldSchema, addChange);
+ TableChanges.ColumnDeleteChange deleteChange = TableChanges.ColumnDeleteChange.get(newAddSchema);
+ deleteChange.deleteColumn("col1");
+ deleteChange.deleteColumn("col3");
+ InternalSchema newDeleteSchema = SchemaChangeUtils.applyTableChanges2Schema(newAddSchema, deleteChange);
+
+ TableChanges.ColumnUpdateChange updateChange = TableChanges.ColumnUpdateChange.get(newDeleteSchema);
+ updateChange.updateColumnType("col2", Types.LongType.get())
+ .updateColumnComment("col2", "alter col2 comments")
+ .renameColumn("col2", "colx").addPositionChange("col2",
+ "col4", "after");
+ InternalSchema updateSchema = SchemaChangeUtils.applyTableChanges2Schema(newDeleteSchema, updateChange);
+
+ // add col1 again
+ TableChanges.ColumnAddChange addChange1 = TableChanges.ColumnAddChange.get(updateSchema);
+ addChange1.addColumns("col1", Types.BooleanType.get(), "add new col1");
+ InternalSchema finalSchema = SchemaChangeUtils.applyTableChanges2Schema(updateSchema, addChange1);
+ InternalSchema mergeSchema = new InternalSchemaMerger(oldSchema, finalSchema, true, false).mergeSchema();
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r836733080
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala
##########
@@ -61,6 +61,11 @@ class MergeOnReadSnapshotRelation(sqlContext: SQLContext,
tableSchema: HoodieTableSchema,
requiredSchema: HoodieTableSchema,
filters: Array[Filter]): HoodieMergeOnReadRDD = {
+ if (!internalSchema.isEmptySchema) {
+ // it is safe to enable vectorizedReader
+ sqlContext.sparkSession.sessionState.conf.setConfString("spark.sql.parquet.recordLevelFilter.enabled", "false")
Review comment:
@xiarixiaoyao : Also, here
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,291 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getEmptyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isEmptySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ idToName = cols.isEmpty() ? new HashMap<>() : InternalSchemaBuilder.getBuilder().buildIdToName(record);
+ nameToId = cols.isEmpty() ? new HashMap<>() : idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ maxColumnId = idToName.isEmpty() ? -1 : idToName.keySet().stream().max(Comparator.comparing(Integer::valueOf)).get();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, List<Field> cols) {
+ this.maxColumnId = maxColumnId;
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ buildIdToName();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, Field... cols) {
+ this(versionId, maxColumnId, Arrays.asList(cols));
+ }
+
+ public RecordType getRecord() {
+ return record;
+ }
+
+ private Map<Integer, String> buildIdToName() {
+ if (idToName == null) {
+ idToName = InternalSchemaBuilder.getBuilder().buildIdToName(record);
+ }
+ return idToName;
+ }
+
+ private Map<String, Integer> buildNameToId() {
+ if (nameToId == null) {
+ if (idToName != null && !idToName.isEmpty()) {
+ nameToId = idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ return nameToId;
+ }
+ nameToId = InternalSchemaBuilder.getBuilder().buildNameToId(record);
+ }
+ return nameToId;
+ }
+
+ private Map<Integer, Field> buildIdToField() {
+ if (idToField == null) {
+ idToField = InternalSchemaBuilder.getBuilder().buildIdToField(record);
+ }
+ return idToField;
+ }
+
+ /**
+ * Get all columns full name.
+ */
+ public List<String> getAllColsFullName() {
+ if (nameToId == null) {
+ nameToId = InternalSchemaBuilder.getBuilder().buildNameToId(record);
+ }
+ return Arrays.asList(nameToId.keySet().toArray(new String[0]));
+ }
+
+ /**
+ * Set the version ID for this schema.
+ */
+ public InternalSchema setSchemaId(long versionId) {
+ this.versionId = versionId;
+ return this;
+ }
+
+ /**
+ * Returns the version ID for this schema.
+ */
+ public long schemaId() {
+ return this.versionId;
+ }
+
+ /**
+ * Set the version ID for this schema.
+ */
+ public void setMax_column_id(int maxColumnId) {
Review comment:
Use camel case for all names (class, methods, variables)
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala
##########
@@ -60,6 +60,12 @@ class BaseFileOnlyRelation(sqlContext: SQLContext,
tableSchema: HoodieTableSchema,
requiredSchema: HoodieTableSchema,
filters: Array[Filter]): HoodieUnsafeRDD = {
+ if (!internalSchema.isEmptySchema) {
+ // it is safe to enable vectorizedReader
+ sqlContext.sparkSession.sessionState.conf.setConfString("spark.sql.parquet.recordLevelFilter.enabled", "false")
Review comment:
@xiarixiaoyao : Can you add the comment in code why recordLevelFilter.enabled is turned off in this case ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1081965935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* aeaa837dd208456b9bb0ad07f1675f7d9ea1c175 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1083811909
hey @xiarixiaoyao : I tried to run integ test for this patch and running into NoClassDefFoundError when metadata table compaction kicks in.
```
22/03/30 23:52:42 ERROR HoodieTestSuiteJob: Failed to run Test Suite
java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caf
feine
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:206)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.execute(DagScheduler.java:113)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.schedule(DagScheduler.java:68)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:213)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.main(HoodieTestSuiteJob.java:180)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
at org.apache.hudi.common.util.InternalSchemaCache.<clinit>(InternalSchemaCache.java:61)
at org.apache.hudi.table.action.compact.RunCompactionActionExecutor.execute(RunCompactionActionExecutor.java:79)
at org.apache.hudi.table.HoodieSparkMergeOnReadTable.compact(HoodieSparkMergeOnReadTable.java:142)
at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:345)
at org.apache.hudi.client.BaseHoodieWriteClient.compact(BaseHoodieWriteClient.java:974)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.compactIfNecessary(HoodieBackedTableMetadataWriter.java:825)
at org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter.commit(SparkHoodieBackedTableMetadataWriter.java:136)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.processAndCommit(HoodieBackedTableMetadataWriter.java:674)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.update(HoodieBackedTableMetadataWriter.java:686)
at org.apache.hudi.client.BaseHoodieWriteClient.lambda$writeTableMetadata$0(BaseHoodieWriteClient.java:324)
at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
at org.apache.hudi.client.BaseHoodieWriteClient.writeTableMetadata(BaseHoodieWriteClient.java:324)
at org.apache.hudi.client.BaseHoodieWriteClient.commit(BaseHoodieWriteClient.java:280)
at org.apache.hudi.client.BaseHoodieWriteClient.commitStats(BaseHoodieWriteClient.java:226)
at org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:122)
at org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:644)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:309)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:161)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:75)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:73)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:84)
at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.$anonfun$applyOrElse$1(QueryExecution.scala:110)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:110)
at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:106)
at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:481)
at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:82)
at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:481)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:267)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:263)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:457)
at org.apache.spark.sql.execution.QueryExecution.eagerlyExecuteCommands(QueryExecution.scala:106)
at org.apache.spark.sql.execution.QueryExecution.commandExecuted$lzycompute(QueryExecution.scala:93)
at org.apache.spark.sql.execution.QueryExecution.commandExecuted(QueryExecution.scala:91)
at org.apache.spark.sql.execution.QueryExecution.assertCommandExecuted(QueryExecution.scala:128)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:848)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:382)
at org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:303)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:239)
at org.apache.hudi.integ.testsuite.dag.nodes.SparkInsertNode.execute(SparkInsertNode.scala:76)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.executeNode(DagScheduler.java:139)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.lambda$execute$0(DagScheduler.java:105)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.github.benmanes.caffeine.cache.Caffeine
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 55 more
Exception in thread "main" org.apache.hudi.exception.HoodieException: Failed to run Test Suite
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:218)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.main(HoodieTestSuiteJob.java:180)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:206)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.execute(DagScheduler.java:113)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.schedule(DagScheduler.java:68)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:213)
... 13 more
Caused by: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
at org.apache.hudi.common.util.InternalSchemaCache.<clinit>(InternalSchemaCache.java:61)
at org.apache.hudi.table.action.compact.RunCompactionActionExecutor.execute(RunCompactionActionExecutor.java:79)
at org.apache.hudi.table.HoodieSparkMergeOnReadTable.compact(HoodieSparkMergeOnReadTable.java:142)
at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:345)
at org.apache.hudi.client.BaseHoodieWriteClient.compact(BaseHoodieWriteClient.java:974)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.compactIfNecessary(HoodieBackedTableMetadataWriter.java:825)
at org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter.commit(SparkHoodieBackedTableMetadataWriter.java:136)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.processAndCommit(HoodieBackedTableMetadataWriter.java:674)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.update(HoodieBackedTableMetadataWriter.java:686)
at org.apache.hudi.client.BaseHoodieWriteClient.lambda$writeTableMetadata$0(BaseHoodieWriteClient.java:324)
at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084416859
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084090687
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541)
* 5c147a6a52c3f118a154c9b36c09b9f245dd20e2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085694168
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682)
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* 929adaa89a13ba028801aaa49fdd41cb99594f96 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085701857
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682)
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* 929adaa89a13ba028801aaa49fdd41cb99594f96 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840545810
##########
File path: hudi-spark-datasource/hudi-spark3.1.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark312HoodieParquetFileFormat.scala
##########
@@ -0,0 +1,365 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import java.net.URI
+import java.util
+import org.apache.hadoop.conf.Configuration
+import org.apache.hadoop.fs.Path
+import org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
+import org.apache.hadoop.mapreduce.{JobID, TaskAttemptID, TaskID, TaskType}
+import org.apache.hudi.client.utils.SparkInternalSchemaConverter
+import org.apache.hudi.common.fs.FSUtils
+import org.apache.hudi.common.util.InternalSchemaCache
+import org.apache.hudi.common.util.collection.Pair
+import org.apache.hudi.internal.schema.InternalSchema
+import org.apache.hudi.internal.schema.utils.{InternalSchemaUtils, SerDeHelper}
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger
+import org.apache.parquet.filter2.compat.FilterCompat
+import org.apache.parquet.filter2.predicate.FilterApi
+import org.apache.parquet.format.converter.ParquetMetadataConverter.SKIP_ROW_GROUPS
+import org.apache.parquet.hadoop.{ParquetFileReader, ParquetInputFormat, ParquetRecordReader}
+
+import org.apache.spark.SPARK_VERSION
+import org.apache.spark.TaskContext
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{Cast, JoinedRow}
+import org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection
+import org.apache.spark.sql.catalyst.util.DateTimeUtils
+import org.apache.spark.sql.execution.datasources.{DataSourceUtils, PartitionedFile, RecordReaderIterator}
+import org.apache.spark.sql.execution.datasources.parquet._
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources._
+import org.apache.spark.sql.types.{AtomicType, DataType, StructField, StructType}
+import org.apache.spark.util.SerializableConfiguration
+
+class Spark312HoodieParquetFileFormat extends ParquetFileFormat {
+
+ // reference ParquetFileFormat from spark project
+ override def buildReaderWithPartitionValues(
+ sparkSession: SparkSession,
+ dataSchema: StructType,
+ partitionSchema: StructType,
+ requiredSchema: StructType,
+ filters: Seq[Filter],
+ options: Map[String, String],
+ hadoopConf: Configuration): PartitionedFile => Iterator[InternalRow] = {
+ if (hadoopConf.get(SparkInternalSchemaConverter.HOODIE_QUERY_SCHEMA, "").isEmpty) {
+ // fallback to origin parquet File read
+ super.buildReaderWithPartitionValues(sparkSession, dataSchema, partitionSchema, requiredSchema, filters, options, hadoopConf)
+ } else {
+ hadoopConf.set(ParquetInputFormat.READ_SUPPORT_CLASS, classOf[ParquetReadSupport].getName)
+ hadoopConf.set(
+ ParquetReadSupport.SPARK_ROW_REQUESTED_SCHEMA,
+ requiredSchema.json)
+ hadoopConf.set(
+ ParquetWriteSupport.SPARK_ROW_SCHEMA,
+ requiredSchema.json)
+ hadoopConf.set(
+ SQLConf.SESSION_LOCAL_TIMEZONE.key,
+ sparkSession.sessionState.conf.sessionLocalTimeZone)
+ hadoopConf.setBoolean(
+ SQLConf.NESTED_SCHEMA_PRUNING_ENABLED.key,
+ sparkSession.sessionState.conf.nestedSchemaPruningEnabled)
+ hadoopConf.setBoolean(
+ SQLConf.CASE_SENSITIVE.key,
+ sparkSession.sessionState.conf.caseSensitiveAnalysis)
+
+ ParquetWriteSupport.setSchema(requiredSchema, hadoopConf)
+
+ // Sets flags for `ParquetToSparkSchemaConverter`
+ hadoopConf.setBoolean(
+ SQLConf.PARQUET_BINARY_AS_STRING.key,
+ sparkSession.sessionState.conf.isParquetBinaryAsString)
+ hadoopConf.setBoolean(
+ SQLConf.PARQUET_INT96_AS_TIMESTAMP.key,
+ sparkSession.sessionState.conf.isParquetINT96AsTimestamp)
+ // for dataSource v1, we have no method to do project for spark physical plan.
+ // it's safe to do cols project here.
+ val internalSchemaString = hadoopConf.get(SparkInternalSchemaConverter.HOODIE_QUERY_SCHEMA)
+ val querySchemaOption = SerDeHelper.fromJson(internalSchemaString)
+ if (querySchemaOption.isPresent && !requiredSchema.isEmpty) {
+ val prunedSchema = SparkInternalSchemaConverter.convertAndPruneStructTypeToInternalSchema(requiredSchema, querySchemaOption.get())
+ hadoopConf.set(SparkInternalSchemaConverter.HOODIE_QUERY_SCHEMA, SerDeHelper.toJson(prunedSchema))
+ }
+ val broadcastedHadoopConf =
+ sparkSession.sparkContext.broadcast(new SerializableConfiguration(hadoopConf))
+
+ // TODO: if you move this into the closure it reverts to the default values.
+ // If true, enable using the custom RecordReader for parquet. This only works for
+ // a subset of the types (no complex types).
+ val resultSchema = StructType(partitionSchema.fields ++ requiredSchema.fields)
+ val sqlConf = sparkSession.sessionState.conf
+ val enableOffHeapColumnVector = sqlConf.offHeapColumnVectorEnabled
+ val enableVectorizedReader: Boolean =
+ sqlConf.parquetVectorizedReaderEnabled &&
+ resultSchema.forall(_.dataType.isInstanceOf[AtomicType])
+ val enableRecordFilter: Boolean = sqlConf.parquetRecordFilterEnabled
+ val timestampConversion: Boolean = sqlConf.isParquetINT96TimestampConversion
+ val capacity = sqlConf.parquetVectorizedReaderBatchSize
+ val enableParquetFilterPushDown: Boolean = sqlConf.parquetFilterPushDown
+ // Whole stage codegen (PhysicalRDD) is able to deal with batches directly
+ val returningBatch = supportBatch(sparkSession, resultSchema)
+ val pushDownDate = sqlConf.parquetFilterPushDownDate
+ val pushDownTimestamp = sqlConf.parquetFilterPushDownTimestamp
+ val pushDownDecimal = sqlConf.parquetFilterPushDownDecimal
+ val pushDownStringStartWith = sqlConf.parquetFilterPushDownStringStartWith
+ val pushDownInFilterThreshold = sqlConf.parquetFilterPushDownInFilterThreshold
+ val isCaseSensitive = sqlConf.caseSensitiveAnalysis
+
+ (file: PartitionedFile) => {
+ assert(file.partitionValues.numFields == partitionSchema.size)
+ val filePath = new Path(new URI(file.filePath))
+ val split =
+ new org.apache.parquet.hadoop.ParquetInputSplit(
+ filePath,
+ file.start,
+ file.start + file.length,
+ file.length,
+ Array.empty,
+ null)
+ val sharedConf = broadcastedHadoopConf.value.value
+ // do deal with internalSchema
+ val internalSchemaString = sharedConf.get(SparkInternalSchemaConverter.HOODIE_QUERY_SCHEMA)
+ // querySchema must be a pruned schema.
+ val querySchemaOption = SerDeHelper.fromJson(internalSchemaString)
+ val internalSchemaChangeEnabled = if (internalSchemaString.isEmpty || !querySchemaOption.isPresent) false else true
+ val tablePath = sharedConf.get(SparkInternalSchemaConverter.HOODIE_TABLE_PATH)
+ val commitInstantTime = FSUtils.getCommitTime(filePath.getName).toLong;
+ val fileSchema = if (internalSchemaChangeEnabled) {
+ val validCommits = sharedConf.get(SparkInternalSchemaConverter.HOODIE_VALID_COMMITS_LIST)
+ InternalSchemaCache.getInternalSchemaByVersionId(commitInstantTime, tablePath, sharedConf, if (validCommits == null) "" else validCommits)
+ } else {
+ // this should not happened, searchSchemaAndCache will deal with correctly.
+ null
+ }
+
+ lazy val footerFileMetaData =
+ ParquetFileReader.readFooter(sharedConf, filePath, SKIP_ROW_GROUPS).getFileMetaData
+ val datetimeRebaseMode = DataSourceUtils.datetimeRebaseMode(
+ footerFileMetaData.getKeyValueMetaData.get,
+ SQLConf.get.getConf(SQLConf.LEGACY_PARQUET_REBASE_MODE_IN_READ))
+ // Try to push down filters when filter push-down is enabled.
+ val pushed = if (enableParquetFilterPushDown) {
+ val parquetSchema = footerFileMetaData.getSchema
+ val parquetFilters = if (SPARK_VERSION.startsWith("3.1.3")) {
Review comment:
If Spark 3.1.4 is released, should it also follow same path ? In that case, Can we invert the check to first check for versions 3.1.0, 3.1.1 and 3.1.2 and create the appropriate parquet filters ?
A good TODO would be to have a SparkVersion class that parses SparkVersion and has methods to check for <=, > versions correctly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085388404
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634)
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085437895
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1058934310
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 059686f6b26f16b4ce1e9def3087f8b7d860a778 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535)
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050966417
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e04e2076296e16e1b5b60b510ed85d536873a93 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1058091631
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* cb8c6f4233cb1bac50aa67de4145df8458499f6d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507)
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 059686f6b26f16b4ce1e9def3087f8b7d860a778 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1058141835
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 059686f6b26f16b4ce1e9def3087f8b7d860a778 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1059036403
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1058009821
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* cb8c6f4233cb1bac50aa67de4145df8458499f6d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507)
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 059686f6b26f16b4ce1e9def3087f8b7d860a778 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r820545713
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
Review comment:
I suggest that separate the `get` methods like `getXXX` and `findXXX` and `set` methods strictly. The `getXXX` methods should not change or initialize the private member variables.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1059912572
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao edited a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao edited a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1066554313
@bvaradar @codope , could you pls help me review this PR in your spare time， Thank you very much.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r825720570
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala
##########
@@ -177,6 +192,70 @@ class DefaultSource extends RelationProvider
override def shortName(): String = "hudi_v1"
+ private def getBaseFileOnlyView(useHoodieFileIndex: Boolean,
Review comment:
Yes, this is a issue I want to discuss with you, BaseFileOnlyViewRelation cannot support vector read/ DPP, We ran over 1t of tpcds, and the performance decreased significantly
I will use another PR to support BaseFileOnlyViewRelation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1066554313
@bvaradar , could you pls help me review this PR in your spare time， Thank you very much.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051756102
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e909b66fb05a4cdad405b144b041554f45664d3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340)
* 6ba1413ff8b09ec39ec823ae2e3816cd217df553 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342)
* 758d417cc8f02537d8174f19c904c062b0873646 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1054040283
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* cb8c6f4233cb1bac50aa67de4145df8458499f6d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051543590
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e04e2076296e16e1b5b60b510ed85d536873a93 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316)
* e909b66fb05a4cdad405b144b041554f45664d3e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1052132941
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348)
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* 4ff0d57275e8f907d945c60bd93c2bef227c7c3d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051928469
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2685177494a54601e91a21d849d2ffd6e284f4ba Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347)
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051825663
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ba1413ff8b09ec39ec823ae2e3816cd217df553 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342)
* 758d417cc8f02537d8174f19c904c062b0873646 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343)
* 2685177494a54601e91a21d849d2ffd6e284f4ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051853685
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 758d417cc8f02537d8174f19c904c062b0873646 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343)
* 2685177494a54601e91a21d849d2ffd6e284f4ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051871486
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 758d417cc8f02537d8174f19c904c062b0873646 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343)
* 2685177494a54601e91a21d849d2ffd6e284f4ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347)
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051875111
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2685177494a54601e91a21d849d2ffd6e284f4ba Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347)
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1058912634
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1059912572
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r820532887
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getDummyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isDummySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ if (versionId >= 0) {
Review comment:
i think here don't need to judge if versionId >= 0. Even though this a dummy schema, we also can initialize `idToField`, `nameToId`, `idToName` and `maxColumnId` according to cols.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1060162794
@bvaradar sorry to bother you，if you have free time，could you pls help me review this pr, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079028174
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276)
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* c266a8e2797ef8ae829d6e14860c5a1091a933bb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835198394
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/block/HoodieAvroDataBlock.java
##########
@@ -147,17 +159,26 @@ private RecordIterator(Schema readerSchema, Schema writerSchema, byte[] content)
int version = this.dis.readInt();
HoodieAvroDataBlockVersion logBlockVersion = new HoodieAvroDataBlockVersion(version);
- this.reader = new GenericDatumReader<>(writerSchema, readerSchema);
+ Schema finalReadSchema = readerSchema;
+ if (!internalSchema.isEmptySchema()) {
Review comment:
maybe i miss somethings，
this case already covered by Spark3DDLTest.scala,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079469064
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082547582
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* aeaa837dd208456b9bb0ad07f1675f7d9ea1c175 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509)
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1081727873
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 5357ce8bff9b47bfe50816b178c267efed1d3b0e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392)
* a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079620376
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b61ba72e253a02c3176b1687eba89a22024b580b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389)
* 5357ce8bff9b47bfe50816b178c267efed1d3b0e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r837332697
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala
##########
@@ -61,6 +61,11 @@ class MergeOnReadSnapshotRelation(sqlContext: SQLContext,
tableSchema: HoodieTableSchema,
requiredSchema: HoodieTableSchema,
filters: Array[Filter]): HoodieMergeOnReadRDD = {
+ if (!internalSchema.isEmptySchema) {
+ // it is safe to enable vectorizedReader
+ sqlContext.sparkSession.sessionState.conf.setConfString("spark.sql.parquet.recordLevelFilter.enabled", "false")
Review comment:
we no need recordLevelFilter.enabled for snapshot read, this filter only for incremental query， mor incremental query need to filter data through file level filters
i also post another pr to fixed regression problem https://github.com/apache/hudi/pull/5168
once merged will remove those code.
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala
##########
@@ -60,6 +60,12 @@ class BaseFileOnlyRelation(sqlContext: SQLContext,
tableSchema: HoodieTableSchema,
requiredSchema: HoodieTableSchema,
filters: Array[Filter]): HoodieUnsafeRDD = {
+ if (!internalSchema.isEmptySchema) {
+ // it is safe to enable vectorizedReader
+ sqlContext.sparkSession.sessionState.conf.setConfString("spark.sql.parquet.recordLevelFilter.enabled", "false")
Review comment:
we no need recordLevelFilter.enabled for snapshot read, this filter only for incremental query， mor incremental query need to filter data through file level filters
i also post another pr to fixed regression problem https://github.com/apache/hudi/pull/5168 once merged will remove those code.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085551694
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840537311
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,212 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hudi.common.fs.FSUtils;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.log4j.LogManager;
+import org.apache.log4j.Logger;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.List;
+import java.util.Set;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ private static final Logger LOG = LogManager.getLogger(InternalSchemaCache.class);
+ // Use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * Search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param metaClient current hoodie metaClient
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient, boolean cacheEnable) {
+ Option<InternalSchema> candidateSchema = getSchemaByReadingCommitFile(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ if (!cacheEnable) {
+ // parse history schema and return directly
+ return InternalSchemaUtils.searchSchema(versionID, getHistoricalSchemas(metaClient));
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || InternalSchemaUtils.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return InternalSchemaUtils.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> getSchemaByReadingCommitFile(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ /**
+ * Get internalSchema and avroSchema for compaction/cluster operation.
+ *
+ * @param metaClient current hoodie metaClient
+ * @param compactionAndClusteringInstant first instant before current compaction/cluster instant
+ * @return (internalSchemaStrOpt, avroSchemaStrOpt) a pair of InternalSchema/avroSchema
+ */
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getCommitsAndCompactionTimeline().findInstantsBefore(compactionAndClusteringInstant).filterCompletedInstants();
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata;
+ try {
+ metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ } catch (Exception e) {
+ throw new HoodieException(String.format("cannot read metadata from commit: %s", lastInstantBeforeCurrentCompaction.get()), e);
+ }
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ }
+ return Pair.of(Option.empty(), Option.empty());
+ }
+
+ /**
+ * Give a schema versionId return its internalSchema.
+ * This method will be called by spark tasks, we should minimize time cost.
+ * We try our best to not use metaClient， since the initialization of metaClient is time cost
+ * step1：
+ * try to parser internalSchema from HoodieInstant directly
+ * step2：
+ * if we cannot parser internalSchema in step1，
+ * try to find internalSchema in historySchema.
+ *
+ * @param versionId the internalSchema version to be search.
+ * @param tablePath table path
+ * @param hadoopConf conf
+ * @param validCommits current validate commits, use to make up the commit file path/verify the validity of the history schema files
+ * @return a internalSchema.
+ */
+ public static InternalSchema getInternalSchemaByVersionId(long versionId, String tablePath, Configuration hadoopConf, String validCommits) {
+ Set<String> commitSet = Arrays.stream(validCommits.split(",")).collect(Collectors.toSet());
+ List<String> validateCommitList = commitSet.stream().map(fileName -> {
+ String fileExtension = HoodieInstant.getTimelineFileExtension(fileName);
+ return fileName.replace(fileExtension, "");
+ }).collect(Collectors.toList());
+
+ FileSystem fs = FSUtils.getFs(tablePath, hadoopConf);
+ Path hoodieMetaPath = new Path(tablePath, HoodieTableMetaClient.METAFOLDER_NAME);
+ //step1:
+ Path candidateCommitFile = commitSet.stream().filter(fileName -> {
+ String fileExtension = HoodieInstant.getTimelineFileExtension(fileName);
+ return fileName.replace(fileExtension, "").equals(versionId + "");
+ }).findFirst().map(f -> new Path(hoodieMetaPath, f)).orElse(null);
+ if (candidateCommitFile != null) {
+ try {
+ byte[] data;
+ try (FSDataInputStream is = fs.open(candidateCommitFile)) {
+ data = FileIOUtils.readAsByteArray(is);
+ } catch (IOException e) {
+ throw e;
+ }
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (latestInternalSchemaStr != null) {
+ return SerDeHelper.fromJson(latestInternalSchemaStr).orElse(null);
+ }
+ } catch (Exception e1) {
+ // swallow this exception.
+ LOG.warn(String.format("cannot found internalSchema from commit file %s . Now fallback to parser historical internalSchemas", candidateCommitFile.toString()));
Review comment:
nit: Reword to "Cannot find internal schema from commit file %s. Falling back to parsing historical internal schema"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan edited a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
nsivabalan edited a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1083811909
hey @xiarixiaoyao : I tried to run integ test for this patch and running into NoClassDefFoundError when metadata table compaction kicks in. Likely this will happen for any MOR table compaction. Can you take a look and fix it.
```
22/03/30 23:52:42 ERROR HoodieTestSuiteJob: Failed to run Test Suite
java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caf
feine
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:206)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.execute(DagScheduler.java:113)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.schedule(DagScheduler.java:68)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:213)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.main(HoodieTestSuiteJob.java:180)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
at org.apache.hudi.common.util.InternalSchemaCache.<clinit>(InternalSchemaCache.java:61)
at org.apache.hudi.table.action.compact.RunCompactionActionExecutor.execute(RunCompactionActionExecutor.java:79)
at org.apache.hudi.table.HoodieSparkMergeOnReadTable.compact(HoodieSparkMergeOnReadTable.java:142)
at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:345)
at org.apache.hudi.client.BaseHoodieWriteClient.compact(BaseHoodieWriteClient.java:974)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.compactIfNecessary(HoodieBackedTableMetadataWriter.java:825)
at org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter.commit(SparkHoodieBackedTableMetadataWriter.java:136)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.processAndCommit(HoodieBackedTableMetadataWriter.java:674)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.update(HoodieBackedTableMetadataWriter.java:686)
at org.apache.hudi.client.BaseHoodieWriteClient.lambda$writeTableMetadata$0(BaseHoodieWriteClient.java:324)
at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
at org.apache.hudi.client.BaseHoodieWriteClient.writeTableMetadata(BaseHoodieWriteClient.java:324)
at org.apache.hudi.client.BaseHoodieWriteClient.commit(BaseHoodieWriteClient.java:280)
at org.apache.hudi.client.BaseHoodieWriteClient.commitStats(BaseHoodieWriteClient.java:226)
at org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:122)
at org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:644)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:309)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:161)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:75)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:73)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:84)
at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.$anonfun$applyOrElse$1(QueryExecution.scala:110)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:110)
at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:106)
at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:481)
at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:82)
at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:481)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:267)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:263)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:457)
at org.apache.spark.sql.execution.QueryExecution.eagerlyExecuteCommands(QueryExecution.scala:106)
at org.apache.spark.sql.execution.QueryExecution.commandExecuted$lzycompute(QueryExecution.scala:93)
at org.apache.spark.sql.execution.QueryExecution.commandExecuted(QueryExecution.scala:91)
at org.apache.spark.sql.execution.QueryExecution.assertCommandExecuted(QueryExecution.scala:128)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:848)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:382)
at org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:303)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:239)
at org.apache.hudi.integ.testsuite.dag.nodes.SparkInsertNode.execute(SparkInsertNode.scala:76)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.executeNode(DagScheduler.java:139)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.lambda$execute$0(DagScheduler.java:105)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: com.github.benmanes.caffeine.cache.Caffeine
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 55 more
Exception in thread "main" org.apache.hudi.exception.HoodieException: Failed to run Test Suite
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:218)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.main(HoodieTestSuiteJob.java:180)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:206)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.execute(DagScheduler.java:113)
at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.schedule(DagScheduler.java:68)
at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:213)
... 13 more
Caused by: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
at org.apache.hudi.common.util.InternalSchemaCache.<clinit>(InternalSchemaCache.java:61)
at org.apache.hudi.table.action.compact.RunCompactionActionExecutor.execute(RunCompactionActionExecutor.java:79)
at org.apache.hudi.table.HoodieSparkMergeOnReadTable.compact(HoodieSparkMergeOnReadTable.java:142)
at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:345)
at org.apache.hudi.client.BaseHoodieWriteClient.compact(BaseHoodieWriteClient.java:974)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.compactIfNecessary(HoodieBackedTableMetadataWriter.java:825)
at org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter.commit(SparkHoodieBackedTableMetadataWriter.java:136)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.processAndCommit(HoodieBackedTableMetadataWriter.java:674)
at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.update(HoodieBackedTableMetadataWriter.java:686)
at org.apache.hudi.client.BaseHoodieWriteClient.lambda$writeTableMetadata$0(BaseHoodieWriteClient.java:324)
at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085962556
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
}, {
"hash" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"triggerType" : "PUSH"
}, {
"hash" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705",
"triggerID" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"triggerType" : "PUSH"
}, {
"hash" : "c7c98b00d24280081192f7e133b2e1b44e532392",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c7c98b00d24280081192f7e133b2e1b44e532392",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a85abe9d8517f591f43201d61b729066939b99a1 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699)
* a66629f12e982bc3eb1fc0c17420004ee3de2033 UNKNOWN
* e28e7f2e100c377fe92d1ae89983d97c424b630a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705)
* c7c98b00d24280081192f7e133b2e1b44e532392 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840636504
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
##########
@@ -231,8 +237,14 @@ object HoodieSparkSqlWriter {
Array(classOf[org.apache.avro.generic.GenericData],
classOf[org.apache.avro.Schema]))
var schema = AvroConversionUtils.convertStructTypeToAvroSchema(df.schema, structName, nameSpace)
+ val lastestSchema = getLatestTableSchema(fs, basePath, sparkContext, schema)
if (reconcileSchema) {
- schema = getLatestTableSchema(fs, basePath, sparkContext, schema)
+ schema = lastestSchema
+ }
+ schema = {
Review comment:
it workd for all case in hudi 0.9
for safe, let me add some logcial to fallback original logical
fixed. as follow code.
```
if (internalSchemaOpt.isDefined) {
schema = {
val newSparkSchema = AvroConversionUtils.convertAvroSchemaToStructType(AvroSchemaEvolutionUtils.canonicalizeColumnNullability(schema, lastestSchema))
AvroConversionUtils.convertStructTypeToAvroSchema(newSparkSchema, structName, nameSpace)
}
}
```
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala
##########
@@ -74,7 +75,7 @@ class BaseFileOnlyRelation(sqlContext: SQLContext,
options = optParams,
// NOTE: We have to fork the Hadoop Config here as Spark will be modifying it
// to configure Parquet reader appropriately
- hadoopConf = new Configuration(conf)
+ hadoopConf = HoodieDataSourceHelper.getConfigurationForInternalSchema(new Configuration(conf), requiredSchema.internalSchema, metaClient.getBasePath, validCommits)
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar merged pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
vinothchandar merged pull request #4910:
URL: https://github.com/apache/hudi/pull/4910
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835261405
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SerDeHelper.java
##########
@@ -0,0 +1,351 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import com.fasterxml.jackson.core.JsonFactory;
+import com.fasterxml.jackson.core.JsonGenerator;
+import com.fasterxml.jackson.databind.JsonNode;
+import com.fasterxml.jackson.databind.ObjectMapper;
+
+import org.apache.hadoop.hbase.exceptions.IllegalArgumentIOException;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.io.IOException;
+import java.io.StringWriter;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Locale;
+import java.util.TreeMap;
+import java.util.regex.Matcher;
+import java.util.regex.Pattern;
+
+public class SerDeHelper {
+ private SerDeHelper() {
+
+ }
+
+ public static final String LATEST_SCHEMA = "latest_Schema";
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835266122
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -237,6 +251,30 @@ protected void commit(HoodieTable table, String commitActionType, String instant
HoodieActiveTimeline activeTimeline = table.getActiveTimeline();
// Finalize write
finalizeWrite(table, instantTime, stats);
+ // do save internal schema to support Implicitly add columns in write process
+ if (!metadata.getExtraMetadata().containsKey(SerDeHelper.LATEST_SCHEMA)
+ && metadata.getExtraMetadata().containsKey(SCHEMA_KEY) && table.getConfig().getSchemaEvolutionEnable()) {
+ TableSchemaResolver schemaUtil = new TableSchemaResolver(table.getMetaClient());
+ String historySchemaStr = schemaUtil.getTableHistorySchemaStrFromCommitMetadata().orElse("");
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(table.getMetaClient());
+ if (!historySchemaStr.isEmpty()) {
+ InternalSchema internalSchema = InternalSchemaUtils.searchSchema(Long.parseLong(instantTime),
+ SerDeHelper.parseSchemas(historySchemaStr));
+ Schema avroSchema = HoodieAvroUtils.createHoodieWriteSchema(new Schema.Parser().parse(config.getSchema()));
+ InternalSchema evolutionSchema = AvroSchemaEvolutionUtils.evolveSchemaFromNewAvroSchema(avroSchema, internalSchema);
+ if (evolutionSchema.equals(internalSchema)) {
+ metadata.addMetadata(SerDeHelper.LATEST_SCHEMA, SerDeHelper.toJson(evolutionSchema));
+ schemasManager.persistHistorySchemaStr(instantTime, historySchemaStr);
Review comment:
TODO added.
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835263370
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java
##########
@@ -109,6 +115,9 @@
private final FileSystem fs;
// Total log files read - for metrics
private AtomicLong totalLogFiles = new AtomicLong(0);
+ // Internal schema
+ private InternalSchema internalSchema = InternalSchema.getEmptyInternalSchema();
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084031826
> hey @xiarixiaoyao : I tried to run integ test for this patch and running into NoClassDefFoundError when metadata table compaction kicks in. Likely this will happen for any MOR table compaction. Can you take a look and fix it.
>
> ```
> 22/03/30 23:52:42 ERROR HoodieTestSuiteJob: Failed to run Test Suite
> java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caf
> feine
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:206)
> at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.execute(DagScheduler.java:113)
> at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.schedule(DagScheduler.java:68)
> at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:213)
> at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.main(HoodieTestSuiteJob.java:180)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
> at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
> at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
> at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
> at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
> at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> Caused by: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
> at org.apache.hudi.common.util.InternalSchemaCache.<clinit>(InternalSchemaCache.java:61)
> at org.apache.hudi.table.action.compact.RunCompactionActionExecutor.execute(RunCompactionActionExecutor.java:79)
> at org.apache.hudi.table.HoodieSparkMergeOnReadTable.compact(HoodieSparkMergeOnReadTable.java:142)
> at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:345)
> at org.apache.hudi.client.BaseHoodieWriteClient.compact(BaseHoodieWriteClient.java:974)
> at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.compactIfNecessary(HoodieBackedTableMetadataWriter.java:825)
> at org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter.commit(SparkHoodieBackedTableMetadataWriter.java:136)
> at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.processAndCommit(HoodieBackedTableMetadataWriter.java:674)
> at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.update(HoodieBackedTableMetadataWriter.java:686)
> at org.apache.hudi.client.BaseHoodieWriteClient.lambda$writeTableMetadata$0(BaseHoodieWriteClient.java:324)
> at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
> at org.apache.hudi.client.BaseHoodieWriteClient.writeTableMetadata(BaseHoodieWriteClient.java:324)
> at org.apache.hudi.client.BaseHoodieWriteClient.commit(BaseHoodieWriteClient.java:280)
> at org.apache.hudi.client.BaseHoodieWriteClient.commitStats(BaseHoodieWriteClient.java:226)
> at org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:122)
> at org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:644)
> at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:309)
> at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:161)
> at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
> at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:75)
> at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:73)
> at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:84)
> at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.$anonfun$applyOrElse$1(QueryExecution.scala:110)
> at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
> at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
> at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
> at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
> at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
> at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:110)
> at org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.applyOrElse(QueryExecution.scala:106)
> at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:481)
> at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:82)
> at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:481)
> at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:30)
> at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:267)
> at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:263)
> at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:30)
> at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:30)
> at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:457)
> at org.apache.spark.sql.execution.QueryExecution.eagerlyExecuteCommands(QueryExecution.scala:106)
> at org.apache.spark.sql.execution.QueryExecution.commandExecuted$lzycompute(QueryExecution.scala:93)
> at org.apache.spark.sql.execution.QueryExecution.commandExecuted(QueryExecution.scala:91)
> at org.apache.spark.sql.execution.QueryExecution.assertCommandExecuted(QueryExecution.scala:128)
> at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:848)
> at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:382)
> at org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:303)
> at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:239)
> at org.apache.hudi.integ.testsuite.dag.nodes.SparkInsertNode.execute(SparkInsertNode.scala:76)
> at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.executeNode(DagScheduler.java:139)
> at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.lambda$execute$0(DagScheduler.java:105)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.ClassNotFoundException: com.github.benmanes.caffeine.cache.Caffeine
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
> ... 55 more
> Exception in thread "main" org.apache.hudi.exception.HoodieException: Failed to run Test Suite
> at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:218)
> at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.main(HoodieTestSuiteJob.java:180)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
> at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
> at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
> at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
> at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
> at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> Caused by: java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:206)
> at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.execute(DagScheduler.java:113)
> at org.apache.hudi.integ.testsuite.dag.scheduler.DagScheduler.schedule(DagScheduler.java:68)
> at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:213)
> ... 13 more
> Caused by: java.lang.NoClassDefFoundError: com/github/benmanes/caffeine/cache/Caffeine
> at org.apache.hudi.common.util.InternalSchemaCache.<clinit>(InternalSchemaCache.java:61)
> at org.apache.hudi.table.action.compact.RunCompactionActionExecutor.execute(RunCompactionActionExecutor.java:79)
> at org.apache.hudi.table.HoodieSparkMergeOnReadTable.compact(HoodieSparkMergeOnReadTable.java:142)
> at org.apache.hudi.client.SparkRDDWriteClient.compact(SparkRDDWriteClient.java:345)
> at org.apache.hudi.client.BaseHoodieWriteClient.compact(BaseHoodieWriteClient.java:974)
> at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.compactIfNecessary(HoodieBackedTableMetadataWriter.java:825)
> at org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter.commit(SparkHoodieBackedTableMetadataWriter.java:136)
> at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.processAndCommit(HoodieBackedTableMetadataWriter.java:674)
> at org.apache.hudi.metadata.HoodieBackedTableMetadataWriter.update(HoodieBackedTableMetadataWriter.java:686)
> at org.apache.hudi.client.BaseHoodieWriteClient.lambda$writeTableMetadata$0(BaseHoodieWriteClient.java:324)
> at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
>
> ```
Thank you very much for finding this bug. I'm sorry for that
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085519020
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085548647
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085875245
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* 929adaa89a13ba028801aaa49fdd41cb99594f96 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690)
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a85abe9d8517f591f43201d61b729066939b99a1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao edited a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao edited a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085877159
> @xiarixiaoyao : Finished reviewing new code changes. Making one final pass now. Meanwhile, please take a look at the comments.
>
> Also one more comment: Its good that we moved the version definition of caffeine to parent pom file. We would still need a dependency statement in hudi-common/pom.xml (without version) as caffeine is directly used in the code. Can you add the below patch
>
> ```
> diff --git a/hudi-common/pom.xml b/hudi-common/pom.xml
> index f60573875c..ece8d242ce 100644
> --- a/hudi-common/pom.xml
> +++ b/hudi-common/pom.xml
> @@ -117,6 +117,12 @@
> <artifactId>avro</artifactId>
> </dependency>
>
> + <!-- caffeine -->
> + <dependency>
> + <groupId>com.github.ben-manes.caffeine</groupId>
> + <artifactId>caffeine</artifactId>
> + </dependency>
> +
> <!-- Parquet -->
> <dependency>
> <groupId>org.apache.parquet</groupId>
> ```
@bvaradar Thanks for reminding, already addressed all comments
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085294223
@nsivabalan Thank you very much. If there are any more problem/worry, I will solve them as soon as possible
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840175669
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##########
@@ -167,6 +167,22 @@
+ "implementations of HoodieRecordPayload to convert incoming records to avro. This is also used as the write schema "
+ "evolving records during an update.");
+ public static final ConfigProperty<String> INTERNAL_SCHEMA_STRING = ConfigProperty
+ .key("hoodie.internal.schema")
+ .noDefaultValue()
+ .withDocumentation("Schema string representing the latest schema of the table. Hudi passes this to "
+ + "implementations of evolution of schema");
+
+ public static final ConfigProperty<Boolean> SCHEMA_EVOLUTION_ENABLE = ConfigProperty
Review comment:
no problems, let me modfy it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840174124
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java
##########
@@ -588,6 +589,9 @@ public void archive(HoodieEngineContext context, List<HoodieInstant> instants) t
}
}
writeToFile(wrapperSchema, records);
+ // try to clean old history schema.
+ FileBasedInternalSchemaStorageManager fss = new FileBasedInternalSchemaStorageManager(metaClient);
Review comment:
TimelineArchiver will delete commit files, now history internalSchema is treaded as commit files。 so i think may be it's better to clean historySchema here.
of course if you have diff idea, i can move it to cleaner. thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085354053
>
We have launched this feature in the official version of Huawei cloud, although the version we use is hudi 0.9
in our offical version we have already support spark/hive/trino. flink version has some bugs to be fixed
We have already used it production env. I will synchronize the community in time for subsequent bugs in the production environment.
Of course I understand you have reason to concern. Anyway, thank you very much for your review
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085724198
@bvaradar @vinothchandar
already base the codes， and addressed all comments
pls help me review again， thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082709362
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084420839
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840180390
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieTimeline.java
##########
@@ -55,6 +55,8 @@
String COMPACTION_ACTION = "compaction";
String REQUESTED_EXTENSION = ".requested";
String RESTORE_ACTION = "restore";
+ // only for schema save
+ String SAVE_SCHEMA_ACTION = "schemacommit";
Review comment:
I think may be we no need to include this in getWriteTimeline. SCHEMA_COMMIT_ACTION is only used by FileBaseInternalSchemasManager to manage files in ./hoodie/.schema, it has no influnce on the commits files in ./hoodie
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085357415
@xiarixiaoyao This is amazing. No. I am just trying to understand safety. Spark code paths seem to fallback to older ways nicely from what I gather.
Can you knock off these minor code comments, rebase and once @bvaradar take a final pass, we can land this for 0.11.
That way, we can continue hardening this in 0.11.x
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r825709104
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getDummyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isDummySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ if (versionId >= 0) {
+ buildIdToName();
+ maxColumnId = idToName.keySet().stream().max(Comparator.comparing(Integer::valueOf)).get();
+ }
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, List<Field> cols) {
+ this.maxColumnId = maxColumnId;
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ buildIdToName();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, Field... cols) {
+ this(versionId, maxColumnId, Arrays.asList(cols));
+ }
+
+ public RecordType getRecord() {
+ return record;
+ }
+
+ private Map<Integer, String> buildIdToName() {
+ if (idToName == null) {
+ idToName = InternalSchemaUtils.buildIdToName(record);
+ }
+ return idToName;
+ }
+
+ private Map<String, Integer> buildNameToId() {
+ if (nameToId == null) {
+ if (idToName != null && !idToName.isEmpty()) {
+ nameToId = idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ return nameToId;
+ }
+ nameToId = InternalSchemaUtils.buildNameToId(record);
+ }
+ return nameToId;
+ }
+
+ private Map<Integer, Field> buildIdToField() {
+ if (idToField == null) {
+ idToField = InternalSchemaUtils.buildIdToField(record);
+ }
+ return idToField;
+ }
+
+ /**
+ * get all columns full name.
+ */
+ public List<String> getAllColsFullName() {
+ if (nameToId == null) {
+ nameToId = InternalSchemaUtils.buildNameToId(record);
+ }
+ return Arrays.asList(nameToId.keySet().toArray(new String[0]));
+ }
+
+ /**
+ * set the version ID for this schema.
+ */
+ public InternalSchema setSchemaId(long versionId) {
+ this.versionId = versionId;
Review comment:
1)when we add a new column, the max_column_id will be +1
2) when we do DDL, before we save internalSchema, we will setSchemaId for it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075889392
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* f63e59e2924ada773f25904ebb90775c1d475c06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184)
* 35845665ddbfb2c176c80ddbe30404422f01cfac UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r829107917
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
+ private AvroSchemaUtil() {
+ }
+
+ private static final long MILLIS_PER_DAY = 86400000L;
+
+ //Export for test
+ public static final Conversions.DecimalConversion DECIMAL_CONVERSION = new Conversions.DecimalConversion();
+
+ /**
+ * Given a avro record with a given schema, rewrites it into the new schema while setting fields only from the new schema.
+ * support deep rewrite for nested record.
+ * This particular method does the following things :
+ * a) Create a new empty GenericRecord with the new schema.
+ * b) For GenericRecord, copy over the data from the old schema to the new schema or set default values for all fields of this transformed schema
+ *
+ * @param oldRecord oldRecord to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return newRecord for new Schema
+ */
+ public static GenericRecord rewriteRecord(IndexedRecord oldRecord, Schema newSchema) {
+ Object newRecord = rewriteRecord(oldRecord, oldRecord.getSchema(), newSchema);
+ return (GenericData.Record) newRecord;
+ }
+
+ private static Object rewriteRecord(Object oldRecord, Schema oldSchema, Schema newSchema) {
+ if (oldRecord == null) {
+ return null;
+ }
+ switch (newSchema.getType()) {
+ case RECORD:
+ if (!(oldRecord instanceof IndexedRecord)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ IndexedRecord indexedRecord = (IndexedRecord) oldRecord;
+ List<Schema.Field> fields = newSchema.getFields();
+ Map<Integer, Object> helper = new HashMap<>();
+
+ for (int i = 0; i < fields.size(); i++) {
+ Schema.Field field = fields.get(i);
+ if (oldSchema.getField(field.name()) != null) {
+ Schema.Field oldField = oldSchema.getField(field.name());
+ helper.put(i, rewriteRecord(indexedRecord.get(oldField.pos()), oldField.schema(), fields.get(i).schema()));
+ }
+ }
+ GenericData.Record newRecord = new GenericData.Record(newSchema);
+ for (int i = 0; i < fields.size(); i++) {
+ if (helper.containsKey(i)) {
+ newRecord.put(i, helper.get(i));
+ } else {
+ if (fields.get(i).defaultVal() instanceof JsonProperties.Null) {
+ newRecord.put(i, null);
+ } else {
+ newRecord.put(i, fields.get(i).defaultVal());
+ }
+ }
+ }
+ return newRecord;
+ case ARRAY:
+ if (!(oldRecord instanceof Collection)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Collection array = (Collection)oldRecord;
+ List<Object> newArray = new ArrayList();
+ for (Object element : array) {
+ newArray.add(rewriteRecord(element, oldSchema.getElementType(), newSchema.getElementType()));
+ }
+ return newArray;
+ case MAP:
+ if (!(oldRecord instanceof Map)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Map<Object, Object> map = (Map<Object, Object>) oldRecord;
+ Map<Object, Object> newMap = new HashMap<>();
+ for (Map.Entry<Object, Object> entry : map.entrySet()) {
+ newMap.put(entry.getKey(), rewriteRecord(entry.getValue(), oldSchema.getValueType(), newSchema.getValueType()));
+ }
+ return newMap;
+ case UNION:
+ return rewriteRecord(oldRecord, getActualSchemaFromUnion(oldSchema, oldRecord), getActualSchemaFromUnion(newSchema, oldRecord));
+ default:
+ return rewritePrimaryType(oldRecord, oldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ Schema realOldSchema = oldSchema;
+ if (realOldSchema.getType() == UNION) {
+ realOldSchema = getActualSchemaFromUnion(oldSchema, oldValue);
+ }
+ if (realOldSchema.getType() == newSchema.getType()) {
+ switch (realOldSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ case INT:
+ case LONG:
+ case FLOAT:
+ case DOUBLE:
+ case BYTES:
+ case STRING:
+ return oldValue;
+ case FIXED:
+ // fixed size and name must match:
+ if (!SchemaCompatibility.schemaNameEquals(realOldSchema, newSchema) || realOldSchema.getFixedSize() != newSchema.getFixedSize()) {
+ // deal with the precision change for decimalType
+ if (realOldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) realOldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale()).setScale(((LogicalTypes.Decimal) newSchema.getLogicalType()).getScale());
+ return DECIMAL_CONVERSION.toFixed(bd, newSchema, newSchema.getLogicalType());
+ }
+ } else {
+ return oldValue;
+ }
+ return oldValue;
+ default:
+ throw new AvroRuntimeException("Unknown schema type: " + newSchema.getType());
+ }
+ } else {
+ return rewritePrimaryTypeWithDiffSchemaType(oldValue, realOldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryTypeWithDiffSchemaType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ switch (newSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ break;
+ case INT:
+ if (newSchema.getLogicalType() == LogicalTypes.date() && oldSchema.getType() == Schema.Type.STRING) {
+ return fromJavaDate(Date.valueOf(oldValue.toString()));
+ }
+ break;
+ case LONG:
+ if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).longValue();
+ }
+ break;
+ case FLOAT:
+ if ((oldSchema.getType() == Schema.Type.INT)
+ || (oldSchema.getType() == Schema.Type.LONG)) {
+ return oldSchema.getType() == Schema.Type.INT ? ((Integer) oldValue).floatValue() : ((Long) oldValue).floatValue();
+ }
+ break;
+ case DOUBLE:
+ if (oldSchema.getType() == Schema.Type.FLOAT) {
+ // java float cannot convert to double directly, deal with float precision change
+ return Double.valueOf(oldValue + "");
+ } else if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).doubleValue();
+ } else if (oldSchema.getType() == Schema.Type.LONG) {
+ return ((Long) oldValue).doubleValue();
+ }
+ break;
+ case BYTES:
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ return ((String) oldValue).getBytes(StandardCharsets.UTF_8);
+ }
+ break;
+ case STRING:
+ if (oldSchema.getType() == Schema.Type.BYTES) {
+ return String.valueOf(((byte[]) oldValue));
+ }
+ if (oldSchema.getLogicalType() == LogicalTypes.date()) {
+ return toJavaDate((Integer) oldValue).toString();
+ }
+ if (oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT
+ || oldSchema.getType() == Schema.Type.DOUBLE) {
+ return oldValue.toString();
+ }
+ if (oldSchema.getType() == Schema.Type.FIXED && oldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) oldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale());
+ return bd.toString();
+ }
+ break;
+ case FIXED:
+ // deal with decimal Type
+ if (newSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ // TODO: support more types
+ if (oldSchema.getType() == Schema.Type.STRING
+ || oldSchema.getType() == Schema.Type.DOUBLE
+ || oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT) {
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) newSchema.getLogicalType();
+ BigDecimal bigDecimal = null;
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ bigDecimal = new java.math.BigDecimal((String) oldValue)
+ .setScale(decimal.getScale());
+ } else {
+ // Due to Java, there will be precision problems in direct conversion, we should use string instead of use double
+ bigDecimal = new java.math.BigDecimal(oldValue.toString())
+ .setScale(decimal.getScale());
+ }
+ return DECIMAL_CONVERSION.toFixed(bigDecimal, newSchema, newSchema.getLogicalType());
+ }
+ }
+ break;
+ default:
+ }
+ throw new AvroRuntimeException(String.format("cannot support rewrite value for schema type: %s since the old schema type is: %s", newSchema, oldSchema));
+ }
+
+ // convert days to Date
+ private static Date toJavaDate(int days) {
+ long localMillis = Math.multiplyExact(days, MILLIS_PER_DAY);
+ int timeZoneOffset;
+ TimeZone defaultTimeZone = TimeZone.getDefault();
+ if (defaultTimeZone instanceof sun.util.calendar.ZoneInfo) {
+ timeZoneOffset = ((sun.util.calendar.ZoneInfo) defaultTimeZone).getOffsetsByWall(localMillis, null);
+ } else {
+ timeZoneOffset = defaultTimeZone.getOffset(localMillis - defaultTimeZone.getRawOffset());
+ }
+ return new Date(localMillis - timeZoneOffset);
+ }
+
+ // convert Date to days
+ private static int fromJavaDate(Date date) {
+ long millisUtc = date.getTime();
+ long millisLocal = millisUtc + TimeZone.getDefault().getOffset(millisUtc);
+ int julianDays = Math.toIntExact(Math.floorDiv(millisLocal, MILLIS_PER_DAY));
+ return julianDays;
+ }
+
+ private static Schema getActualSchemaFromUnion(Schema schema, Object data) {
+ Schema actualSchema;
+ if (!schema.getType().equals(UNION)) {
+ return schema;
+ }
+ if (schema.getTypes().size() == 2
+ && schema.getTypes().get(0).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(1);
+ } else if (schema.getTypes().size() == 2
+ && schema.getTypes().get(1).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(0);
+ } else if (schema.getTypes().size() == 1) {
+ actualSchema = schema.getTypes().get(0);
+ } else {
+ // deal complex union. this should not happened in hoodie,
+ // since flink/spark do not write this type.
+ int i = GenericData.get().resolveUnion(schema, data);
+ actualSchema = schema.getTypes().get(i);
+ }
+ return actualSchema;
+ }
+
+ /**
+ * Given avro records, rewrites them with new schema.
+ *
+ * @param oldRecords oldRecords to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return a iterator of rewrote GeneriRcords
+ */
+ public static Iterator<GenericRecord> rewriteRecords(Iterator<GenericRecord> oldRecords, Schema newSchema) {
+ if (oldRecords == null || newSchema == null) {
+ return Collections.emptyIterator();
+ }
+ return new Iterator<GenericRecord>() {
+ @Override
+ public boolean hasNext() {
+ return oldRecords.hasNext();
+ }
+
+ @Override
+ public GenericRecord next() {
+ return rewriteRecord(oldRecords.next(), newSchema);
+ }
+ };
+ }
+
+ /**
+ * support evolution from a new avroSchema.
+ * notice: this is not a universal method,
Review comment:
Can you add more descriptive comments about this notice to capture when and why this method is used
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
+ private AvroSchemaUtil() {
+ }
+
+ private static final long MILLIS_PER_DAY = 86400000L;
+
+ //Export for test
+ public static final Conversions.DecimalConversion DECIMAL_CONVERSION = new Conversions.DecimalConversion();
+
+ /**
+ * Given a avro record with a given schema, rewrites it into the new schema while setting fields only from the new schema.
+ * support deep rewrite for nested record.
+ * This particular method does the following things :
+ * a) Create a new empty GenericRecord with the new schema.
+ * b) For GenericRecord, copy over the data from the old schema to the new schema or set default values for all fields of this transformed schema
+ *
+ * @param oldRecord oldRecord to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return newRecord for new Schema
+ */
+ public static GenericRecord rewriteRecord(IndexedRecord oldRecord, Schema newSchema) {
+ Object newRecord = rewriteRecord(oldRecord, oldRecord.getSchema(), newSchema);
+ return (GenericData.Record) newRecord;
+ }
+
+ private static Object rewriteRecord(Object oldRecord, Schema oldSchema, Schema newSchema) {
+ if (oldRecord == null) {
+ return null;
+ }
+ switch (newSchema.getType()) {
+ case RECORD:
+ if (!(oldRecord instanceof IndexedRecord)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ IndexedRecord indexedRecord = (IndexedRecord) oldRecord;
+ List<Schema.Field> fields = newSchema.getFields();
+ Map<Integer, Object> helper = new HashMap<>();
+
+ for (int i = 0; i < fields.size(); i++) {
+ Schema.Field field = fields.get(i);
+ if (oldSchema.getField(field.name()) != null) {
+ Schema.Field oldField = oldSchema.getField(field.name());
+ helper.put(i, rewriteRecord(indexedRecord.get(oldField.pos()), oldField.schema(), fields.get(i).schema()));
+ }
+ }
+ GenericData.Record newRecord = new GenericData.Record(newSchema);
+ for (int i = 0; i < fields.size(); i++) {
+ if (helper.containsKey(i)) {
+ newRecord.put(i, helper.get(i));
+ } else {
+ if (fields.get(i).defaultVal() instanceof JsonProperties.Null) {
+ newRecord.put(i, null);
+ } else {
+ newRecord.put(i, fields.get(i).defaultVal());
+ }
+ }
+ }
+ return newRecord;
+ case ARRAY:
+ if (!(oldRecord instanceof Collection)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Collection array = (Collection)oldRecord;
+ List<Object> newArray = new ArrayList();
+ for (Object element : array) {
+ newArray.add(rewriteRecord(element, oldSchema.getElementType(), newSchema.getElementType()));
+ }
+ return newArray;
+ case MAP:
+ if (!(oldRecord instanceof Map)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Map<Object, Object> map = (Map<Object, Object>) oldRecord;
+ Map<Object, Object> newMap = new HashMap<>();
+ for (Map.Entry<Object, Object> entry : map.entrySet()) {
+ newMap.put(entry.getKey(), rewriteRecord(entry.getValue(), oldSchema.getValueType(), newSchema.getValueType()));
+ }
+ return newMap;
+ case UNION:
+ return rewriteRecord(oldRecord, getActualSchemaFromUnion(oldSchema, oldRecord), getActualSchemaFromUnion(newSchema, oldRecord));
+ default:
+ return rewritePrimaryType(oldRecord, oldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ Schema realOldSchema = oldSchema;
+ if (realOldSchema.getType() == UNION) {
+ realOldSchema = getActualSchemaFromUnion(oldSchema, oldValue);
+ }
+ if (realOldSchema.getType() == newSchema.getType()) {
+ switch (realOldSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ case INT:
+ case LONG:
+ case FLOAT:
+ case DOUBLE:
+ case BYTES:
+ case STRING:
+ return oldValue;
+ case FIXED:
+ // fixed size and name must match:
+ if (!SchemaCompatibility.schemaNameEquals(realOldSchema, newSchema) || realOldSchema.getFixedSize() != newSchema.getFixedSize()) {
+ // deal with the precision change for decimalType
+ if (realOldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) realOldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale()).setScale(((LogicalTypes.Decimal) newSchema.getLogicalType()).getScale());
+ return DECIMAL_CONVERSION.toFixed(bd, newSchema, newSchema.getLogicalType());
+ }
+ } else {
+ return oldValue;
+ }
+ return oldValue;
+ default:
+ throw new AvroRuntimeException("Unknown schema type: " + newSchema.getType());
+ }
+ } else {
+ return rewritePrimaryTypeWithDiffSchemaType(oldValue, realOldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryTypeWithDiffSchemaType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ switch (newSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ break;
+ case INT:
+ if (newSchema.getLogicalType() == LogicalTypes.date() && oldSchema.getType() == Schema.Type.STRING) {
+ return fromJavaDate(Date.valueOf(oldValue.toString()));
+ }
+ break;
+ case LONG:
+ if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).longValue();
+ }
+ break;
+ case FLOAT:
+ if ((oldSchema.getType() == Schema.Type.INT)
+ || (oldSchema.getType() == Schema.Type.LONG)) {
+ return oldSchema.getType() == Schema.Type.INT ? ((Integer) oldValue).floatValue() : ((Long) oldValue).floatValue();
+ }
+ break;
+ case DOUBLE:
+ if (oldSchema.getType() == Schema.Type.FLOAT) {
+ // java float cannot convert to double directly, deal with float precision change
+ return Double.valueOf(oldValue + "");
+ } else if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).doubleValue();
+ } else if (oldSchema.getType() == Schema.Type.LONG) {
+ return ((Long) oldValue).doubleValue();
+ }
+ break;
+ case BYTES:
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ return ((String) oldValue).getBytes(StandardCharsets.UTF_8);
+ }
+ break;
+ case STRING:
+ if (oldSchema.getType() == Schema.Type.BYTES) {
+ return String.valueOf(((byte[]) oldValue));
+ }
+ if (oldSchema.getLogicalType() == LogicalTypes.date()) {
+ return toJavaDate((Integer) oldValue).toString();
+ }
+ if (oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT
+ || oldSchema.getType() == Schema.Type.DOUBLE) {
+ return oldValue.toString();
+ }
+ if (oldSchema.getType() == Schema.Type.FIXED && oldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) oldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale());
+ return bd.toString();
+ }
+ break;
+ case FIXED:
+ // deal with decimal Type
+ if (newSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ // TODO: support more types
+ if (oldSchema.getType() == Schema.Type.STRING
+ || oldSchema.getType() == Schema.Type.DOUBLE
+ || oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT) {
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) newSchema.getLogicalType();
+ BigDecimal bigDecimal = null;
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ bigDecimal = new java.math.BigDecimal((String) oldValue)
+ .setScale(decimal.getScale());
+ } else {
+ // Due to Java, there will be precision problems in direct conversion, we should use string instead of use double
+ bigDecimal = new java.math.BigDecimal(oldValue.toString())
+ .setScale(decimal.getScale());
+ }
+ return DECIMAL_CONVERSION.toFixed(bigDecimal, newSchema, newSchema.getLogicalType());
+ }
+ }
+ break;
+ default:
+ }
+ throw new AvroRuntimeException(String.format("cannot support rewrite value for schema type: %s since the old schema type is: %s", newSchema, oldSchema));
+ }
+
+ // convert days to Date
+ private static Date toJavaDate(int days) {
+ long localMillis = Math.multiplyExact(days, MILLIS_PER_DAY);
+ int timeZoneOffset;
+ TimeZone defaultTimeZone = TimeZone.getDefault();
+ if (defaultTimeZone instanceof sun.util.calendar.ZoneInfo) {
+ timeZoneOffset = ((sun.util.calendar.ZoneInfo) defaultTimeZone).getOffsetsByWall(localMillis, null);
+ } else {
+ timeZoneOffset = defaultTimeZone.getOffset(localMillis - defaultTimeZone.getRawOffset());
+ }
+ return new Date(localMillis - timeZoneOffset);
+ }
+
+ // convert Date to days
+ private static int fromJavaDate(Date date) {
+ long millisUtc = date.getTime();
+ long millisLocal = millisUtc + TimeZone.getDefault().getOffset(millisUtc);
+ int julianDays = Math.toIntExact(Math.floorDiv(millisLocal, MILLIS_PER_DAY));
+ return julianDays;
+ }
+
+ private static Schema getActualSchemaFromUnion(Schema schema, Object data) {
+ Schema actualSchema;
+ if (!schema.getType().equals(UNION)) {
+ return schema;
+ }
+ if (schema.getTypes().size() == 2
+ && schema.getTypes().get(0).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(1);
+ } else if (schema.getTypes().size() == 2
+ && schema.getTypes().get(1).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(0);
+ } else if (schema.getTypes().size() == 1) {
+ actualSchema = schema.getTypes().get(0);
+ } else {
+ // deal complex union. this should not happened in hoodie,
+ // since flink/spark do not write this type.
+ int i = GenericData.get().resolveUnion(schema, data);
+ actualSchema = schema.getTypes().get(i);
+ }
+ return actualSchema;
+ }
+
+ /**
+ * Given avro records, rewrites them with new schema.
+ *
+ * @param oldRecords oldRecords to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return a iterator of rewrote GeneriRcords
+ */
+ public static Iterator<GenericRecord> rewriteRecords(Iterator<GenericRecord> oldRecords, Schema newSchema) {
+ if (oldRecords == null || newSchema == null) {
+ return Collections.emptyIterator();
+ }
+ return new Iterator<GenericRecord>() {
+ @Override
+ public boolean hasNext() {
+ return oldRecords.hasNext();
+ }
+
+ @Override
+ public GenericRecord next() {
+ return rewriteRecord(oldRecords.next(), newSchema);
+ }
+ };
+ }
+
+ /**
+ * support evolution from a new avroSchema.
+ * notice: this is not a universal method,
+ * now hoodie support implicitly add columns when hoodie write operation,
+ * This ability needs to be preserved, so implicitly evolution for internalSchema should supported.
+ *
+ * @param evolvedSchema implicitly evolution of avro when hoodie write operation
+ * @param oldSchema old internalSchema
+ * @param supportPositionReorder support position reorder
+ * @return evolution Schema
+ */
+ public static InternalSchema evolutionSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema, Boolean supportPositionReorder) {
+ InternalSchema evolvedInternalSchema = AvroInternalSchemaConverter.convert(evolvedSchema);
+ // do check, only support add column evolution
+ List<String> colNamesFromEvolved = evolvedInternalSchema.getAllColsFullName();
+ List<String> colNamesFromOldSchema = oldSchema.getAllColsFullName();
+ List<String> diffFromOldSchema = colNamesFromOldSchema.stream().filter(f -> !colNamesFromEvolved.contains(f)).collect(Collectors.toList());
+ List<Types.Field> newFields = new ArrayList<>();
+ if (colNamesFromEvolved.size() == colNamesFromOldSchema.size() && diffFromOldSchema.size() == 0) {
+ // no changes happen
+ if (supportPositionReorder) {
+ evolvedInternalSchema.getRecord().fields().forEach(f -> newFields.add(oldSchema.getRecord().field(f.name())));
+ return new InternalSchema(newFields);
+ }
+ return oldSchema;
+ }
+ // try to find all added columns
+ if (diffFromOldSchema.size() != 0) {
+ throw new UnsupportedOperationException("cannot evolution schema implicitly, find delete/rename operation");
+ }
+
+ List<String> diffFromEvolutionSchema = colNamesFromEvolved.stream().filter(f -> !colNamesFromOldSchema.contains(f)).collect(Collectors.toList());
+ // Remove redundancy from diffFromEvolutionSchema.
+ // for example, now we add a struct col in evolvedSchema, the struct col is " user struct<name:string, age:int> "
+ // when we do diff operation: user, user.name, user.age will appeared in the resultSet which is redundancy, user.name and user.age should be excluded.
+ // deal with add operation
+ TreeMap<Integer, String> finalAddAction = new TreeMap<>();
+ for (int i = 0; i < diffFromEvolutionSchema.size(); i++) {
+ String name = diffFromEvolutionSchema.get(i);
+ int splitPoint = name.lastIndexOf(".");
+ String parentName = splitPoint > 0 ? name.substring(0, splitPoint) : "";
+ if (!parentName.isEmpty() && diffFromEvolutionSchema.contains(parentName)) {
+ // find redundancy, skip it
+ continue;
+ }
+ finalAddAction.put(evolvedInternalSchema.findIdByName(name), name);
+ }
+
+ TableChanges.ColumnAddChange addChange = TableChanges.ColumnAddChange.get(oldSchema);
+ finalAddAction.entrySet().stream().forEach(f -> {
+ String name = f.getValue();
+ int splitPoint = name.lastIndexOf(".");
+ String parentName = splitPoint > 0 ? name.substring(0, splitPoint) : "";
+ String rawName = splitPoint > 0 ? name.substring(splitPoint + 1) : name;
+ addChange.addColumns(parentName, rawName, evolvedInternalSchema.findType(name), null);
+ });
+
+ InternalSchema res = SchemaChangeUtils.applyTableChanges2Schema(oldSchema, addChange);
+ if (supportPositionReorder) {
+ evolvedInternalSchema.getRecord().fields().forEach(f -> newFields.add(oldSchema.getRecord().field(f.name())));
+ return new InternalSchema(newFields);
+ } else {
+ return res;
+ }
+ }
+
+ public static InternalSchema evolutionSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema) {
+ return evolutionSchemaFromNewAvroSchema(evolvedSchema, oldSchema, false);
+ }
+
+ /**
+ * canonical the nullability.
+ * do not allow change cols Nullability field from optional to required.
+ * if above problem occurs, try to correct it.
+ *
+ * @param writeSchema writeSchema hoodie used to write data.
+ * @param readSchema read schema
+ * @return canonical Schema
+ */
+ public static Schema canonicalColumnNullability(Schema writeSchema, Schema readSchema) {
Review comment:
nit: canonical to canonicalize
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SerDeHelper.java
##########
@@ -0,0 +1,384 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import com.fasterxml.jackson.core.JsonFactory;
+import com.fasterxml.jackson.core.JsonGenerator;
+import com.fasterxml.jackson.databind.JsonNode;
+import com.fasterxml.jackson.databind.ObjectMapper;
+
+import org.apache.hadoop.hbase.exceptions.IllegalArgumentIOException;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.io.IOException;
+import java.io.StringWriter;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Locale;
+import java.util.SortedMap;
+import java.util.TreeMap;
+import java.util.regex.Matcher;
+import java.util.regex.Pattern;
+
+public class SerDeHelper {
+ private SerDeHelper() {
+
+ }
+
+ public static final String LATESTSCHEMA = "latestSchema";
+ public static final String SCHEMAS = "schemas";
+ private static final String MAX_COLUMN_ID = "max_column_id";
+ private static final String VERSION_ID = "version-id";
+ private static final String TYPE = "type";
+ private static final String RECORD = "record";
+ private static final String ARRAY = "array";
+ private static final String MAP = "map";
+ private static final String FIELDS = "fields";
+ private static final String ELEMENT = "element";
+ private static final String KEY = "key";
+ private static final String VALUE = "value";
+ private static final String DOC = "doc";
+ private static final String NAME = "name";
+ private static final String ID = "id";
+ private static final String ELEMENT_ID = "element-id";
+ private static final String KEY_ID = "key-id";
+ private static final String VALUE_ID = "value-id";
+ private static final String OPTIONAL = "optional";
+ private static final String ELEMENT_OPTIONAL = "element_optional";
+ private static final String VALUE_OPTIONAL = "value_optional";
+
+ private static final Pattern FIXED = Pattern.compile("fixed\\[(\\d+)\\]");
+ private static final Pattern DECIMAL = Pattern.compile("decimal\\((\\d+),\\s+(\\d+)\\)");
+
+ /**
+ * convert history internalSchemas to json.
+ * this is used when save history schemas into hudi.
+ *
+ * @param internalSchemas history internal schemas
+ * @return a string
+ */
+ public static String toJson(List<InternalSchema> internalSchemas) {
+ try {
+ StringWriter writer = new StringWriter();
+ JsonGenerator generator = (new JsonFactory()).createGenerator(writer);
+ generator.writeStartObject();
+ generator.writeArrayFieldStart(SCHEMAS);
+ for (InternalSchema schema : internalSchemas) {
+ toJson(schema, generator);
+ }
+ generator.writeEndArray();
+ generator.writeEndObject();
+ generator.flush();
+ return writer.toString();
+ } catch (IOException e) {
+ throw new RuntimeException(e);
+ }
+ }
+
+ /**
+ * convert internalSchemas to json.
+ *
+ * @param internalSchema a internal schema
+ * @return a string
+ */
+ public static String toJson(InternalSchema internalSchema) {
+ if (internalSchema == null || internalSchema.isDummySchema()) {
+ return "";
+ }
+ try {
+ StringWriter writer = new StringWriter();
+ JsonGenerator generator = (new JsonFactory()).createGenerator(writer);
+ toJson(internalSchema, generator);
+ generator.flush();
+ return writer.toString();
+ } catch (IOException e) {
+ throw new RuntimeException(e);
+ }
+ }
+
+ private static void toJson(InternalSchema internalSchema, JsonGenerator generator) throws IOException {
+ toJson(internalSchema.getRecord(), internalSchema.getMax_column_id(), internalSchema.schemaId(), generator);
+ }
+
+ private static void toJson(Types.RecordType record, Integer maxColumnId, Long versionId, JsonGenerator generator) throws IOException {
+ generator.writeStartObject();
+ if (maxColumnId != null) {
+ generator.writeNumberField(MAX_COLUMN_ID, maxColumnId);
+ }
+ if (versionId != null) {
+ generator.writeNumberField(VERSION_ID, versionId);
+ }
+ generator.writeStringField(TYPE, RECORD);
+ generator.writeArrayFieldStart(FIELDS);
+ for (Types.Field field : record.fields()) {
+ generator.writeStartObject();
+ generator.writeNumberField(ID, field.fieldId());
+ generator.writeStringField(NAME, field.name());
+ generator.writeBooleanField(OPTIONAL, field.isOptional());
+ generator.writeFieldName(TYPE);
+ toJson(field.type(), generator);
+ if (field.doc() != null) {
+ generator.writeStringField(DOC, field.doc());
+ }
+ generator.writeEndObject();
+ }
+ generator.writeEndArray();
+ generator.writeEndObject();
+ }
+
+ private static void toJson(Type type, JsonGenerator generator) throws IOException {
+ switch (type.typeId()) {
+ case RECORD:
+ toJson((Types.RecordType) type, null, null, generator);
+ break;
+ case ARRAY:
+ Types.ArrayType array = (Types.ArrayType) type;
+ generator.writeStartObject();
+ generator.writeStringField(TYPE, ARRAY);
+ generator.writeNumberField(ELEMENT_ID, array.elementId());
+ generator.writeFieldName(ELEMENT);
+ toJson(array.elementType(), generator);
+ generator.writeBooleanField(ELEMENT_OPTIONAL, array.isElementOptional());
+ generator.writeEndObject();
+ break;
+ case MAP:
+ Types.MapType map = (Types.MapType) type;
+ generator.writeStartObject();
+ generator.writeStringField(TYPE, MAP);
+ generator.writeNumberField(KEY_ID, map.keyId());
+ generator.writeFieldName(KEY);
+ toJson(map.keyType(), generator);
+ generator.writeNumberField(VALUE_ID, map.valueId());
+ generator.writeFieldName(VALUE);
+ toJson(map.valueType(), generator);
+ generator.writeBooleanField(VALUE_OPTIONAL, map.isValueOptional());
+ generator.writeEndObject();
+ break;
+ default:
+ if (!type.isNestedType()) {
+ generator.writeString(type.toString());
+ } else {
+ throw new IllegalArgumentIOException(String.format("cannot write unknown types: %s", type));
+ }
+ }
+ }
+
+ private static Type parserTypeFromJson(JsonNode jsonNode) {
+ if (jsonNode.isTextual()) {
+ String type = jsonNode.asText().toLowerCase(Locale.ROOT);
+ // deal with fixed and decimal
+ Matcher fixed = FIXED.matcher(type);
+ if (fixed.matches()) {
+ return Types.FixedType.getFixed(Integer.parseInt(fixed.group(1)));
+ }
+ Matcher decimal = DECIMAL.matcher(type);
+ if (decimal.matches()) {
+ return Types.DecimalType.get(
+ Integer.parseInt(decimal.group(1)),
+ Integer.parseInt(decimal.group(2)));
+ }
+ // deal with other type
+ switch (Type.fromValue(type)) {
+ case BOOLEAN:
+ return Types.BooleanType.get();
+ case INT:
+ return Types.IntType.get();
+ case LONG:
+ return Types.LongType.get();
+ case FLOAT:
+ return Types.FloatType.get();
+ case DOUBLE:
+ return Types.DoubleType.get();
+ case DATE:
+ return Types.DateType.get();
+ case TIME:
+ return Types.TimeType.get();
+ case TIMESTAMP:
+ return Types.TimestampType.get();
+ case STRING:
+ return Types.StringType.get();
+ case UUID:
+ return Types.UUIDType.get();
+ case BINARY:
+ return Types.BinaryType.get();
+ default:
+ throw new IllegalArgumentException("cannot parser types from jsonNode");
+ }
+ } else if (jsonNode.isObject()) {
+ String typeStr = jsonNode.get(TYPE).asText();
+ if (RECORD.equals(typeStr)) {
+ JsonNode fieldNodes = jsonNode.get(FIELDS);
+ Iterator<JsonNode> iter = fieldNodes.elements();
+ List<Types.Field> fields = new ArrayList<>();
+ while (iter.hasNext()) {
+ JsonNode field = iter.next();
+ // extract
+ int id = field.get(ID).asInt();
+ String name = field.get(NAME).asText();
+ Type type = parserTypeFromJson(field.get(TYPE));
+ String doc = field.has(DOC) ? field.get(DOC).asText() : null;
+ boolean optional = field.get(OPTIONAL).asBoolean();
+ // build fields
+ fields.add(Types.Field.get(id, optional, name, type, doc));
+ }
+ return Types.RecordType.get(fields);
+ } else if (ARRAY.equals(typeStr)) {
+ int elementId = jsonNode.get(ELEMENT_ID).asInt();
+ Type elementType = parserTypeFromJson(jsonNode.get(ELEMENT));
+ boolean optional = jsonNode.get(ELEMENT_OPTIONAL).asBoolean();
+ return Types.ArrayType.get(elementId, optional, elementType);
+ } else if (MAP.equals(typeStr)) {
+ int keyId = jsonNode.get(KEY_ID).asInt();
+ Type keyType = parserTypeFromJson(jsonNode.get(KEY));
+ int valueId = jsonNode.get(VALUE_ID).asInt();
+ Type valueType = parserTypeFromJson(jsonNode.get(VALUE));
+ boolean optional = jsonNode.get(VALUE_OPTIONAL).asBoolean();
+ return Types.MapType.get(keyId, valueId, keyType, valueType, optional);
+ }
+ }
+ throw new IllegalArgumentException(String.format("cannot parse type from jsonNode: %s", jsonNode));
+ }
+
+ /**
+ * convert jsonNode to internalSchema.
+ *
+ * @param jsonNode a jsonNode.
+ * @return a internalSchema.
+ */
+ public static InternalSchema fromJson(JsonNode jsonNode) {
+ Integer maxColumnId = !jsonNode.has(MAX_COLUMN_ID) ? null : jsonNode.get(MAX_COLUMN_ID).asInt();
+ Long versionId = !jsonNode.has(VERSION_ID) ? null : jsonNode.get(VERSION_ID).asLong();
+ Types.RecordType type = (Types.RecordType)parserTypeFromJson(jsonNode);
+ if (versionId == null) {
+ return new InternalSchema(type.fields());
+ } else {
+ if (maxColumnId != null) {
+ return new InternalSchema(versionId, maxColumnId, type.fields());
+ } else {
+ return new InternalSchema(versionId, type.fields());
+ }
+ }
+ }
+
+ /**
+ * convert string to internalSchema.
+ *
+ * @param json a json string.
+ * @return a internalSchema.
+ */
+ public static Option<InternalSchema> fromJson(String json) {
+ if (json == null || json.isEmpty()) {
+ return Option.empty();
+ }
+ try {
+ return Option.of(fromJson((new ObjectMapper(new JsonFactory())).readValue(json, JsonNode.class)));
+ } catch (IOException e) {
+ throw new RuntimeException(e);
+ }
+ }
+
+ /**
+ * convert json string to history internalSchemas.
+ * TreeMap is used to hold history internalSchemas.
+ *
+ * @param json a json string
+ * @return a TreeMap
+ */
+ public static TreeMap<Long, InternalSchema> parseSchemas(String json) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ try {
+ JsonNode jsonNode = (new ObjectMapper(new JsonFactory())).readValue(json, JsonNode.class);
+ if (!jsonNode.has(SCHEMAS)) {
+ throw new IllegalArgumentException(String.format("cannot parser schemas from current json string, missing key name: %s", SCHEMAS));
+ }
+ JsonNode schemas = jsonNode.get(SCHEMAS);
+ Iterator<JsonNode> iter = schemas.elements();
+ while (iter.hasNext()) {
+ JsonNode schema = iter.next();
+ InternalSchema current = fromJson(schema);
+ result.put(current.schemaId(), current);
+ }
+ } catch (IOException e) {
+ throw new HoodieException(e);
+ }
+ return result;
+ }
+
+ /**
+ * search target internalSchema by version number.
+ *
+ * @param versionId the internalSchema version to be search.
+ * @param internalSchemas internalSchemas to be searched.
+ * @return a internalSchema.
+ */
+ public static InternalSchema searchSchema(long versionId, List<InternalSchema> internalSchemas) {
Review comment:
The methods: searchSchema and inheritSchema does not belong to this class. This class should only deal with conversion to/from json.
There are many classes which are named as "xxxxUtils", "xxxxHelper" which does a bunch of different things affecting code readability :)
Instead, it would be better if we group only related methods in a class and name them accordingly.
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
+ private AvroSchemaUtil() {
+ }
+
+ private static final long MILLIS_PER_DAY = 86400000L;
+
+ //Export for test
+ public static final Conversions.DecimalConversion DECIMAL_CONVERSION = new Conversions.DecimalConversion();
+
+ /**
+ * Given a avro record with a given schema, rewrites it into the new schema while setting fields only from the new schema.
+ * support deep rewrite for nested record.
+ * This particular method does the following things :
+ * a) Create a new empty GenericRecord with the new schema.
+ * b) For GenericRecord, copy over the data from the old schema to the new schema or set default values for all fields of this transformed schema
+ *
+ * @param oldRecord oldRecord to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return newRecord for new Schema
+ */
+ public static GenericRecord rewriteRecord(IndexedRecord oldRecord, Schema newSchema) {
+ Object newRecord = rewriteRecord(oldRecord, oldRecord.getSchema(), newSchema);
+ return (GenericData.Record) newRecord;
+ }
+
+ private static Object rewriteRecord(Object oldRecord, Schema oldSchema, Schema newSchema) {
+ if (oldRecord == null) {
+ return null;
+ }
+ switch (newSchema.getType()) {
+ case RECORD:
+ if (!(oldRecord instanceof IndexedRecord)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ IndexedRecord indexedRecord = (IndexedRecord) oldRecord;
+ List<Schema.Field> fields = newSchema.getFields();
+ Map<Integer, Object> helper = new HashMap<>();
+
+ for (int i = 0; i < fields.size(); i++) {
+ Schema.Field field = fields.get(i);
+ if (oldSchema.getField(field.name()) != null) {
+ Schema.Field oldField = oldSchema.getField(field.name());
+ helper.put(i, rewriteRecord(indexedRecord.get(oldField.pos()), oldField.schema(), fields.get(i).schema()));
+ }
+ }
+ GenericData.Record newRecord = new GenericData.Record(newSchema);
+ for (int i = 0; i < fields.size(); i++) {
+ if (helper.containsKey(i)) {
+ newRecord.put(i, helper.get(i));
+ } else {
+ if (fields.get(i).defaultVal() instanceof JsonProperties.Null) {
+ newRecord.put(i, null);
+ } else {
+ newRecord.put(i, fields.get(i).defaultVal());
+ }
+ }
+ }
+ return newRecord;
+ case ARRAY:
+ if (!(oldRecord instanceof Collection)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Collection array = (Collection)oldRecord;
+ List<Object> newArray = new ArrayList();
+ for (Object element : array) {
+ newArray.add(rewriteRecord(element, oldSchema.getElementType(), newSchema.getElementType()));
+ }
+ return newArray;
+ case MAP:
+ if (!(oldRecord instanceof Map)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Map<Object, Object> map = (Map<Object, Object>) oldRecord;
+ Map<Object, Object> newMap = new HashMap<>();
+ for (Map.Entry<Object, Object> entry : map.entrySet()) {
+ newMap.put(entry.getKey(), rewriteRecord(entry.getValue(), oldSchema.getValueType(), newSchema.getValueType()));
+ }
+ return newMap;
+ case UNION:
+ return rewriteRecord(oldRecord, getActualSchemaFromUnion(oldSchema, oldRecord), getActualSchemaFromUnion(newSchema, oldRecord));
+ default:
+ return rewritePrimaryType(oldRecord, oldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ Schema realOldSchema = oldSchema;
+ if (realOldSchema.getType() == UNION) {
+ realOldSchema = getActualSchemaFromUnion(oldSchema, oldValue);
+ }
+ if (realOldSchema.getType() == newSchema.getType()) {
+ switch (realOldSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ case INT:
+ case LONG:
+ case FLOAT:
+ case DOUBLE:
+ case BYTES:
+ case STRING:
+ return oldValue;
+ case FIXED:
+ // fixed size and name must match:
+ if (!SchemaCompatibility.schemaNameEquals(realOldSchema, newSchema) || realOldSchema.getFixedSize() != newSchema.getFixedSize()) {
+ // deal with the precision change for decimalType
+ if (realOldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) realOldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale()).setScale(((LogicalTypes.Decimal) newSchema.getLogicalType()).getScale());
+ return DECIMAL_CONVERSION.toFixed(bd, newSchema, newSchema.getLogicalType());
+ }
+ } else {
+ return oldValue;
+ }
+ return oldValue;
+ default:
+ throw new AvroRuntimeException("Unknown schema type: " + newSchema.getType());
+ }
+ } else {
+ return rewritePrimaryTypeWithDiffSchemaType(oldValue, realOldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryTypeWithDiffSchemaType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ switch (newSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ break;
+ case INT:
+ if (newSchema.getLogicalType() == LogicalTypes.date() && oldSchema.getType() == Schema.Type.STRING) {
+ return fromJavaDate(Date.valueOf(oldValue.toString()));
+ }
+ break;
+ case LONG:
+ if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).longValue();
+ }
+ break;
+ case FLOAT:
+ if ((oldSchema.getType() == Schema.Type.INT)
+ || (oldSchema.getType() == Schema.Type.LONG)) {
+ return oldSchema.getType() == Schema.Type.INT ? ((Integer) oldValue).floatValue() : ((Long) oldValue).floatValue();
+ }
+ break;
+ case DOUBLE:
+ if (oldSchema.getType() == Schema.Type.FLOAT) {
+ // java float cannot convert to double directly, deal with float precision change
+ return Double.valueOf(oldValue + "");
+ } else if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).doubleValue();
+ } else if (oldSchema.getType() == Schema.Type.LONG) {
+ return ((Long) oldValue).doubleValue();
+ }
+ break;
+ case BYTES:
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ return ((String) oldValue).getBytes(StandardCharsets.UTF_8);
+ }
+ break;
+ case STRING:
+ if (oldSchema.getType() == Schema.Type.BYTES) {
+ return String.valueOf(((byte[]) oldValue));
+ }
+ if (oldSchema.getLogicalType() == LogicalTypes.date()) {
+ return toJavaDate((Integer) oldValue).toString();
+ }
+ if (oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT
+ || oldSchema.getType() == Schema.Type.DOUBLE) {
+ return oldValue.toString();
+ }
+ if (oldSchema.getType() == Schema.Type.FIXED && oldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) oldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale());
+ return bd.toString();
+ }
+ break;
+ case FIXED:
+ // deal with decimal Type
+ if (newSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ // TODO: support more types
+ if (oldSchema.getType() == Schema.Type.STRING
+ || oldSchema.getType() == Schema.Type.DOUBLE
+ || oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT) {
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) newSchema.getLogicalType();
+ BigDecimal bigDecimal = null;
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ bigDecimal = new java.math.BigDecimal((String) oldValue)
+ .setScale(decimal.getScale());
+ } else {
+ // Due to Java, there will be precision problems in direct conversion, we should use string instead of use double
+ bigDecimal = new java.math.BigDecimal(oldValue.toString())
+ .setScale(decimal.getScale());
+ }
+ return DECIMAL_CONVERSION.toFixed(bigDecimal, newSchema, newSchema.getLogicalType());
+ }
+ }
+ break;
+ default:
+ }
+ throw new AvroRuntimeException(String.format("cannot support rewrite value for schema type: %s since the old schema type is: %s", newSchema, oldSchema));
+ }
+
+ // convert days to Date
+ private static Date toJavaDate(int days) {
+ long localMillis = Math.multiplyExact(days, MILLIS_PER_DAY);
+ int timeZoneOffset;
+ TimeZone defaultTimeZone = TimeZone.getDefault();
+ if (defaultTimeZone instanceof sun.util.calendar.ZoneInfo) {
+ timeZoneOffset = ((sun.util.calendar.ZoneInfo) defaultTimeZone).getOffsetsByWall(localMillis, null);
+ } else {
+ timeZoneOffset = defaultTimeZone.getOffset(localMillis - defaultTimeZone.getRawOffset());
+ }
+ return new Date(localMillis - timeZoneOffset);
+ }
+
+ // convert Date to days
+ private static int fromJavaDate(Date date) {
+ long millisUtc = date.getTime();
+ long millisLocal = millisUtc + TimeZone.getDefault().getOffset(millisUtc);
+ int julianDays = Math.toIntExact(Math.floorDiv(millisLocal, MILLIS_PER_DAY));
+ return julianDays;
+ }
+
+ private static Schema getActualSchemaFromUnion(Schema schema, Object data) {
+ Schema actualSchema;
+ if (!schema.getType().equals(UNION)) {
+ return schema;
+ }
+ if (schema.getTypes().size() == 2
+ && schema.getTypes().get(0).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(1);
+ } else if (schema.getTypes().size() == 2
+ && schema.getTypes().get(1).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(0);
+ } else if (schema.getTypes().size() == 1) {
+ actualSchema = schema.getTypes().get(0);
+ } else {
+ // deal complex union. this should not happened in hoodie,
+ // since flink/spark do not write this type.
+ int i = GenericData.get().resolveUnion(schema, data);
+ actualSchema = schema.getTypes().get(i);
+ }
+ return actualSchema;
+ }
+
+ /**
+ * Given avro records, rewrites them with new schema.
+ *
+ * @param oldRecords oldRecords to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return a iterator of rewrote GeneriRcords
+ */
+ public static Iterator<GenericRecord> rewriteRecords(Iterator<GenericRecord> oldRecords, Schema newSchema) {
+ if (oldRecords == null || newSchema == null) {
+ return Collections.emptyIterator();
+ }
+ return new Iterator<GenericRecord>() {
+ @Override
+ public boolean hasNext() {
+ return oldRecords.hasNext();
+ }
+
+ @Override
+ public GenericRecord next() {
+ return rewriteRecord(oldRecords.next(), newSchema);
+ }
+ };
+ }
+
+ /**
+ * support evolution from a new avroSchema.
+ * notice: this is not a universal method,
+ * now hoodie support implicitly add columns when hoodie write operation,
+ * This ability needs to be preserved, so implicitly evolution for internalSchema should supported.
+ *
+ * @param evolvedSchema implicitly evolution of avro when hoodie write operation
+ * @param oldSchema old internalSchema
+ * @param supportPositionReorder support position reorder
+ * @return evolution Schema
+ */
+ public static InternalSchema evolutionSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema, Boolean supportPositionReorder) {
Review comment:
Can we move methods that handles InternalSchema to one class.
Can you look at HoodieAvroUtils and move the avro specific methods to that class. There is a rewrite method there (without schema evolution handling).It would be better to add the methods to that class
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/InternalSchemaUtils.java
##########
@@ -0,0 +1,856 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalType;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.HoodieSchemaException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+import org.apache.hudi.internal.schema.visitor.InternalSchemaVisitor;
+import org.apache.hudi.internal.schema.visitor.NameToIDVisitor;
+
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.HashMap;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class InternalSchemaUtils {
Review comment:
This class primarily deals with building Internal Schema. Lets rename the class to InternalSchemaBuilder and make the relevant methods non-static.
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
+ private AvroSchemaUtil() {
+ }
+
+ private static final long MILLIS_PER_DAY = 86400000L;
+
+ //Export for test
+ public static final Conversions.DecimalConversion DECIMAL_CONVERSION = new Conversions.DecimalConversion();
+
+ /**
+ * Given a avro record with a given schema, rewrites it into the new schema while setting fields only from the new schema.
+ * support deep rewrite for nested record.
+ * This particular method does the following things :
+ * a) Create a new empty GenericRecord with the new schema.
+ * b) For GenericRecord, copy over the data from the old schema to the new schema or set default values for all fields of this transformed schema
+ *
+ * @param oldRecord oldRecord to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return newRecord for new Schema
+ */
+ public static GenericRecord rewriteRecord(IndexedRecord oldRecord, Schema newSchema) {
+ Object newRecord = rewriteRecord(oldRecord, oldRecord.getSchema(), newSchema);
+ return (GenericData.Record) newRecord;
+ }
+
+ private static Object rewriteRecord(Object oldRecord, Schema oldSchema, Schema newSchema) {
+ if (oldRecord == null) {
+ return null;
+ }
+ switch (newSchema.getType()) {
+ case RECORD:
+ if (!(oldRecord instanceof IndexedRecord)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ IndexedRecord indexedRecord = (IndexedRecord) oldRecord;
+ List<Schema.Field> fields = newSchema.getFields();
+ Map<Integer, Object> helper = new HashMap<>();
+
+ for (int i = 0; i < fields.size(); i++) {
+ Schema.Field field = fields.get(i);
+ if (oldSchema.getField(field.name()) != null) {
+ Schema.Field oldField = oldSchema.getField(field.name());
+ helper.put(i, rewriteRecord(indexedRecord.get(oldField.pos()), oldField.schema(), fields.get(i).schema()));
+ }
+ }
+ GenericData.Record newRecord = new GenericData.Record(newSchema);
+ for (int i = 0; i < fields.size(); i++) {
+ if (helper.containsKey(i)) {
+ newRecord.put(i, helper.get(i));
+ } else {
+ if (fields.get(i).defaultVal() instanceof JsonProperties.Null) {
+ newRecord.put(i, null);
+ } else {
+ newRecord.put(i, fields.get(i).defaultVal());
+ }
+ }
+ }
+ return newRecord;
+ case ARRAY:
+ if (!(oldRecord instanceof Collection)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Collection array = (Collection)oldRecord;
+ List<Object> newArray = new ArrayList();
+ for (Object element : array) {
+ newArray.add(rewriteRecord(element, oldSchema.getElementType(), newSchema.getElementType()));
+ }
+ return newArray;
+ case MAP:
+ if (!(oldRecord instanceof Map)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Map<Object, Object> map = (Map<Object, Object>) oldRecord;
+ Map<Object, Object> newMap = new HashMap<>();
+ for (Map.Entry<Object, Object> entry : map.entrySet()) {
+ newMap.put(entry.getKey(), rewriteRecord(entry.getValue(), oldSchema.getValueType(), newSchema.getValueType()));
+ }
+ return newMap;
+ case UNION:
+ return rewriteRecord(oldRecord, getActualSchemaFromUnion(oldSchema, oldRecord), getActualSchemaFromUnion(newSchema, oldRecord));
+ default:
+ return rewritePrimaryType(oldRecord, oldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ Schema realOldSchema = oldSchema;
+ if (realOldSchema.getType() == UNION) {
+ realOldSchema = getActualSchemaFromUnion(oldSchema, oldValue);
+ }
+ if (realOldSchema.getType() == newSchema.getType()) {
+ switch (realOldSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ case INT:
+ case LONG:
+ case FLOAT:
+ case DOUBLE:
+ case BYTES:
+ case STRING:
+ return oldValue;
+ case FIXED:
+ // fixed size and name must match:
+ if (!SchemaCompatibility.schemaNameEquals(realOldSchema, newSchema) || realOldSchema.getFixedSize() != newSchema.getFixedSize()) {
+ // deal with the precision change for decimalType
+ if (realOldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) realOldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale()).setScale(((LogicalTypes.Decimal) newSchema.getLogicalType()).getScale());
+ return DECIMAL_CONVERSION.toFixed(bd, newSchema, newSchema.getLogicalType());
+ }
+ } else {
+ return oldValue;
+ }
+ return oldValue;
+ default:
+ throw new AvroRuntimeException("Unknown schema type: " + newSchema.getType());
+ }
+ } else {
+ return rewritePrimaryTypeWithDiffSchemaType(oldValue, realOldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryTypeWithDiffSchemaType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ switch (newSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ break;
+ case INT:
+ if (newSchema.getLogicalType() == LogicalTypes.date() && oldSchema.getType() == Schema.Type.STRING) {
+ return fromJavaDate(Date.valueOf(oldValue.toString()));
+ }
+ break;
+ case LONG:
+ if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).longValue();
+ }
+ break;
+ case FLOAT:
+ if ((oldSchema.getType() == Schema.Type.INT)
+ || (oldSchema.getType() == Schema.Type.LONG)) {
+ return oldSchema.getType() == Schema.Type.INT ? ((Integer) oldValue).floatValue() : ((Long) oldValue).floatValue();
+ }
+ break;
+ case DOUBLE:
+ if (oldSchema.getType() == Schema.Type.FLOAT) {
+ // java float cannot convert to double directly, deal with float precision change
+ return Double.valueOf(oldValue + "");
+ } else if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).doubleValue();
+ } else if (oldSchema.getType() == Schema.Type.LONG) {
+ return ((Long) oldValue).doubleValue();
+ }
+ break;
+ case BYTES:
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ return ((String) oldValue).getBytes(StandardCharsets.UTF_8);
+ }
+ break;
+ case STRING:
+ if (oldSchema.getType() == Schema.Type.BYTES) {
+ return String.valueOf(((byte[]) oldValue));
+ }
+ if (oldSchema.getLogicalType() == LogicalTypes.date()) {
+ return toJavaDate((Integer) oldValue).toString();
+ }
+ if (oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT
+ || oldSchema.getType() == Schema.Type.DOUBLE) {
+ return oldValue.toString();
+ }
+ if (oldSchema.getType() == Schema.Type.FIXED && oldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) oldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale());
+ return bd.toString();
+ }
+ break;
+ case FIXED:
+ // deal with decimal Type
+ if (newSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ // TODO: support more types
+ if (oldSchema.getType() == Schema.Type.STRING
+ || oldSchema.getType() == Schema.Type.DOUBLE
+ || oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT) {
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) newSchema.getLogicalType();
+ BigDecimal bigDecimal = null;
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ bigDecimal = new java.math.BigDecimal((String) oldValue)
+ .setScale(decimal.getScale());
+ } else {
+ // Due to Java, there will be precision problems in direct conversion, we should use string instead of use double
+ bigDecimal = new java.math.BigDecimal(oldValue.toString())
+ .setScale(decimal.getScale());
+ }
+ return DECIMAL_CONVERSION.toFixed(bigDecimal, newSchema, newSchema.getLogicalType());
+ }
+ }
+ break;
+ default:
+ }
+ throw new AvroRuntimeException(String.format("cannot support rewrite value for schema type: %s since the old schema type is: %s", newSchema, oldSchema));
+ }
+
+ // convert days to Date
+ private static Date toJavaDate(int days) {
+ long localMillis = Math.multiplyExact(days, MILLIS_PER_DAY);
+ int timeZoneOffset;
+ TimeZone defaultTimeZone = TimeZone.getDefault();
+ if (defaultTimeZone instanceof sun.util.calendar.ZoneInfo) {
+ timeZoneOffset = ((sun.util.calendar.ZoneInfo) defaultTimeZone).getOffsetsByWall(localMillis, null);
+ } else {
+ timeZoneOffset = defaultTimeZone.getOffset(localMillis - defaultTimeZone.getRawOffset());
+ }
+ return new Date(localMillis - timeZoneOffset);
+ }
+
+ // convert Date to days
+ private static int fromJavaDate(Date date) {
+ long millisUtc = date.getTime();
+ long millisLocal = millisUtc + TimeZone.getDefault().getOffset(millisUtc);
+ int julianDays = Math.toIntExact(Math.floorDiv(millisLocal, MILLIS_PER_DAY));
+ return julianDays;
+ }
+
+ private static Schema getActualSchemaFromUnion(Schema schema, Object data) {
+ Schema actualSchema;
+ if (!schema.getType().equals(UNION)) {
+ return schema;
+ }
+ if (schema.getTypes().size() == 2
+ && schema.getTypes().get(0).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(1);
+ } else if (schema.getTypes().size() == 2
+ && schema.getTypes().get(1).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(0);
+ } else if (schema.getTypes().size() == 1) {
+ actualSchema = schema.getTypes().get(0);
+ } else {
+ // deal complex union. this should not happened in hoodie,
+ // since flink/spark do not write this type.
+ int i = GenericData.get().resolveUnion(schema, data);
+ actualSchema = schema.getTypes().get(i);
+ }
+ return actualSchema;
+ }
+
+ /**
+ * Given avro records, rewrites them with new schema.
+ *
+ * @param oldRecords oldRecords to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return a iterator of rewrote GeneriRcords
+ */
+ public static Iterator<GenericRecord> rewriteRecords(Iterator<GenericRecord> oldRecords, Schema newSchema) {
+ if (oldRecords == null || newSchema == null) {
+ return Collections.emptyIterator();
+ }
+ return new Iterator<GenericRecord>() {
+ @Override
+ public boolean hasNext() {
+ return oldRecords.hasNext();
+ }
+
+ @Override
+ public GenericRecord next() {
+ return rewriteRecord(oldRecords.next(), newSchema);
+ }
+ };
+ }
+
+ /**
+ * support evolution from a new avroSchema.
+ * notice: this is not a universal method,
+ * now hoodie support implicitly add columns when hoodie write operation,
+ * This ability needs to be preserved, so implicitly evolution for internalSchema should supported.
+ *
+ * @param evolvedSchema implicitly evolution of avro when hoodie write operation
+ * @param oldSchema old internalSchema
+ * @param supportPositionReorder support position reorder
+ * @return evolution Schema
+ */
+ public static InternalSchema evolutionSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema, Boolean supportPositionReorder) {
+ InternalSchema evolvedInternalSchema = AvroInternalSchemaConverter.convert(evolvedSchema);
+ // do check, only support add column evolution
+ List<String> colNamesFromEvolved = evolvedInternalSchema.getAllColsFullName();
+ List<String> colNamesFromOldSchema = oldSchema.getAllColsFullName();
+ List<String> diffFromOldSchema = colNamesFromOldSchema.stream().filter(f -> !colNamesFromEvolved.contains(f)).collect(Collectors.toList());
+ List<Types.Field> newFields = new ArrayList<>();
+ if (colNamesFromEvolved.size() == colNamesFromOldSchema.size() && diffFromOldSchema.size() == 0) {
+ // no changes happen
+ if (supportPositionReorder) {
+ evolvedInternalSchema.getRecord().fields().forEach(f -> newFields.add(oldSchema.getRecord().field(f.name())));
+ return new InternalSchema(newFields);
+ }
+ return oldSchema;
+ }
+ // try to find all added columns
+ if (diffFromOldSchema.size() != 0) {
+ throw new UnsupportedOperationException("cannot evolution schema implicitly, find delete/rename operation");
Review comment:
nit: evolution -> evolve, cannot -> Cannot
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SchemaChangePersistHelper.java
##########
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.action.TableChange;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.action.TableChangesHelper;
+
+import java.util.Arrays;
+
+public class SchemaChangePersistHelper {
Review comment:
Instead of defining this class and SchemaChangeUtils as utils, can we reorganize this :
Create 2 classes InternalSchemaChangeApplier and InternalTypeChangeApplier. You can move the relevant methods to each class and make them non-static. InternalSchemaChangeApplier should delegate to InternalTypeChangeApplier when needed.
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
+ private AvroSchemaUtil() {
+ }
+
+ private static final long MILLIS_PER_DAY = 86400000L;
+
+ //Export for test
+ public static final Conversions.DecimalConversion DECIMAL_CONVERSION = new Conversions.DecimalConversion();
+
+ /**
+ * Given a avro record with a given schema, rewrites it into the new schema while setting fields only from the new schema.
+ * support deep rewrite for nested record.
+ * This particular method does the following things :
+ * a) Create a new empty GenericRecord with the new schema.
+ * b) For GenericRecord, copy over the data from the old schema to the new schema or set default values for all fields of this transformed schema
+ *
+ * @param oldRecord oldRecord to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return newRecord for new Schema
+ */
+ public static GenericRecord rewriteRecord(IndexedRecord oldRecord, Schema newSchema) {
+ Object newRecord = rewriteRecord(oldRecord, oldRecord.getSchema(), newSchema);
+ return (GenericData.Record) newRecord;
+ }
+
+ private static Object rewriteRecord(Object oldRecord, Schema oldSchema, Schema newSchema) {
+ if (oldRecord == null) {
+ return null;
+ }
+ switch (newSchema.getType()) {
+ case RECORD:
+ if (!(oldRecord instanceof IndexedRecord)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ IndexedRecord indexedRecord = (IndexedRecord) oldRecord;
+ List<Schema.Field> fields = newSchema.getFields();
+ Map<Integer, Object> helper = new HashMap<>();
+
+ for (int i = 0; i < fields.size(); i++) {
+ Schema.Field field = fields.get(i);
+ if (oldSchema.getField(field.name()) != null) {
+ Schema.Field oldField = oldSchema.getField(field.name());
+ helper.put(i, rewriteRecord(indexedRecord.get(oldField.pos()), oldField.schema(), fields.get(i).schema()));
+ }
+ }
+ GenericData.Record newRecord = new GenericData.Record(newSchema);
+ for (int i = 0; i < fields.size(); i++) {
+ if (helper.containsKey(i)) {
+ newRecord.put(i, helper.get(i));
+ } else {
+ if (fields.get(i).defaultVal() instanceof JsonProperties.Null) {
+ newRecord.put(i, null);
+ } else {
+ newRecord.put(i, fields.get(i).defaultVal());
+ }
+ }
+ }
+ return newRecord;
+ case ARRAY:
+ if (!(oldRecord instanceof Collection)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Collection array = (Collection)oldRecord;
+ List<Object> newArray = new ArrayList();
+ for (Object element : array) {
+ newArray.add(rewriteRecord(element, oldSchema.getElementType(), newSchema.getElementType()));
+ }
+ return newArray;
+ case MAP:
+ if (!(oldRecord instanceof Map)) {
+ throw new IllegalArgumentException("cannot rewrite record with different type");
+ }
+ Map<Object, Object> map = (Map<Object, Object>) oldRecord;
+ Map<Object, Object> newMap = new HashMap<>();
+ for (Map.Entry<Object, Object> entry : map.entrySet()) {
+ newMap.put(entry.getKey(), rewriteRecord(entry.getValue(), oldSchema.getValueType(), newSchema.getValueType()));
+ }
+ return newMap;
+ case UNION:
+ return rewriteRecord(oldRecord, getActualSchemaFromUnion(oldSchema, oldRecord), getActualSchemaFromUnion(newSchema, oldRecord));
+ default:
+ return rewritePrimaryType(oldRecord, oldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ Schema realOldSchema = oldSchema;
+ if (realOldSchema.getType() == UNION) {
+ realOldSchema = getActualSchemaFromUnion(oldSchema, oldValue);
+ }
+ if (realOldSchema.getType() == newSchema.getType()) {
+ switch (realOldSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ case INT:
+ case LONG:
+ case FLOAT:
+ case DOUBLE:
+ case BYTES:
+ case STRING:
+ return oldValue;
+ case FIXED:
+ // fixed size and name must match:
+ if (!SchemaCompatibility.schemaNameEquals(realOldSchema, newSchema) || realOldSchema.getFixedSize() != newSchema.getFixedSize()) {
+ // deal with the precision change for decimalType
+ if (realOldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) realOldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale()).setScale(((LogicalTypes.Decimal) newSchema.getLogicalType()).getScale());
+ return DECIMAL_CONVERSION.toFixed(bd, newSchema, newSchema.getLogicalType());
+ }
+ } else {
+ return oldValue;
+ }
+ return oldValue;
+ default:
+ throw new AvroRuntimeException("Unknown schema type: " + newSchema.getType());
+ }
+ } else {
+ return rewritePrimaryTypeWithDiffSchemaType(oldValue, realOldSchema, newSchema);
+ }
+ }
+
+ private static Object rewritePrimaryTypeWithDiffSchemaType(Object oldValue, Schema oldSchema, Schema newSchema) {
+ switch (newSchema.getType()) {
+ case NULL:
+ case BOOLEAN:
+ break;
+ case INT:
+ if (newSchema.getLogicalType() == LogicalTypes.date() && oldSchema.getType() == Schema.Type.STRING) {
+ return fromJavaDate(Date.valueOf(oldValue.toString()));
+ }
+ break;
+ case LONG:
+ if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).longValue();
+ }
+ break;
+ case FLOAT:
+ if ((oldSchema.getType() == Schema.Type.INT)
+ || (oldSchema.getType() == Schema.Type.LONG)) {
+ return oldSchema.getType() == Schema.Type.INT ? ((Integer) oldValue).floatValue() : ((Long) oldValue).floatValue();
+ }
+ break;
+ case DOUBLE:
+ if (oldSchema.getType() == Schema.Type.FLOAT) {
+ // java float cannot convert to double directly, deal with float precision change
+ return Double.valueOf(oldValue + "");
+ } else if (oldSchema.getType() == Schema.Type.INT) {
+ return ((Integer) oldValue).doubleValue();
+ } else if (oldSchema.getType() == Schema.Type.LONG) {
+ return ((Long) oldValue).doubleValue();
+ }
+ break;
+ case BYTES:
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ return ((String) oldValue).getBytes(StandardCharsets.UTF_8);
+ }
+ break;
+ case STRING:
+ if (oldSchema.getType() == Schema.Type.BYTES) {
+ return String.valueOf(((byte[]) oldValue));
+ }
+ if (oldSchema.getLogicalType() == LogicalTypes.date()) {
+ return toJavaDate((Integer) oldValue).toString();
+ }
+ if (oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT
+ || oldSchema.getType() == Schema.Type.DOUBLE) {
+ return oldValue.toString();
+ }
+ if (oldSchema.getType() == Schema.Type.FIXED && oldSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ final byte[] bytes;
+ bytes = ((GenericFixed) oldValue).bytes();
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) oldSchema.getLogicalType();
+ BigDecimal bd = new BigDecimal(new BigInteger(bytes), decimal.getScale());
+ return bd.toString();
+ }
+ break;
+ case FIXED:
+ // deal with decimal Type
+ if (newSchema.getLogicalType() instanceof LogicalTypes.Decimal) {
+ // TODO: support more types
+ if (oldSchema.getType() == Schema.Type.STRING
+ || oldSchema.getType() == Schema.Type.DOUBLE
+ || oldSchema.getType() == Schema.Type.INT
+ || oldSchema.getType() == Schema.Type.LONG
+ || oldSchema.getType() == Schema.Type.FLOAT) {
+ LogicalTypes.Decimal decimal = (LogicalTypes.Decimal) newSchema.getLogicalType();
+ BigDecimal bigDecimal = null;
+ if (oldSchema.getType() == Schema.Type.STRING) {
+ bigDecimal = new java.math.BigDecimal((String) oldValue)
+ .setScale(decimal.getScale());
+ } else {
+ // Due to Java, there will be precision problems in direct conversion, we should use string instead of use double
+ bigDecimal = new java.math.BigDecimal(oldValue.toString())
+ .setScale(decimal.getScale());
+ }
+ return DECIMAL_CONVERSION.toFixed(bigDecimal, newSchema, newSchema.getLogicalType());
+ }
+ }
+ break;
+ default:
+ }
+ throw new AvroRuntimeException(String.format("cannot support rewrite value for schema type: %s since the old schema type is: %s", newSchema, oldSchema));
+ }
+
+ // convert days to Date
+ private static Date toJavaDate(int days) {
+ long localMillis = Math.multiplyExact(days, MILLIS_PER_DAY);
+ int timeZoneOffset;
+ TimeZone defaultTimeZone = TimeZone.getDefault();
+ if (defaultTimeZone instanceof sun.util.calendar.ZoneInfo) {
+ timeZoneOffset = ((sun.util.calendar.ZoneInfo) defaultTimeZone).getOffsetsByWall(localMillis, null);
+ } else {
+ timeZoneOffset = defaultTimeZone.getOffset(localMillis - defaultTimeZone.getRawOffset());
+ }
+ return new Date(localMillis - timeZoneOffset);
+ }
+
+ // convert Date to days
+ private static int fromJavaDate(Date date) {
+ long millisUtc = date.getTime();
+ long millisLocal = millisUtc + TimeZone.getDefault().getOffset(millisUtc);
+ int julianDays = Math.toIntExact(Math.floorDiv(millisLocal, MILLIS_PER_DAY));
+ return julianDays;
+ }
+
+ private static Schema getActualSchemaFromUnion(Schema schema, Object data) {
+ Schema actualSchema;
+ if (!schema.getType().equals(UNION)) {
+ return schema;
+ }
+ if (schema.getTypes().size() == 2
+ && schema.getTypes().get(0).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(1);
+ } else if (schema.getTypes().size() == 2
+ && schema.getTypes().get(1).getType() == Schema.Type.NULL) {
+ actualSchema = schema.getTypes().get(0);
+ } else if (schema.getTypes().size() == 1) {
+ actualSchema = schema.getTypes().get(0);
+ } else {
+ // deal complex union. this should not happened in hoodie,
+ // since flink/spark do not write this type.
+ int i = GenericData.get().resolveUnion(schema, data);
+ actualSchema = schema.getTypes().get(i);
+ }
+ return actualSchema;
+ }
+
+ /**
+ * Given avro records, rewrites them with new schema.
+ *
+ * @param oldRecords oldRecords to be rewrite
+ * @param newSchema newSchema used to rewrite oldRecord
+ * @return a iterator of rewrote GeneriRcords
+ */
+ public static Iterator<GenericRecord> rewriteRecords(Iterator<GenericRecord> oldRecords, Schema newSchema) {
+ if (oldRecords == null || newSchema == null) {
+ return Collections.emptyIterator();
+ }
+ return new Iterator<GenericRecord>() {
+ @Override
+ public boolean hasNext() {
+ return oldRecords.hasNext();
+ }
+
+ @Override
+ public GenericRecord next() {
+ return rewriteRecord(oldRecords.next(), newSchema);
+ }
+ };
+ }
+
+ /**
+ * support evolution from a new avroSchema.
+ * notice: this is not a universal method,
+ * now hoodie support implicitly add columns when hoodie write operation,
+ * This ability needs to be preserved, so implicitly evolution for internalSchema should supported.
+ *
+ * @param evolvedSchema implicitly evolution of avro when hoodie write operation
+ * @param oldSchema old internalSchema
+ * @param supportPositionReorder support position reorder
+ * @return evolution Schema
+ */
+ public static InternalSchema evolutionSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema, Boolean supportPositionReorder) {
+ InternalSchema evolvedInternalSchema = AvroInternalSchemaConverter.convert(evolvedSchema);
+ // do check, only support add column evolution
+ List<String> colNamesFromEvolved = evolvedInternalSchema.getAllColsFullName();
+ List<String> colNamesFromOldSchema = oldSchema.getAllColsFullName();
+ List<String> diffFromOldSchema = colNamesFromOldSchema.stream().filter(f -> !colNamesFromEvolved.contains(f)).collect(Collectors.toList());
+ List<Types.Field> newFields = new ArrayList<>();
+ if (colNamesFromEvolved.size() == colNamesFromOldSchema.size() && diffFromOldSchema.size() == 0) {
+ // no changes happen
+ if (supportPositionReorder) {
+ evolvedInternalSchema.getRecord().fields().forEach(f -> newFields.add(oldSchema.getRecord().field(f.name())));
+ return new InternalSchema(newFields);
+ }
+ return oldSchema;
+ }
+ // try to find all added columns
+ if (diffFromOldSchema.size() != 0) {
+ throw new UnsupportedOperationException("cannot evolution schema implicitly, find delete/rename operation");
+ }
+
+ List<String> diffFromEvolutionSchema = colNamesFromEvolved.stream().filter(f -> !colNamesFromOldSchema.contains(f)).collect(Collectors.toList());
+ // Remove redundancy from diffFromEvolutionSchema.
+ // for example, now we add a struct col in evolvedSchema, the struct col is " user struct<name:string, age:int> "
+ // when we do diff operation: user, user.name, user.age will appeared in the resultSet which is redundancy, user.name and user.age should be excluded.
+ // deal with add operation
+ TreeMap<Integer, String> finalAddAction = new TreeMap<>();
+ for (int i = 0; i < diffFromEvolutionSchema.size(); i++) {
+ String name = diffFromEvolutionSchema.get(i);
+ int splitPoint = name.lastIndexOf(".");
+ String parentName = splitPoint > 0 ? name.substring(0, splitPoint) : "";
+ if (!parentName.isEmpty() && diffFromEvolutionSchema.contains(parentName)) {
+ // find redundancy, skip it
+ continue;
+ }
+ finalAddAction.put(evolvedInternalSchema.findIdByName(name), name);
+ }
+
+ TableChanges.ColumnAddChange addChange = TableChanges.ColumnAddChange.get(oldSchema);
+ finalAddAction.entrySet().stream().forEach(f -> {
+ String name = f.getValue();
+ int splitPoint = name.lastIndexOf(".");
+ String parentName = splitPoint > 0 ? name.substring(0, splitPoint) : "";
+ String rawName = splitPoint > 0 ? name.substring(splitPoint + 1) : name;
+ addChange.addColumns(parentName, rawName, evolvedInternalSchema.findType(name), null);
+ });
+
+ InternalSchema res = SchemaChangeUtils.applyTableChanges2Schema(oldSchema, addChange);
+ if (supportPositionReorder) {
+ evolvedInternalSchema.getRecord().fields().forEach(f -> newFields.add(oldSchema.getRecord().field(f.name())));
+ return new InternalSchema(newFields);
+ } else {
+ return res;
+ }
+ }
+
+ public static InternalSchema evolutionSchemaFromNewAvroSchema(Schema evolvedSchema, InternalSchema oldSchema) {
Review comment:
rename this and above method
evolutionSchemaFromNewAvroSchema to evolveSchemaFromNewAvroSchema
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1073034867
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591)
* 066450fb1940cc6640afc0911e5416c1a827ba67 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830502191
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java
##########
@@ -361,15 +372,38 @@ private boolean isNewInstantBlock(HoodieLogBlock logBlock) {
*/
private void processDataBlock(HoodieDataBlock dataBlock, Option<List<String>> keys) throws Exception {
try (ClosableIterator<IndexedRecord> recordItr = dataBlock.getRecordItr(keys.orElse(Collections.emptyList()))) {
+ boolean headRecord = true;
+ Option<Schema> schemaOption = Option.empty();
while (recordItr.hasNext()) {
- IndexedRecord record = recordItr.next();
+ IndexedRecord currentRecord = recordItr.next();
+ if (headRecord) {
+ schemaOption = getMergedSchema(dataBlock, currentRecord);
+ headRecord = false;
+ }
+ IndexedRecord record = schemaOption.isPresent() ? AvroSchemaUtil.rewriteRecord(currentRecord, schemaOption.get()) : currentRecord;
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830502713
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##########
@@ -2021,6 +2048,16 @@ public Builder withSchema(String schemaStr) {
return this;
}
+ public Builder withInternalSchema(String internalSchemaStr) {
Review comment:
sorry, we have not used this function, delte it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1073051721
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 9fc0b7d6bde89a857aaa98e8b322b9854ff5279f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094)
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8a4ef3a507ee3b4483c409e5a3af76eb0c421e40 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050873608
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c09a928506e41a69dd5e48f1cc2f7815216db1e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312)
* 4e04e2076296e16e1b5b60b510ed85d536873a93 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075079635
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152)
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075095546
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152)
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* f63e59e2924ada773f25904ebb90775c1d475c06 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r832207038
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/action/InternalSchemaMerger.java
##########
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.util.ArrayList;
+import java.util.List;
+
+/**
+ * auxiliary class.
+ * help to merge file schema and query schema to produce final read schema for avro/parquet file
+ */
+public class InternalSchemaMerger {
+ private final InternalSchema fileSchema;
+ private final InternalSchema querySchema;
+ // now there exist some bugs when we use spark update/merge api,
+ // those operation will change col nullability from optional to required which is wrong.
+ // Before that bug is fixed, we need to do adapt.
+ // if mergeRequiredFiledForce is true, we will ignore the col's required attribute.
+ private final boolean ignoreRequiredAttribute;
+ // Whether to use column Type from file schema to read files when we find some column type has changed.
Review comment:
spark parquetReader need the original column type to read data, otherwise the parquetReader will failed.
**eg: current column type is StringType, now we changed it to decimalType,**
we should not pass decimalType to parquetReader, we must pass StringType to it; when we read out data, we convert data from String to Decimal, everything is ok.
for log reader,
since our rewriteRecordwithNewSchema function support rewrite directly， so we no need this parameter
**eg: current column type is StringType, now we changed it to decimalType,**
we can pass decimalType to rewriteRecordwithNewSchema directly, everythings is ok.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076148897
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 35845665ddbfb2c176c80ddbe30404422f01cfac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216)
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r833494525
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/AlterHoodieTableAddColumnsCommand.scala
##########
@@ -110,15 +110,15 @@ object AlterHoodieTableAddColumnsCommand {
HoodieWriterUtils.parametersWithWriteDefaults(hoodieCatalogTable.catalogProperties).asJava
)
- val commitActionType = CommitUtils.getCommitActionType(WriteOperationType.INSERT, hoodieCatalogTable.tableType)
+ val commitActionType = CommitUtils.getCommitActionType(WriteOperationType.ALTER_SCHEMA, hoodieCatalogTable.tableType)
Review comment:
yes， thanks for your remind， we should do that
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076570343
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* b52e9b156c672288291ba319c822dabf98a55e3a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237)
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* 1c95fe08a4c7e03188a98c531817294555d41505 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r833508387
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/TableInternalSchemaUtils.java
##########
@@ -0,0 +1,140 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class TableInternalSchemaUtils {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
Review comment:
Now we donnot use meatclient in executor side when we read parquet file, we parser internalSchema directly
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r833425748
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/TableInternalSchemaUtils.java
##########
@@ -0,0 +1,140 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class TableInternalSchemaUtils {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
+ HoodieTableMetaClient metaClient = HoodieTableMetaClient.builder().setBasePath(tablePath).setConf(hadoopConf).build();
+ return searchSchemaAndCache(versionID, metaClient);
+ }
+
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient) {
+ Option<InternalSchema> candidateSchema = searchSchema(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || SerDeHelper.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return SerDeHelper.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> searchSchema(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATESTSCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getActiveTimeline().filterCompletedInstants().findInstantsBefore(compactionAndClusteringInstant);
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ try {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATESTSCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ } catch (Exception e) {
+ // swallow this exception
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r833484353
##########
File path: hudi-common/src/test/java/org/apache/hudi/internal/schema/action/TestMergeSchema.java
##########
@@ -0,0 +1,66 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+
+import org.apache.hudi.internal.schema.utils.SchemaChangeUtils;
+import org.junit.jupiter.api.Test;
+
+import java.util.Arrays;
+
+public class TestMergeSchema {
+
+ @Test
+ public void testPrimitiveMerge() {
+ Types.RecordType record = Types.RecordType.get(Arrays.asList(new Types.Field[] {
+ Types.Field.get(0, "col1", Types.BooleanType.get()),
+ Types.Field.get(1, "col2", Types.IntType.get()),
+ Types.Field.get(2, "col3", Types.LongType.get()),
+ Types.Field.get(3, "col4", Types.FloatType.get())}));
+
+ InternalSchema oldSchema = new InternalSchema(record.fields());
+ // add c1 after 'col1', and c2 before 'col3'
+ TableChanges.ColumnAddChange addChange = TableChanges.ColumnAddChange.get(oldSchema);
+ addChange.addColumns("c1", Types.BooleanType.get(), "add c1 after col1");
+ addChange.addPositionChange("c1", "col1", "after");
+ addChange.addColumns("c2", Types.IntType.get(), "add c2 before col3");
+ addChange.addPositionChange("c2", "col3", "before");
+ InternalSchema newAddSchema = SchemaChangeUtils.applyTableChanges2Schema(oldSchema, addChange);
+ TableChanges.ColumnDeleteChange deleteChange = TableChanges.ColumnDeleteChange.get(newAddSchema);
+ deleteChange.deleteColumn("col1");
+ deleteChange.deleteColumn("col3");
+ InternalSchema newDeleteSchema = SchemaChangeUtils.applyTableChanges2Schema(newAddSchema, deleteChange);
+
+ TableChanges.ColumnUpdateChange updateChange = TableChanges.ColumnUpdateChange.get(newDeleteSchema);
+ updateChange.updateColumnType("col2", Types.LongType.get())
+ .updateColumnComment("col2", "alter col2 comments")
+ .renameColumn("col2", "colx").addPositionChange("col2",
+ "col4", "after");
+ InternalSchema updateSchema = SchemaChangeUtils.applyTableChanges2Schema(newDeleteSchema, updateChange);
+
+ // add col1 again
+ TableChanges.ColumnAddChange addChange1 = TableChanges.ColumnAddChange.get(updateSchema);
+ addChange1.addColumns("col1", Types.BooleanType.get(), "add new col1");
+ InternalSchema finalSchema = SchemaChangeUtils.applyTableChanges2Schema(updateSchema, addChange1);
+ InternalSchema mergeSchema = new InternalSchemaMerger(oldSchema, finalSchema, true, false).mergeSchema();
Review comment:
yes， add more assert
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050835322
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c09a928506e41a69dd5e48f1cc2f7815216db1e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312)
* 4e04e2076296e16e1b5b60b510ed85d536873a93 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050966417
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e04e2076296e16e1b5b60b510ed85d536873a93 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051825663
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6ba1413ff8b09ec39ec823ae2e3816cd217df553 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342)
* 758d417cc8f02537d8174f19c904c062b0873646 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343)
* 2685177494a54601e91a21d849d2ffd6e284f4ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1051853685
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 758d417cc8f02537d8174f19c904c062b0873646 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343)
* 2685177494a54601e91a21d849d2ffd6e284f4ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1052203919
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* 4ff0d57275e8f907d945c60bd93c2bef227c7c3d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1055244794
@YannByron if you get a chance, please take a pass also. thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050826865
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c09a928506e41a69dd5e48f1cc2f7815216db1e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1054995399
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* cb8c6f4233cb1bac50aa67de4145df8458499f6d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380)
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1054040283
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* cb8c6f4233cb1bac50aa67de4145df8458499f6d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r828030393
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkMergeHelper.java
##########
@@ -77,14 +89,39 @@ public void runMerge(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD<HoodieKey>
readSchema = mergeHandle.getWriterSchemaWithMetaFields();
}
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ Boolean needToReWriteRecord = false;
+ // to do support bootstrap
+ if (querySchemaOpt.isPresent() && !baseFile.getBootstrapBaseFile().isPresent()) {
+ // check implicitly add columns, and position reorder(spark sql may change cols order)
+ InternalSchema querySchema = AvroSchemaUtil.evolutionSchemaFromNewAvroSchema(readSchema, querySchemaOpt.get(), true);
Review comment:
Can we add a short-circuit to avoid performing these steps for EmptySchema (DummySchema) ? We need to make sure existing flow (when there is no schema evolution enabled) has minimal/no overhead not just in this place but everywhere
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1059036403
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 3c293b72b3f4a11272f658a4be941028834c937f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r820552084
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/action/TableChange.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.common.model.HoodieRecord;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.internal.schema.HoodieSchemaException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.Types;
+
+import java.util.ArrayList;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+
+/**
+ * TableChange subclasses represent requested changes to a table.
+ * now only column changes support.
+ * to do support partition changes
+ */
+public interface TableChange {
+ /* The action Type of schema change. */
+ enum ColumnChangeID {
+ ADD, UPDATE, DELETE, PROPERTY_CHANGE, REPLACE;
+ private String name;
+
+ private ColumnChangeID() {
+ this.name = this.name().toLowerCase(Locale.ROOT);
+ }
+
+ public String getName() {
+ return name;
+ }
+ }
+
+ static ColumnChangeID fromValue(String value) {
+ switch (value.toLowerCase(Locale.ROOT)) {
+ case "add":
+ return ColumnChangeID.ADD;
+ case "change":
+ return ColumnChangeID.UPDATE;
+ case "delete":
+ return ColumnChangeID.DELETE;
+ case "property":
+ return ColumnChangeID.PROPERTY_CHANGE;
+ case "replace":
+ return ColumnChangeID.REPLACE;
+ default:
+ throw new IllegalArgumentException("Invalid value of Type.");
+ }
+ }
+
+ ColumnChangeID columnChangeId();
+
+ default boolean withPositionChange() {
+ return false;
+ }
+
+ abstract class BaseColumnChange implements TableChange {
+ protected final InternalSchema internalSchema;
+ protected final Map<Integer, Integer> id2parent;
+ protected final Map<Integer, ArrayList<ColumnPositionChange>> positionChangeMap = new HashMap<>();
+
+ BaseColumnChange(InternalSchema schema) {
+ this.internalSchema = schema;
+ this.id2parent = InternalSchemaUtils.index2Parents(schema.getRecord());
+ }
+
+ /**
+ * add position change.
+ *
+ * @param srcName column which need to be reordered
+ * @param dsrName reference position
+ * @param orderType change types
+ * @return this
+ */
+ public BaseColumnChange addPositionChange(String srcName, String dsrName, ColumnPositionChange.ColumnPositionType orderType) {
+ Integer srcId = findIdByFullName(srcName);
+ Option<Integer> dsrIdOpt = dsrName.isEmpty() ? Option.empty() : Option.of(findIdByFullName(dsrName));
+ Integer srcParentId = id2parent.get(srcId);
+ Option<Integer> dsrParentIdOpt = dsrIdOpt.map(id2parent::get);
+ // forbid adjust hoodie metadata columns.
+ switch (orderType) {
+ case BEFORE:
+ checkColModifyIsLegal(dsrName);
+ break;
+ case FIRST:
+ if (srcId == null || srcId == -1 || srcParentId == null || srcParentId == -1) {
+ throw new HoodieSchemaException("forbid adjust top-level columns position by using through first syntax");
+ }
+ break;
+ case AFTER:
+ List<String> checkColumns = HoodieRecord.HOODIE_META_COLUMNS.subList(0, HoodieRecord.HOODIE_META_COLUMNS.size() - 2);
+ if (checkColumns.stream().anyMatch(f -> f.equalsIgnoreCase(dsrName))) {
+ throw new HoodieSchemaException("forbid adjust the position of ordinary columns between meta columns");
+ }
+ break;
+ case NO_OPERATION:
+ default:
+ break;
+ }
+ int parentId;
+ if (srcParentId != null && dsrParentIdOpt.isPresent() && srcParentId.equals(dsrParentIdOpt.get())) {
+ Types.Field parentField = internalSchema.findField(srcParentId);
+ if (!(parentField.type() instanceof Types.RecordType)) {
+ throw new HoodieSchemaException(String.format("only support reorder fields in struct type, but find: %s", parentField.type()));
+ }
+ parentId = parentField.fieldId();
+ } else if (srcParentId == null && !dsrParentIdOpt.isPresent()) {
+ parentId = -1;
+ } else if (srcParentId != null && !dsrParentIdOpt.isPresent() && orderType.equals(ColumnPositionChange.ColumnPositionType.FIRST)) {
+ parentId = srcParentId;
+ } else {
+ throw new HoodieSchemaException("cannot order position from different parent");
+ }
+
+ ArrayList<ColumnPositionChange> changes = positionChangeMap.getOrDefault(parentId, new ArrayList<>());
+ changes.add(ColumnPositionChange.get(srcId, dsrIdOpt.orElse(-1), orderType));
+ positionChangeMap.put(parentId, changes);
+ return this;
+ }
+
+ public BaseColumnChange addPositionChange(String srcName, String dsrName, String orderType) {
+ return addPositionChange(srcName, dsrName, ColumnPositionChange.fromTypeValue(orderType));
+ }
+
+ /**
+ * abstract method.
+ * give a column fullName and return the field id
+ *
+ * @param fullName column fullName
+ * @return field id of current column
+ */
+ protected abstract Integer findIdByFullName(String fullName);
+
+ // Modify hudi meta columns is prohibited
+ protected void checkColModifyIsLegal(String colNeedToModfiy) {
+ if (HoodieRecord.HOODIE_META_COLUMNS.stream().anyMatch(f -> f.equalsIgnoreCase(colNeedToModfiy))) {
+ throw new IllegalArgumentException(String.format("cannot modify hudi meta col: %s", colNeedToModfiy));
+ }
+ }
+
+ @Override
+ public boolean withPositionChange() {
+ return false;
+ }
+ }
+
+ /**
+ * Column position change.
+ * now support three change types: FIRST/AFTER/BEFORE
+ * FIRST means the specified column should be the first column.
+ * AFTER means the specified column should be put after the given column.
+ * BEFORE means the specified column should be put before the given column.
+ * Note that, the specified column may be a nested field:
+ * AFTER/BEFORE means the given columns should in the same struct;
+ * FIRST means this field should be the first one within the struct.
+ */
+ class ColumnPositionChange {
+ public enum ColumnPositionType {
+ FIRST,
+ BEFORE,
Review comment:
maybe `FIRST` and `AFTER` is enough. `BEFORE` is not necessary. we can keep this syntax consistent with Spark.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r820543023
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getDummyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isDummySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ if (versionId >= 0) {
+ buildIdToName();
+ maxColumnId = idToName.keySet().stream().max(Comparator.comparing(Integer::valueOf)).get();
+ }
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, List<Field> cols) {
+ this.maxColumnId = maxColumnId;
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ buildIdToName();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, Field... cols) {
+ this(versionId, maxColumnId, Arrays.asList(cols));
+ }
+
+ public RecordType getRecord() {
+ return record;
+ }
+
+ private Map<Integer, String> buildIdToName() {
+ if (idToName == null) {
+ idToName = InternalSchemaUtils.buildIdToName(record);
+ }
+ return idToName;
+ }
+
+ private Map<String, Integer> buildNameToId() {
+ if (nameToId == null) {
+ if (idToName != null && !idToName.isEmpty()) {
+ nameToId = idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ return nameToId;
+ }
+ nameToId = InternalSchemaUtils.buildNameToId(record);
+ }
+ return nameToId;
+ }
+
+ private Map<Integer, Field> buildIdToField() {
+ if (idToField == null) {
+ idToField = InternalSchemaUtils.buildIdToField(record);
+ }
+ return idToField;
+ }
+
+ /**
+ * get all columns full name.
+ */
+ public List<String> getAllColsFullName() {
+ if (nameToId == null) {
+ nameToId = InternalSchemaUtils.buildNameToId(record);
+ }
+ return Arrays.asList(nameToId.keySet().toArray(new String[0]));
+ }
+
+ /**
+ * set the version ID for this schema.
+ */
+ public InternalSchema setSchemaId(long versionId) {
+ this.versionId = versionId;
Review comment:
when will the `setSchemaId` and `setMax_column_id` be called alone.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r820536598
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getDummyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isDummySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ if (versionId >= 0) {
Review comment:
And also, if cols is empty, all member variables is empty or initial values like `maxColumnId` and `versionId` are `-1`. so i suggest to finish filling up members here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r821280577
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java
##########
@@ -530,4 +533,51 @@ private boolean hasOperationField() {
return false;
}
}
+
+ /**
+ * Gets the InternalSchema for a hoodie table from the HoodieCommitMetadata of the instant.
+ *
+ * @return InternalSchema for this table
+ */
+ public Option<InternalSchema> getTableInternalSchemaFromCommitMetadata() {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ if (timeline.lastInstant().isPresent()) {
+ return getTableInternalSchemaFromCommitMetadata(timeline.lastInstant().get());
+ } else {
+ return Option.empty();
+ }
+ }
+
+ /**
+ * Gets the InternalSchema for a hoodie table from the HoodieCommitMetadata of the instant.
+ *
+ * @return InternalSchema for this table
+ */
+ private Option<InternalSchema> getTableInternalSchemaFromCommitMetadata(HoodieInstant instant) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
Review comment:
just using metaClient.getActiveTimeline() may be enough.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1074306329
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r831700264
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -237,6 +251,30 @@ protected void commit(HoodieTable table, String commitActionType, String instant
HoodieActiveTimeline activeTimeline = table.getActiveTimeline();
// Finalize write
finalizeWrite(table, instantTime, stats);
+ // do save internal schema to support Implicitly add columns in write process
+ if (!metadata.getExtraMetadata().containsKey(SerDeHelper.LATEST_SCHEMA)
+ && metadata.getExtraMetadata().containsKey(SCHEMA_KEY) && table.getConfig().getSchemaEvolutionEnable()) {
+ TableSchemaResolver schemaUtil = new TableSchemaResolver(table.getMetaClient());
+ String historySchemaStr = schemaUtil.getTableHistorySchemaStrFromCommitMetadata().orElse("");
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(table.getMetaClient());
+ if (!historySchemaStr.isEmpty()) {
+ InternalSchema internalSchema = InternalSchemaUtils.searchSchema(Long.parseLong(instantTime),
+ SerDeHelper.parseSchemas(historySchemaStr));
+ Schema avroSchema = HoodieAvroUtils.createHoodieWriteSchema(new Schema.Parser().parse(config.getSchema()));
+ InternalSchema evolutionSchema = AvroSchemaEvolutionUtils.evolveSchemaFromNewAvroSchema(avroSchema, internalSchema);
+ if (evolutionSchema.equals(internalSchema)) {
+ metadata.addMetadata(SerDeHelper.LATEST_SCHEMA, SerDeHelper.toJson(evolutionSchema));
+ schemasManager.persistHistorySchemaStr(instantTime, historySchemaStr);
Review comment:
if schema is unchanged, we just copy the old history schema, no extra schema info will be added.
of course we can avoid writeing history schema, directly, let me modfiy those codes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830465724
##########
File path: hudi-client/hudi-spark-client/src/main/scala/org/apache/hudi/HoodieSparkUtils.scala
##########
@@ -297,17 +303,25 @@ object HoodieSparkUtils extends SparkAdapterSupport {
AttributeReference(columnName, field.get.dataType, field.get.nullable)()
}
- def getRequiredSchema(tableAvroSchema: Schema, requiredColumns: Array[String]): (Schema, StructType) = {
- // First get the required avro-schema, then convert the avro-schema to spark schema.
- val name2Fields = tableAvroSchema.getFields.asScala.map(f => f.name() -> f).toMap
- // Here have to create a new Schema.Field object
- // to prevent throwing exceptions like "org.apache.avro.AvroRuntimeException: Field already used".
- val requiredFields = requiredColumns.map(c => name2Fields(c))
- .map(f => new Schema.Field(f.name(), f.schema(), f.doc(), f.defaultVal(), f.order())).toList
- val requiredAvroSchema = Schema.createRecord(tableAvroSchema.getName, tableAvroSchema.getDoc,
- tableAvroSchema.getNamespace, tableAvroSchema.isError, requiredFields.asJava)
- val requiredStructSchema = AvroConversionUtils.convertAvroSchemaToStructType(requiredAvroSchema)
- (requiredAvroSchema, requiredStructSchema)
+ def getRequiredSchema(tableAvroSchema: Schema, requiredColumns: Array[String], internalSchema: InternalSchema = InternalSchema.getDummyInternalSchema): (Schema, StructType, InternalSchema) = {
+ if (internalSchema.isDummySchema) {
+ // First get the required avro-schema, then convert the avro-schema to spark schema.
+ val name2Fields = tableAvroSchema.getFields.asScala.map(f => f.name() -> f).toMap
+ // Here have to create a new Schema.Field object
+ // to prevent throwing exceptions like "org.apache.avro.AvroRuntimeException: Field already used".
+ val requiredFields = requiredColumns.map(c => name2Fields(c))
+ .map(f => new Schema.Field(f.name(), f.schema(), f.doc(), f.defaultVal(), f.order())).toList
+ val requiredAvroSchema = Schema.createRecord(tableAvroSchema.getName, tableAvroSchema.getDoc,
+ tableAvroSchema.getNamespace, tableAvroSchema.isError, requiredFields.asJava)
+ val requiredStructSchema = AvroConversionUtils.convertAvroSchemaToStructType(requiredAvroSchema)
+ (requiredAvroSchema, requiredStructSchema, internalSchema)
+ } else {
+ // support nested project
Review comment:
yes, nested projection is supported,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1073068736
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8a4ef3a507ee3b4483c409e5a3af76eb0c421e40 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075185186
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* f63e59e2924ada773f25904ebb90775c1d475c06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076298764
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* d16fb4953f49ca231f49247924760cbb7a3efcb6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231)
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* b52e9b156c672288291ba319c822dabf98a55e3a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r833501016
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/block/HoodieAvroDataBlock.java
##########
@@ -147,17 +159,22 @@ private RecordIterator(Schema readerSchema, Schema writerSchema, byte[] content)
int version = this.dis.readInt();
HoodieAvroDataBlockVersion logBlockVersion = new HoodieAvroDataBlockVersion(version);
- this.reader = new GenericDatumReader<>(writerSchema, readerSchema);
+ Schema finalReadSchema = readerSchema;
+ if (!internalSchema.isEmptySchema()) {
+ finalReadSchema = writerSchema;
Review comment:
yes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075889392
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* f63e59e2924ada773f25904ebb90775c1d475c06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184)
* 35845665ddbfb2c176c80ddbe30404422f01cfac UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075915291
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 35845665ddbfb2c176c80ddbe30404422f01cfac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076160986
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 35845665ddbfb2c176c80ddbe30404422f01cfac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216)
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* d16fb4953f49ca231f49247924760cbb7a3efcb6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076578264
@bvaradar addressed all comments. and there are some comments that may need to be discussed.
could you pls help me review again, thank you very much.
Now code freeze has been delayed for a week, i think we have enought time to make this pr more better.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076233116
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* d16fb4953f49ca231f49247924760cbb7a3efcb6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077437931
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r834267350
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkInternalSchemaConverter.java
##########
@@ -0,0 +1,501 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.client.utils;
+
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.ArrayType;
+import org.apache.spark.sql.types.ArrayType$;
+import org.apache.spark.sql.types.BinaryType;
+import org.apache.spark.sql.types.BinaryType$;
+import org.apache.spark.sql.types.BooleanType;
+import org.apache.spark.sql.types.BooleanType$;
+import org.apache.spark.sql.types.ByteType;
+import org.apache.spark.sql.types.CharType;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.DateType;
+import org.apache.spark.sql.types.DateType$;
+import org.apache.spark.sql.types.Decimal;
+import org.apache.spark.sql.types.DecimalType;
+import org.apache.spark.sql.types.DecimalType$;
+import org.apache.spark.sql.types.DoubleType;
+import org.apache.spark.sql.types.DoubleType$;
+import org.apache.spark.sql.types.FloatType;
+import org.apache.spark.sql.types.FloatType$;
+import org.apache.spark.sql.types.IntegerType;
+import org.apache.spark.sql.types.IntegerType$;
+import org.apache.spark.sql.types.LongType;
+import org.apache.spark.sql.types.LongType$;
+import org.apache.spark.sql.types.MapType;
+import org.apache.spark.sql.types.MapType$;
+import org.apache.spark.sql.types.Metadata;
+import org.apache.spark.sql.types.ShortType;
+import org.apache.spark.sql.types.StringType;
+import org.apache.spark.sql.types.StringType$;
+import org.apache.spark.sql.types.StructField;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.types.StructType$;
+import org.apache.spark.sql.types.TimestampType;
+import org.apache.spark.sql.types.TimestampType$;
+import org.apache.spark.sql.types.UserDefinedType;
+import org.apache.spark.sql.types.VarcharType;
+
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class SparkInternalSchemaConverter {
+ private SparkInternalSchemaConverter() {
+
+ }
+
+ public static final String HOODIE_QUERY_SCHEMA = "hoodie.schema.internal.querySchema";
+ public static final String HOODIE_TABLE_PATH = "hoodie.tablePath";
+ public static final String HOODIE_VALID_COMMITS_LIST = "hoodie.valid.commits.list";
+ /**
Review comment:
nit: empty line before this
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java
##########
@@ -109,6 +115,9 @@
private final FileSystem fs;
// Total log files read - for metrics
private AtomicLong totalLogFiles = new AtomicLong(0);
+ // Internal schema
+ private InternalSchema internalSchema = InternalSchema.getEmptyInternalSchema();
Review comment:
Looks like this is an redundant initialization as internalSchema is setup properly in constructor
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaEvolutionUtils.java
##########
@@ -0,0 +1,145 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+/**
+ * Util methods to support evolve old avro schema based on a given schema.
+ */
+public class AvroSchemaEvolutionUtils {
+ private AvroSchemaEvolutionUtils() {
Review comment:
Can you remove the explicit private constructor. All methods are static.
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -237,6 +251,30 @@ protected void commit(HoodieTable table, String commitActionType, String instant
HoodieActiveTimeline activeTimeline = table.getActiveTimeline();
// Finalize write
finalizeWrite(table, instantTime, stats);
+ // do save internal schema to support Implicitly add columns in write process
+ if (!metadata.getExtraMetadata().containsKey(SerDeHelper.LATEST_SCHEMA)
+ && metadata.getExtraMetadata().containsKey(SCHEMA_KEY) && table.getConfig().getSchemaEvolutionEnable()) {
+ TableSchemaResolver schemaUtil = new TableSchemaResolver(table.getMetaClient());
+ String historySchemaStr = schemaUtil.getTableHistorySchemaStrFromCommitMetadata().orElse("");
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(table.getMetaClient());
+ if (!historySchemaStr.isEmpty()) {
+ InternalSchema internalSchema = InternalSchemaUtils.searchSchema(Long.parseLong(instantTime),
+ SerDeHelper.parseSchemas(historySchemaStr));
+ Schema avroSchema = HoodieAvroUtils.createHoodieWriteSchema(new Schema.Parser().parse(config.getSchema()));
+ InternalSchema evolutionSchema = AvroSchemaEvolutionUtils.evolveSchemaFromNewAvroSchema(avroSchema, internalSchema);
+ if (evolutionSchema.equals(internalSchema)) {
+ metadata.addMetadata(SerDeHelper.LATEST_SCHEMA, SerDeHelper.toJson(evolutionSchema));
+ schemasManager.persistHistorySchemaStr(instantTime, historySchemaStr);
Review comment:
@xiarixiaoyao : Agree, this is a valid concern with the current way for storing history schemas. Once, we move to storing schemas to the general metadata storage, this problem should not be there and we should stop copying the history schema file every commit. Can you add a TODO in this line
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,207 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.fs.FSUtils;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.List;
+import java.util.Set;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // Use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * Search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param metaClient current hoodie metaClient
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient, boolean cacheEnable) {
+ Option<InternalSchema> candidateSchema = getSchemaByReadingCommitFile(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ if (!cacheEnable) {
+ // parse history schema and return directly
+ return InternalSchemaUtils.searchSchema(versionID, getHistoricalSchemas(metaClient));
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || InternalSchemaUtils.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return InternalSchemaUtils.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> getSchemaByReadingCommitFile(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ /**
+ * Get internalSchema and avroSchema for compaction/cluster operation.
+ *
+ * @param metaClient current hoodie metaClient
+ * @param compactionAndClusteringInstant first instant before current compaction/cluster instant
+ * @return (internalSchemaStrOpt, avroSchemaStrOpt) a pair of InternalSchema/avroSchema
+ */
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getCommitsAndCompactionTimeline().findInstantsBefore(compactionAndClusteringInstant).filterCompletedInstants();
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata;
+ try {
+ metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ } catch (Exception e) {
+ throw new HoodieException(String.format("cannot read metadata from commit: %s", lastInstantBeforeCurrentCompaction.get()), e);
+ }
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ }
+ return Pair.of(Option.empty(), Option.empty());
+ }
+
+ /**
+ * Give a schema versionId return its internalSchema.
+ * This method will be called by spark tasks, we should minimize time cost.
+ * We try our best to not use metaClient， since the initialization of metaClient is time cost
+ * step1：
+ * try to parser internalSchema from HoodieInstant directly
+ * step2：
+ * if we cannot parser internalSchema in step1，
+ * try to find internalSchema in historySchema.
+ *
+ * @param versionId the internalSchema version to be search.
+ * @param tablePath table path
+ * @param hadoopConf conf
+ * @param validCommits current validate commits, use to make up the commit file path/verify the validity of the history schema files
+ * @return a internalSchema.
+ */
+ public static InternalSchema getInternalSchemaByVersionId(long versionId, String tablePath, Configuration hadoopConf, String validCommits) {
Review comment:
I don't see this method being used. Can we remove it ?
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieMergeHelper.java
##########
@@ -78,12 +90,41 @@ public void runMerge(HoodieTable<T, HoodieData<HoodieRecord<T>>, HoodieData<Hood
BoundedInMemoryExecutor<GenericRecord, GenericRecord, Void> wrapper = null;
HoodieFileReader<GenericRecord> reader = HoodieFileReaderFactory.getFileReader(cfgForHoodieFile, mergeHandle.getOldFilePath());
+
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ boolean needToReWriteRecord = false;
+ // TODO support bootstrap
Review comment:
Regarding Bootstrap support, what needs to be done in addition to support it? Is there a subsequent PR coming ? If we are not supporting it, can we explicitly add a check during config checking time to error out if we see a bootstrapped table with hoodie.schema.evolution.enable set to true.
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaEvolutionUtils.java
##########
@@ -0,0 +1,145 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.Schema;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.util.ArrayList;
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+/**
+ * Util methods to support evolve old avro schema based on a given schema.
Review comment:
-> "Utility methods to support evolving old avro schema based on a given internal schema."
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/block/HoodieAvroDataBlock.java
##########
@@ -147,17 +159,26 @@ private RecordIterator(Schema readerSchema, Schema writerSchema, byte[] content)
int version = this.dis.readInt();
HoodieAvroDataBlockVersion logBlockVersion = new HoodieAvroDataBlockVersion(version);
- this.reader = new GenericDatumReader<>(writerSchema, readerSchema);
+ Schema finalReadSchema = readerSchema;
+ if (!internalSchema.isEmptySchema()) {
Review comment:
Is there an unit/functional test that would cover this case ?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,207 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.fs.FSUtils;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.List;
+import java.util.Set;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // Use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
Review comment:
Can you explain why weakValues are used instead of softValues ?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala
##########
@@ -107,8 +113,21 @@ class DefaultSource extends RelationProvider
case (COPY_ON_WRITE, QUERY_TYPE_SNAPSHOT_OPT_VAL, false) |
(COPY_ON_WRITE, QUERY_TYPE_READ_OPTIMIZED_OPT_VAL, false) |
(MERGE_ON_READ, QUERY_TYPE_READ_OPTIMIZED_OPT_VAL, false) =>
- new BaseFileOnlyRelation(sqlContext, metaClient, parameters, userSchema, globPaths)
-
+ val internalSchema = new TableSchemaResolver(metaClient).getTableInternalSchemaFromCommitMetadata
+ val sparkSchema = SchemaConverters.toSqlType(new TableSchemaResolver(metaClient).getTableAvroSchema).dataType.asInstanceOf[StructType]
+ val newParameters = parameters ++ Map(SparkInternalSchemaConverter.HOODIE_QUERY_SCHEMA -> SerDeHelper.toJson(internalSchema.orElse(null)),
+ SparkInternalSchemaConverter.HOODIE_TABLE_PATH -> metaClient.getBasePath)
+ if (internalSchema.isPresent) {
+ // Use the HoodieFileIndex only if the 'path' is not globbed.
+ // Or else we use the original way to read hoodie table.
Review comment:
Sounds good.
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,207 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.fs.FSUtils;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.List;
+import java.util.Set;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // Use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * Search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param metaClient current hoodie metaClient
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient, boolean cacheEnable) {
+ Option<InternalSchema> candidateSchema = getSchemaByReadingCommitFile(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ if (!cacheEnable) {
+ // parse history schema and return directly
+ return InternalSchemaUtils.searchSchema(versionID, getHistoricalSchemas(metaClient));
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || InternalSchemaUtils.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return InternalSchemaUtils.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> getSchemaByReadingCommitFile(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ /**
+ * Get internalSchema and avroSchema for compaction/cluster operation.
+ *
+ * @param metaClient current hoodie metaClient
+ * @param compactionAndClusteringInstant first instant before current compaction/cluster instant
+ * @return (internalSchemaStrOpt, avroSchemaStrOpt) a pair of InternalSchema/avroSchema
+ */
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getCommitsAndCompactionTimeline().findInstantsBefore(compactionAndClusteringInstant).filterCompletedInstants();
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata;
+ try {
+ metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ } catch (Exception e) {
+ throw new HoodieException(String.format("cannot read metadata from commit: %s", lastInstantBeforeCurrentCompaction.get()), e);
+ }
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ }
+ return Pair.of(Option.empty(), Option.empty());
+ }
+
+ /**
+ * Give a schema versionId return its internalSchema.
+ * This method will be called by spark tasks, we should minimize time cost.
+ * We try our best to not use metaClient， since the initialization of metaClient is time cost
+ * step1：
+ * try to parser internalSchema from HoodieInstant directly
+ * step2：
+ * if we cannot parser internalSchema in step1，
+ * try to find internalSchema in historySchema.
+ *
+ * @param versionId the internalSchema version to be search.
+ * @param tablePath table path
+ * @param hadoopConf conf
+ * @param validCommits current validate commits, use to make up the commit file path/verify the validity of the history schema files
+ * @return a internalSchema.
+ */
+ public static InternalSchema getInternalSchemaByVersionId(long versionId, String tablePath, Configuration hadoopConf, String validCommits) {
Review comment:
This seems to be the only place where MetaClient is not passed in the constructor which could cause repeated .hoodie listing
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SerDeHelper.java
##########
@@ -0,0 +1,351 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import com.fasterxml.jackson.core.JsonFactory;
+import com.fasterxml.jackson.core.JsonGenerator;
+import com.fasterxml.jackson.databind.JsonNode;
+import com.fasterxml.jackson.databind.ObjectMapper;
+
+import org.apache.hadoop.hbase.exceptions.IllegalArgumentIOException;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.io.IOException;
+import java.io.StringWriter;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Locale;
+import java.util.TreeMap;
+import java.util.regex.Matcher;
+import java.util.regex.Pattern;
+
+public class SerDeHelper {
+ private SerDeHelper() {
+
+ }
+
+ public static final String LATEST_SCHEMA = "latest_Schema";
Review comment:
latest_Schema should be latest_schema
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala
##########
@@ -177,6 +192,70 @@ class DefaultSource extends RelationProvider
override def shortName(): String = "hudi_v1"
+ private def getBaseFileOnlyView(useHoodieFileIndex: Boolean,
Review comment:
@xiarixiaoyao : Are we regressing to poor performance with this change ? @YannByron mentions that this code has been discarded.
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/action/InternalSchemaMerger.java
##########
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.util.ArrayList;
+import java.util.List;
+
+/**
+ * auxiliary class.
+ * help to merge file schema and query schema to produce final read schema for avro/parquet file
+ */
+public class InternalSchemaMerger {
+ private final InternalSchema fileSchema;
+ private final InternalSchema querySchema;
+ // now there exist some bugs when we use spark update/merge api,
+ // those operation will change col nullability from optional to required which is wrong.
+ // Before that bug is fixed, we need to do adapt.
+ // if mergeRequiredFiledForce is true, we will ignore the col's required attribute.
+ private final boolean ignoreRequiredAttribute;
+ // Whether to use column Type from file schema to read files when we find some column type has changed.
Review comment:
Thanks for the explanation. Can you add the comment in the code itself.
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/io/AbstractInternalSchemaStorageManager.java
##########
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.io;
+
+import org.apache.hudi.common.util.Option;
+
+import java.util.List;
+
+abstract class AbstractInternalSchemaStorageManager {
+
+ /**
+ * Persist history schema str.
+ */
+ public abstract void persistHistorySchemaStr(String instantTime, String historySchemaStr);
+
+ /**
+ * Get latest history schema string.
+ */
+ public abstract String getHistorySchemaStr();
+
+ /**
+ * Get latest history schema string.
+ * Using give validCommits to validate all legal histroy Schema files, and return the latest one.
+ */
Review comment:
Add the line: If the passed valid commits is null or empty, valid instants will be fetched from the file-system and used.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r834362437
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala
##########
@@ -177,6 +192,70 @@ class DefaultSource extends RelationProvider
override def shortName(): String = "hudi_v1"
+ private def getBaseFileOnlyView(useHoodieFileIndex: Boolean,
Review comment:
@bvaradar yes i will try to paste a simple perf result， tomorrow.
Adapting this change is very easy, but I don't want to lose too much performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835266319
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/action/InternalSchemaMerger.java
##########
@@ -0,0 +1,190 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.action;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+
+import java.util.ArrayList;
+import java.util.List;
+
+/**
+ * auxiliary class.
+ * help to merge file schema and query schema to produce final read schema for avro/parquet file
+ */
+public class InternalSchemaMerger {
+ private final InternalSchema fileSchema;
+ private final InternalSchema querySchema;
+ // now there exist some bugs when we use spark update/merge api,
+ // those operation will change col nullability from optional to required which is wrong.
+ // Before that bug is fixed, we need to do adapt.
+ // if mergeRequiredFiledForce is true, we will ignore the col's required attribute.
+ private final boolean ignoreRequiredAttribute;
+ // Whether to use column Type from file schema to read files when we find some column type has changed.
Review comment:
yes,fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835140336
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java
##########
@@ -530,4 +533,51 @@ private boolean hasOperationField() {
return false;
}
}
+
+ /**
+ * Gets the InternalSchema for a hoodie table from the HoodieCommitMetadata of the instant.
+ *
+ * @return InternalSchema for this table
+ */
+ public Option<InternalSchema> getTableInternalSchemaFromCommitMetadata() {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ if (timeline.lastInstant().isPresent()) {
+ return getTableInternalSchemaFromCommitMetadata(timeline.lastInstant().get());
+ } else {
+ return Option.empty();
+ }
+ }
+
+ /**
+ * Gets the InternalSchema for a hoodie table from the HoodieCommitMetadata of the instant.
+ *
+ * @return InternalSchema for this table
+ */
+ private Option<InternalSchema> getTableInternalSchemaFromCommitMetadata(HoodieInstant instant) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079141828
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* 544b64a34f4ba19ef742e606e23d8986284be43f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373)
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079637508
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 5357ce8bff9b47bfe50816b178c267efed1d3b0e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082519316
@bvaradar
Thank you very much for your patient review for so many days
let me rebase the code
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084090687
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541)
* 5c147a6a52c3f118a154c9b36c09b9f245dd20e2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840184096
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala
##########
@@ -61,6 +61,11 @@ class MergeOnReadSnapshotRelation(sqlContext: SQLContext,
tableSchema: HoodieTableSchema,
requiredSchema: HoodieTableSchema,
filters: Array[Filter]): HoodieMergeOnReadRDD = {
+ if (!internalSchema.isEmptySchema) {
Review comment:
as https://github.com/apache/hudi/pull/5168 merged, let's remove this method
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085336695
@xiarixiaoyao How much testing have you done with the PR. is it rolled out and actively used already ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840530132
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##########
@@ -167,6 +167,22 @@
+ "implementations of HoodieRecordPayload to convert incoming records to avro. This is also used as the write schema "
+ "evolving records during an update.");
+ public static final ConfigProperty<String> INTERNAL_SCHEMA_STRING = ConfigProperty
+ .key("hoodie.internal.schema")
+ .noDefaultValue()
+ .withDocumentation("Schema string representing the latest schema of the table. Hudi passes this to "
+ + "implementations of evolution of schema");
+
+ public static final ConfigProperty<Boolean> SCHEMA_EVOLUTION_ENABLE = ConfigProperty
Review comment:
@xiarixiaoyao : It is better to prefix with hoodie in the config. So, hoodie.schema.on.read.enable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085886923
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
}, {
"hash" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"triggerType" : "PUSH"
}, {
"hash" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a85abe9d8517f591f43201d61b729066939b99a1 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699)
* a66629f12e982bc3eb1fc0c17420004ee3de2033 UNKNOWN
* e28e7f2e100c377fe92d1ae89983d97c424b630a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084145291
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 5c147a6a52c3f118a154c9b36c09b9f245dd20e2 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612)
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085694168
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682)
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* 929adaa89a13ba028801aaa49fdd41cb99594f96 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082552898
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* aeaa837dd208456b9bb0ad07f1675f7d9ea1c175 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509)
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* ccb5902d740a98ce9cbcbb09a26e344400a3cc17 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082547582
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* aeaa837dd208456b9bb0ad07f1675f7d9ea1c175 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509)
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082709362
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085946938
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
}, {
"hash" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"triggerType" : "PUSH"
}, {
"hash" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705",
"triggerID" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a85abe9d8517f591f43201d61b729066939b99a1 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699)
* a66629f12e982bc3eb1fc0c17420004ee3de2033 UNKNOWN
* e28e7f2e100c377fe92d1ae89983d97c424b630a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1058141835
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 059686f6b26f16b4ce1e9def3087f8b7d860a778 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1057990371
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* cb8c6f4233cb1bac50aa67de4145df8458499f6d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507)
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 059686f6b26f16b4ce1e9def3087f8b7d860a778 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron edited a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron edited a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1061369238
@xiarixiaoyao 'Cause this pr is so huge. So please help me to sort the implement out.
1. do the `SerDeHelper.LATESTSCHEMA` attribute of one commit file and the `SAVE_SCHEMA_ACTION` file save the same thing, or can they convert each other?
2. if enable `hoodie.schema.evolution.enable`, will every commit persist `SerDeHelper.LATESTSCHEMA` in meta file ?
3. When will commit the `SAVE_SCHEMA_ACTION` file? Once that schema is changed ?
4. How to make the Hudi Table with old version like 0.10 compatible with this ? If enable `hoodie.schema.evolution.enable` on an existed old-version hudi table, what will happen? Or we are not about to make them compatible, then how to refuse this.
5. this pr can work when enable `hoodie.metadata.enable` ?
6. why we need to separate Spark3.1 and Spark3.2? See more repeated codes. so try to optimize them if indeed need to deal with spark3.1 and spark3.2 separately.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r828101218
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkMergeHelper.java
##########
@@ -77,14 +89,39 @@ public void runMerge(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD<HoodieKey>
readSchema = mergeHandle.getWriterSchemaWithMetaFields();
}
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ Boolean needToReWriteRecord = false;
+ // to do support bootstrap
+ if (querySchemaOpt.isPresent() && !baseFile.getBootstrapBaseFile().isPresent()) {
+ // check implicitly add columns, and position reorder(spark sql may change cols order)
+ InternalSchema querySchema = AvroSchemaUtil.evolutionSchemaFromNewAvroSchema(readSchema, querySchemaOpt.get(), true);
+ long commitTime = Long.valueOf(FSUtils.getCommitTime(mergeHandle.getOldFilePath().getName()));
+ InternalSchema writeInternalSchema = TableInternalSchemaUtils.searchSchemaAndCache(commitTime, table.getMetaClient());
+ List<String> colNamesFromQuerySchema = querySchema.getAllColsFullName();
+ List<String> colNamesFromWriteSchema = writeInternalSchema.getAllColsFullName();
+ List<String> diffCols = colNamesFromWriteSchema.stream()
Review comment:
yes，you are right, it should be named sameCols
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r828027957
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkMergeHelper.java
##########
@@ -77,14 +89,39 @@ public void runMerge(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD<HoodieKey>
readSchema = mergeHandle.getWriterSchemaWithMetaFields();
}
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ Boolean needToReWriteRecord = false;
+ // to do support bootstrap
+ if (querySchemaOpt.isPresent() && !baseFile.getBootstrapBaseFile().isPresent()) {
+ // check implicitly add columns, and position reorder(spark sql may change cols order)
+ InternalSchema querySchema = AvroSchemaUtil.evolutionSchemaFromNewAvroSchema(readSchema, querySchemaOpt.get(), true);
+ long commitTime = Long.valueOf(FSUtils.getCommitTime(mergeHandle.getOldFilePath().getName()));
+ InternalSchema writeInternalSchema = TableInternalSchemaUtils.searchSchemaAndCache(commitTime, table.getMetaClient());
+ List<String> colNamesFromQuerySchema = querySchema.getAllColsFullName();
+ List<String> colNamesFromWriteSchema = writeInternalSchema.getAllColsFullName();
+ List<String> diffCols = colNamesFromWriteSchema.stream()
Review comment:
Should this be named sameCols?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java
##########
@@ -361,15 +372,38 @@ private boolean isNewInstantBlock(HoodieLogBlock logBlock) {
*/
private void processDataBlock(HoodieDataBlock dataBlock, Option<List<String>> keys) throws Exception {
try (ClosableIterator<IndexedRecord> recordItr = dataBlock.getRecordItr(keys.orElse(Collections.emptyList()))) {
+ boolean headRecord = true;
+ Option<Schema> schemaOption = Option.empty();
while (recordItr.hasNext()) {
- IndexedRecord record = recordItr.next();
+ IndexedRecord currentRecord = recordItr.next();
+ if (headRecord) {
+ schemaOption = getMergedSchema(dataBlock, currentRecord);
+ headRecord = false;
+ }
+ IndexedRecord record = schemaOption.isPresent() ? AvroSchemaUtil.rewriteRecord(currentRecord, schemaOption.get()) : currentRecord;
Review comment:
Looks like we are doing this for reading from Log file. Are we doing similar schema rewrite when reading from previous version of parquet file for compaction and COW ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076593652
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* 1c95fe08a4c7e03188a98c531817294555d41505 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079624873
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b61ba72e253a02c3176b1687eba89a22024b580b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389)
* 5357ce8bff9b47bfe50816b178c267efed1d3b0e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079620376
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b61ba72e253a02c3176b1687eba89a22024b580b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389)
* 5357ce8bff9b47bfe50816b178c267efed1d3b0e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077043430
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079989342
> @xiarixiaoyao 'Cause this pr is so huge. So please help me to sort the implement out.
>
> 1. do the `SerDeHelper.LATESTSCHEMA` attribute of one commit file and the `SAVE_SCHEMA_ACTION` file save the same thing, or can they convert each other?
> 2. if enable `hoodie.schema.evolution.enable`, will every commit persist `SerDeHelper.LATESTSCHEMA` in meta file ?
> 3. When will commit the `SAVE_SCHEMA_ACTION` file? Once that schema is changed ?
> 4. How to make the Hudi Table with old version like 0.10 compatible with this ? If enable `hoodie.schema.evolution.enable` on an existed old-version hudi table, what will happen? Or we are not about to make them compatible, then how to refuse this.
> 5. this pr can work when enable `hoodie.metadata.enable` ?
> 6. why we need to separate Spark3.1 and Spark3.2? See more repeated codes. so try to optimize them if indeed need to deal with spark3.1 and spark3.2 separately.
@xiarixiaoyao : Can you please reply to each of @YannByron questions here ?
One specific question: For an existing table (0.10.1 or prior), Specifically, hoodie.metadata.enable is a writer side config. Readers (Query Engines) will only get to look at evolved schema when they exist as valid schema files. This is what I understood. Is this correct?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1076176711
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 35845665ddbfb2c176c80ddbe30404422f01cfac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216)
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* d16fb4953f49ca231f49247924760cbb7a3efcb6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079064469
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* c266a8e2797ef8ae829d6e14860c5a1091a933bb Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370)
* 544b64a34f4ba19ef742e606e23d8986284be43f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077006690
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* 1c95fe08a4c7e03188a98c531817294555d41505 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250)
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082552898
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* aeaa837dd208456b9bb0ad07f1675f7d9ea1c175 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509)
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* ccb5902d740a98ce9cbcbb09a26e344400a3cc17 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1080095336
> > [#4910 (comment)](https://github.com/apache/hudi/pull/4910#discussion_r834319573) @bvaradar @YannByron this is test result
> > <style> </style>
> > Test case:
> > dataSize: 100G data with 101 columns
> > testQuery: spark.time {spark.sql("select col99, col98 from hudicow_100g where col99 > '77'").count}
> > Test resources:
> > spark-shell --master yarn --driver-memory 20g --executor-memory 8g --executor-cores 3 --num-executors 10 --conf spark.sql.parquet.enableVectorizedReader=true --jars /opt/hudi-spark3.1.2-bundle_2.12-0.11.0-SNAPSHOT.jar --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'
> > Test result:
> > 1st 2st 3st 4st
> > Before_change 23051 ms 4919 ms 4777 ms 4728 ms
> > After_change 23486 ms 14705 ms 11089 ms 11564 ms
> >
> > Let’s ignore the first time query result, since Spark is doing the distribution and initialization of jar packages
> > We can see that the performance degradation is very obvious
>
> @xiarixiaoyao : Not sure what before and after change means here. If I understand correctly, this change in schema evolution results in vectorized reading not working in BaseFileOnlyViewRelation. Correct? If so, can we fix it in this PR itself instead of next PR. Are tables only with schema evolution enabled will not have vectorized working or all the tables (even when there is no schema evolution) affected with the change in BaseFileOnlyViewRelation?
>
> Also, you mentioned that you have removed old hudi relation. Is this the fix for improving the vectorized reading. In that case, Is this change have vectorized reading working?
This problem has nothing to do with schema evolution. It is a problem of Hudi itself.
we have already fixed this problem in this pr.
This problem has been discussed with xushiyan, alexeykudinkin, YannByron .
This problem can be repaired in this PR or another pr. I prefer the latter
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084145291
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 5c147a6a52c3f118a154c9b36c09b9f245dd20e2 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612)
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084954713
@nsivabalan Can you try rerunning your tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840006716
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##########
@@ -167,6 +167,22 @@
+ "implementations of HoodieRecordPayload to convert incoming records to avro. This is also used as the write schema "
+ "evolving records during an update.");
+ public static final ConfigProperty<String> INTERNAL_SCHEMA_STRING = ConfigProperty
Review comment:
will revisit these docs.
##########
File path: pom.xml
##########
@@ -127,6 +127,8 @@
<flink.runtime.artifactId>flink-runtime</flink.runtime.artifactId>
<flink.table.runtime.artifactId>flink-table-runtime_${scala.binary.version}</flink.table.runtime.artifactId>
<flink.table.planner.artifactId>flink-table-planner_${scala.binary.version}</flink.table.planner.artifactId>
+ <spark31.version>3.1.2</spark31.version>
Review comment:
Need to ensure the pom changes are compatible with all thats gone into master
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java
##########
@@ -73,7 +73,8 @@
INFLIGHT_COMPACTION_EXTENSION, REQUESTED_COMPACTION_EXTENSION,
REQUESTED_RESTORE_EXTENSION, INFLIGHT_RESTORE_EXTENSION, RESTORE_EXTENSION,
ROLLBACK_EXTENSION, REQUESTED_ROLLBACK_EXTENSION, INFLIGHT_ROLLBACK_EXTENSION,
- REQUESTED_REPLACE_COMMIT_EXTENSION, INFLIGHT_REPLACE_COMMIT_EXTENSION, REPLACE_COMMIT_EXTENSION));
+ REQUESTED_REPLACE_COMMIT_EXTENSION, INFLIGHT_REPLACE_COMMIT_EXTENSION, REPLACE_COMMIT_EXTENSION,
+ REQUESTED_SAVE_SCHEMA_ACTION_EXTENSION, INFLIGHT_SAVE_SCHEMA_ACTION_EXTENSION, SAVE_SCHEMA_ACTION_EXTENSION));
Review comment:
can we call this `ALTER_SCHEMA` as well, to be consistent?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieTimeline.java
##########
@@ -55,6 +55,8 @@
String COMPACTION_ACTION = "compaction";
String REQUESTED_EXTENSION = ".requested";
String RESTORE_ACTION = "restore";
+ // only for schema save
+ String SAVE_SCHEMA_ACTION = "schemacommit";
Review comment:
then lets just call it SCHEMA_COMMIT_ACTION?
##########
File path: hudi-spark-datasource/hudi-spark3/src/main/java/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieVectorizedParquetRecordReader.java
##########
@@ -0,0 +1,191 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet;
+
+import org.apache.hadoop.mapreduce.InputSplit;
+import org.apache.hadoop.mapreduce.TaskAttemptContext;
+import org.apache.hudi.client.utils.SparkInternalSchemaConverter;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.spark.memory.MemoryMode;
+import org.apache.spark.sql.catalyst.InternalRow;
+import org.apache.spark.sql.execution.vectorized.OffHeapColumnVector;
+import org.apache.spark.sql.execution.vectorized.OnHeapColumnVector;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.vectorized.ColumnarBatch;
+
+import java.io.IOException;
+import java.time.ZoneId;
+import java.util.HashMap;
+import java.util.Map;
+
+public class Spark32HoodieVectorizedParquetRecordReader extends VectorizedParquetRecordReader {
Review comment:
oh god. we have our own reader now? :)
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/IncrementalRelation.scala
##########
@@ -82,21 +85,33 @@ class IncrementalRelation(val sqlContext: SQLContext,
private val commitsToReturn = commitsTimelineToReturn.getInstants.iterator().toList
// use schema from a file produced in the end/latest instant
- val usedSchema: StructType = {
+
+ val (usedSchema, internalSchema) = {
log.info("Inferring schema..")
val schemaResolver = new TableSchemaResolver(metaClient)
- val tableSchema = if (useEndInstantSchema) {
+ val iSchema = if (useEndInstantSchema && !commitsToReturn.isEmpty) {
+ InternalSchemaCache.searchSchemaAndCache(commitsToReturn.last.getTimestamp.toLong, metaClient, hoodieTable.getConfig.getInternalSchemaCacheEnable)
+ } else {
+ schemaResolver.getTableInternalSchemaFromCommitMetadata.orElse(null)
+ }
Review comment:
IIUC if schema evol is not turned on, there is nothing to find in the cache (default turned off) and since LATEST_SCHEMA wont be written into commit metadta - iSchema will be null. Corrct?
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java
##########
@@ -588,6 +589,9 @@ public void archive(HoodieEngineContext context, List<HoodieInstant> instants) t
}
}
writeToFile(wrapperSchema, records);
+ // try to clean old history schema.
+ FileBasedInternalSchemaStorageManager fss = new FileBasedInternalSchemaStorageManager(metaClient);
Review comment:
Ccarrying over the same comment. this should happen at the cleaner?
##########
File path: hudi-common/pom.xml
##########
@@ -108,6 +108,13 @@
<artifactId>jackson-databind</artifactId>
</dependency>
+ <!-- caffeine -->
+ <dependency>
+ <groupId>com.github.ben-manes.caffeine</groupId>
+ <artifactId>caffeine</artifactId>
+ <version>2.9.1</version>
Review comment:
Pull version into root pom
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieMergeHelper.java
##########
@@ -78,12 +90,41 @@ public void runMerge(HoodieTable<T, HoodieData<HoodieRecord<T>>, HoodieData<Hood
BoundedInMemoryExecutor<GenericRecord, GenericRecord, Void> wrapper = null;
HoodieFileReader<GenericRecord> reader = HoodieFileReaderFactory.getFileReader(cfgForHoodieFile, mergeHandle.getOldFilePath());
+
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
Review comment:
Would this be empty if schema evol is not enabled?
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##########
@@ -167,6 +167,22 @@
+ "implementations of HoodieRecordPayload to convert incoming records to avro. This is also used as the write schema "
+ "evolving records during an update.");
+ public static final ConfigProperty<String> INTERNAL_SCHEMA_STRING = ConfigProperty
+ .key("hoodie.internal.schema")
+ .noDefaultValue()
+ .withDocumentation("Schema string representing the latest schema of the table. Hudi passes this to "
+ + "implementations of evolution of schema");
+
+ public static final ConfigProperty<Boolean> SCHEMA_EVOLUTION_ENABLE = ConfigProperty
Review comment:
This almost seems it like Hudi does not evolve schemas today. Could we call this `schema.on.read.enable` (what we have today is a more conservative schema.on.write approach. what are your thoughts?
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java
##########
@@ -241,6 +255,31 @@ protected void commit(HoodieTable table, String commitActionType, String instant
HoodieActiveTimeline activeTimeline = table.getActiveTimeline();
// Finalize write
finalizeWrite(table, instantTime, stats);
+ // do save internal schema to support Implicitly add columns in write process
Review comment:
Pull into a Separate method?
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/HoodieCompactor.java
##########
@@ -117,8 +120,10 @@ public abstract void preCompact(
// log file.That is because in the case of MergeInto, the config.getSchema may not
// the same with the table schema.
try {
- Schema readerSchema = schemaResolver.getTableAvroSchema(false);
- config.setSchema(readerSchema.toString());
+ if (StringUtils.isNullOrEmpty(config.getInternalSchema())) {
Review comment:
this should be empty if the latest_schema key is not written at all i.e schema evol is not turned on?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,207 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.fs.FSUtils;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.List;
+import java.util.Set;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // Use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * Search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param metaClient current hoodie metaClient
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient, boolean cacheEnable) {
+ Option<InternalSchema> candidateSchema = getSchemaByReadingCommitFile(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ if (!cacheEnable) {
+ // parse history schema and return directly
+ return InternalSchemaUtils.searchSchema(versionID, getHistoricalSchemas(metaClient));
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || InternalSchemaUtils.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return InternalSchemaUtils.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> getSchemaByReadingCommitFile(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ /**
+ * Get internalSchema and avroSchema for compaction/cluster operation.
+ *
+ * @param metaClient current hoodie metaClient
+ * @param compactionAndClusteringInstant first instant before current compaction/cluster instant
+ * @return (internalSchemaStrOpt, avroSchemaStrOpt) a pair of InternalSchema/avroSchema
+ */
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getCommitsAndCompactionTimeline().findInstantsBefore(compactionAndClusteringInstant).filterCompletedInstants();
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata;
+ try {
+ metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ } catch (Exception e) {
+ throw new HoodieException(String.format("cannot read metadata from commit: %s", lastInstantBeforeCurrentCompaction.get()), e);
+ }
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ }
+ return Pair.of(Option.empty(), Option.empty());
+ }
+
+ /**
+ * Give a schema versionId return its internalSchema.
+ * This method will be called by spark tasks, we should minimize time cost.
+ * We try our best to not use metaClient， since the initialization of metaClient is time cost
+ * step1：
+ * try to parser internalSchema from HoodieInstant directly
+ * step2：
+ * if we cannot parser internalSchema in step1，
+ * try to find internalSchema in historySchema.
+ *
+ * @param versionId the internalSchema version to be search.
+ * @param tablePath table path
+ * @param hadoopConf conf
+ * @param validCommits current validate commits, use to make up the commit file path/verify the validity of the history schema files
+ * @return a internalSchema.
+ */
+ public static InternalSchema getInternalSchemaByVersionId(long versionId, String tablePath, Configuration hadoopConf, String validCommits) {
+ Set<String> commitSet = Arrays.stream(validCommits.split(",")).collect(Collectors.toSet());
+ List<String> validateCommitList = commitSet.stream().map(fileName -> {
+ String fileExtension = HoodieInstant.getTimelineFileExtension(fileName);
+ return fileName.replace(fileExtension, "");
+ }).collect(Collectors.toList());
+
+ FileSystem fs = FSUtils.getFs(tablePath, hadoopConf);
+ Path hoodieMetaPath = new Path(tablePath, HoodieTableMetaClient.METAFOLDER_NAME);
+ //step1:
+ Path candidateCommitFile = commitSet.stream().filter(fileName -> {
+ String fileExtension = HoodieInstant.getTimelineFileExtension(fileName);
+ return fileName.replace(fileExtension, "").equals(versionId + "");
+ }).findFirst().map(f -> new Path(hoodieMetaPath, f)).orElse(null);
+ if (candidateCommitFile != null) {
+ try {
+ byte[] data;
+ try (FSDataInputStream is = fs.open(candidateCommitFile)) {
+ data = FileIOUtils.readAsByteArray(is);
+ } catch (IOException e) {
+ throw e;
+ }
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (latestInternalSchemaStr != null) {
+ return SerDeHelper.fromJson(latestInternalSchemaStr).orElse(null);
+ }
+ } catch (Exception e1) {
+ // swallow this exception.
Review comment:
log something?
##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataMergedLogRecordReader.java
##########
@@ -65,7 +65,7 @@ private HoodieMetadataMergedLogRecordReader(FileSystem fs, String basePath, Stri
Option<InstantRange> instantRange, boolean enableFullScan) {
super(fs, basePath, logFilePaths, readerSchema, latestInstantTime, maxMemorySizeInBytes, false, false, bufferSize,
spillableMapBasePath, instantRange, false, diskMapType, isBitCaskDiskMapCompressionEnabled, false,
- enableFullScan, Option.of(partitionName));
+ enableFullScan, Option.of(partitionName), null);
Review comment:
dont love passing in `null` as a sentinel value. change to empty?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java
##########
@@ -109,6 +114,9 @@
private final FileSystem fs;
// Total log files read - for metrics
private AtomicLong totalLogFiles = new AtomicLong(0);
+ // Internal schema
+ private InternalSchema internalSchema;
+ private final String path;
Review comment:
add javadocs for this?
##########
File path: hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala
##########
@@ -0,0 +1,349 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import java.net.URI
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.hadoop.fs.Path
+import org.apache.hadoop.mapred.FileSplit
+import org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
+import org.apache.hadoop.mapreduce.{JobID, TaskAttemptID, TaskID, TaskType}
+import org.apache.hudi.client.utils.SparkInternalSchemaConverter
+import org.apache.hudi.common.fs.FSUtils
+import org.apache.hudi.common.util.InternalSchemaCache
+import org.apache.hudi.common.util.collection.Pair
+import org.apache.hudi.internal.schema.InternalSchema
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger
+import org.apache.hudi.internal.schema.utils.{InternalSchemaUtils, SerDeHelper}
+import org.apache.parquet.filter2.compat.FilterCompat
+import org.apache.parquet.filter2.predicate.FilterApi
+import org.apache.parquet.format.converter.ParquetMetadataConverter.SKIP_ROW_GROUPS
+import org.apache.parquet.hadoop.{ParquetFileReader, ParquetInputFormat, ParquetRecordReader}
+import org.apache.spark.TaskContext
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.catalyst.expressions.{Cast, JoinedRow}
+import org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection
+import org.apache.spark.sql.catalyst.util.DateTimeUtils
+import org.apache.spark.sql.execution.datasources.{DataSourceUtils, PartitionedFile, RecordReaderIterator}
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources._
+import org.apache.spark.sql.types.{AtomicType, DataType, StructField, StructType}
+import org.apache.spark.util.SerializableConfiguration
+
+class Spark32HoodieParquetFileFormat extends ParquetFileFormat {
+
+ // reference ParquetFileFormat from spark project
+ override def buildReaderWithPartitionValues(
+ sparkSession: SparkSession,
+ dataSchema: StructType,
+ partitionSchema: StructType,
+ requiredSchema: StructType,
+ filters: Seq[Filter],
+ options: Map[String, String],
+ hadoopConf: Configuration): PartitionedFile => Iterator[InternalRow] = {
+ if (hadoopConf.get(SparkInternalSchemaConverter.HOODIE_QUERY_SCHEMA, "").isEmpty) {
+ // fallback to origin parquet File read
+ super.buildReaderWithPartitionValues(sparkSession, dataSchema, partitionSchema, requiredSchema, filters, options, hadoopConf)
Review comment:
Okay ! this should preserve existing perf
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala
##########
@@ -60,6 +60,12 @@ class BaseFileOnlyRelation(sqlContext: SQLContext,
tableSchema: HoodieTableSchema,
requiredSchema: HoodieTableSchema,
filters: Array[Filter]): HoodieUnsafeRDD = {
+ if (!internalSchema.isEmptySchema) {
+ // it is safe to enable vectorizedReader
+ sqlContext.sparkSession.sessionState.conf.setConfString("spark.sql.parquet.recordLevelFilter.enabled", "false")
Review comment:
whats the impact of this?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/AlterHoodieTableAddColumnsCommand.scala
##########
@@ -110,15 +110,15 @@ object AlterHoodieTableAddColumnsCommand {
HoodieWriterUtils.parametersWithWriteDefaults(hoodieCatalogTable.catalogProperties).asJava
)
- val commitActionType = CommitUtils.getCommitActionType(WriteOperationType.INSERT, hoodieCatalogTable.tableType)
+ val commitActionType = CommitUtils.getCommitActionType(WriteOperationType.ALTER_SCHEMA, hoodieCatalogTable.tableType)
Review comment:
does this work even if the writer does not turn on schema evolution originally for the table? say it was created using DeltaStreamer tool
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
##########
@@ -315,6 +329,32 @@ object HoodieSparkSqlWriter {
processedRecord
}
+ def addSchemaEvolutionParameters(parameters: Map[String, String], internalSchemaOpt: Option[InternalSchema]): Map[String, String] = {
+ val schemaEvolutionEnable = if (internalSchemaOpt.isDefined) "true" else "false"
+ parameters ++ Map(HoodieWriteConfig.INTERNAL_SCHEMA_STRING.key() -> SerDeHelper.toJson(internalSchemaOpt.getOrElse(null)),
+ HoodieWriteConfig.SCHEMA_EVOLUTION_ENABLE.key() -> schemaEvolutionEnable)
+ }
+
+ /**
+ * get latest internalSchema from table
+ *
+ * @param fs instance of FileSystem.
+ * @param basePath base path.
+ * @param sparkContext instance of spark context.
+ * @param schema incoming record's schema.
+ * @return Pair of(boolean, table schema), where first entry will be true only if schema conversion is required.
+ */
+ def getLatestTableInternalSchema(fs: FileSystem, basePath: Path, sparkContext: SparkContext): Option[InternalSchema] = {
+ if (FSUtils.isTableExists(basePath.toString, fs)) {
Review comment:
can we handle the exception and return None as opposed to checking `isTableExists`
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieDataSourceHelper.scala
##########
@@ -46,7 +49,7 @@ object HoodieDataSourceHelper extends PredicateHelper {
options: Map[String, String],
hadoopConf: Configuration): PartitionedFile => Iterator[InternalRow] = {
- val readParquetFile: PartitionedFile => Iterator[Any] = new ParquetFileFormat().buildReaderWithPartitionValues(
+ val readParquetFile: PartitionedFile => Iterator[Any] = sparkAdapter.createHoodieParquetFileFormat().get.buildReaderWithPartitionValues(
Review comment:
I understand you are subclasses the original class. Have you verfied there are no performance diffrences with the file format switch?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieTimeline.java
##########
@@ -55,6 +55,8 @@
String COMPACTION_ACTION = "compaction";
String REQUESTED_EXTENSION = ".requested";
String RESTORE_ACTION = "restore";
+ // only for schema save
+ String SAVE_SCHEMA_ACTION = "schemacommit";
Review comment:
Should the rest of the code treat this as a write ? i.e should be include this in the getWriteTimeline() method?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala
##########
@@ -61,6 +61,11 @@ class MergeOnReadSnapshotRelation(sqlContext: SQLContext,
tableSchema: HoodieTableSchema,
requiredSchema: HoodieTableSchema,
filters: Array[Filter]): HoodieMergeOnReadRDD = {
+ if (!internalSchema.isEmptySchema) {
Review comment:
pull this into a method and share across the different classes?
##########
File path: hudi-spark-datasource/hudi-spark3/src/main/java/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieVectorizedParquetRecordReader.java
##########
@@ -0,0 +1,191 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet;
+
+import org.apache.hadoop.mapreduce.InputSplit;
+import org.apache.hadoop.mapreduce.TaskAttemptContext;
+import org.apache.hudi.client.utils.SparkInternalSchemaConverter;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.spark.memory.MemoryMode;
+import org.apache.spark.sql.catalyst.InternalRow;
+import org.apache.spark.sql.execution.vectorized.OffHeapColumnVector;
+import org.apache.spark.sql.execution.vectorized.OnHeapColumnVector;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.vectorized.ColumnarBatch;
+
+import java.io.IOException;
+import java.time.ZoneId;
+import java.util.HashMap;
+import java.util.Map;
+
+public class Spark32HoodieVectorizedParquetRecordReader extends VectorizedParquetRecordReader {
Review comment:
but we just seem to be wrapping the super class
##########
File path: hudi-spark-datasource/hudi-spark3/src/main/java/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieVectorizedParquetRecordReader.java
##########
@@ -0,0 +1,191 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet;
+
+import org.apache.hadoop.mapreduce.InputSplit;
+import org.apache.hadoop.mapreduce.TaskAttemptContext;
+import org.apache.hudi.client.utils.SparkInternalSchemaConverter;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.spark.memory.MemoryMode;
+import org.apache.spark.sql.catalyst.InternalRow;
+import org.apache.spark.sql.execution.vectorized.OffHeapColumnVector;
+import org.apache.spark.sql.execution.vectorized.OnHeapColumnVector;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.vectorized.ColumnarBatch;
+
+import java.io.IOException;
+import java.time.ZoneId;
+import java.util.HashMap;
+import java.util.Map;
+
+public class Spark32HoodieVectorizedParquetRecordReader extends VectorizedParquetRecordReader {
Review comment:
how is this wired to the file format and invoked?
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieDataSourceHelper.scala
##########
@@ -78,4 +81,11 @@ object HoodieDataSourceHelper extends PredicateHelper {
}
}
+ def getConfigurationForInternalSchema(conf: Configuration, internalSchema: InternalSchema, tablePath: String, validCommits: String): Configuration = {
Review comment:
add docs to explain why we do this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085966215
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
}, {
"hash" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"triggerType" : "PUSH"
}, {
"hash" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705",
"triggerID" : "e28e7f2e100c377fe92d1ae89983d97c424b630a",
"triggerType" : "PUSH"
}, {
"hash" : "c7c98b00d24280081192f7e133b2e1b44e532392",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c7c98b00d24280081192f7e133b2e1b44e532392",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a66629f12e982bc3eb1fc0c17420004ee3de2033 UNKNOWN
* e28e7f2e100c377fe92d1ae89983d97c424b630a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7705)
* c7c98b00d24280081192f7e133b2e1b44e532392 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084414042
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840410773
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java
##########
@@ -167,6 +167,22 @@
+ "implementations of HoodieRecordPayload to convert incoming records to avro. This is also used as the write schema "
+ "evolving records during an update.");
+ public static final ConfigProperty<String> INTERNAL_SCHEMA_STRING = ConfigProperty
+ .key("hoodie.internal.schema")
+ .noDefaultValue()
+ .withDocumentation("Schema string representing the latest schema of the table. Hudi passes this to "
+ + "implementations of evolution of schema");
+
+ public static final ConfigProperty<Boolean> SCHEMA_EVOLUTION_ENABLE = ConfigProperty
Review comment:
fixed
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java
##########
@@ -109,6 +114,9 @@
private final FileSystem fs;
// Total log files read - for metrics
private AtomicLong totalLogFiles = new AtomicLong(0);
+ // Internal schema
+ private InternalSchema internalSchema;
+ private final String path;
Review comment:
fixed
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java
##########
@@ -0,0 +1,207 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hadoop.fs.FSDataInputStream;
+import org.apache.hadoop.fs.FileSystem;
+import org.apache.hadoop.fs.Path;
+import org.apache.hudi.common.fs.FSUtils;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.io.IOException;
+import java.util.Arrays;
+import java.util.List;
+import java.util.Set;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class InternalSchemaCache {
+ // Use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * Search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param metaClient current hoodie metaClient
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient, boolean cacheEnable) {
+ Option<InternalSchema> candidateSchema = getSchemaByReadingCommitFile(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ if (!cacheEnable) {
+ // parse history schema and return directly
+ return InternalSchemaUtils.searchSchema(versionID, getHistoricalSchemas(metaClient));
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || InternalSchemaUtils.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return InternalSchemaUtils.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> getSchemaByReadingCommitFile(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ /**
+ * Get internalSchema and avroSchema for compaction/cluster operation.
+ *
+ * @param metaClient current hoodie metaClient
+ * @param compactionAndClusteringInstant first instant before current compaction/cluster instant
+ * @return (internalSchemaStrOpt, avroSchemaStrOpt) a pair of InternalSchema/avroSchema
+ */
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getCommitsAndCompactionTimeline().findInstantsBefore(compactionAndClusteringInstant).filterCompletedInstants();
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata;
+ try {
+ metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ } catch (Exception e) {
+ throw new HoodieException(String.format("cannot read metadata from commit: %s", lastInstantBeforeCurrentCompaction.get()), e);
+ }
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ }
+ return Pair.of(Option.empty(), Option.empty());
+ }
+
+ /**
+ * Give a schema versionId return its internalSchema.
+ * This method will be called by spark tasks, we should minimize time cost.
+ * We try our best to not use metaClient， since the initialization of metaClient is time cost
+ * step1：
+ * try to parser internalSchema from HoodieInstant directly
+ * step2：
+ * if we cannot parser internalSchema in step1，
+ * try to find internalSchema in historySchema.
+ *
+ * @param versionId the internalSchema version to be search.
+ * @param tablePath table path
+ * @param hadoopConf conf
+ * @param validCommits current validate commits, use to make up the commit file path/verify the validity of the history schema files
+ * @return a internalSchema.
+ */
+ public static InternalSchema getInternalSchemaByVersionId(long versionId, String tablePath, Configuration hadoopConf, String validCommits) {
+ Set<String> commitSet = Arrays.stream(validCommits.split(",")).collect(Collectors.toSet());
+ List<String> validateCommitList = commitSet.stream().map(fileName -> {
+ String fileExtension = HoodieInstant.getTimelineFileExtension(fileName);
+ return fileName.replace(fileExtension, "");
+ }).collect(Collectors.toList());
+
+ FileSystem fs = FSUtils.getFs(tablePath, hadoopConf);
+ Path hoodieMetaPath = new Path(tablePath, HoodieTableMetaClient.METAFOLDER_NAME);
+ //step1:
+ Path candidateCommitFile = commitSet.stream().filter(fileName -> {
+ String fileExtension = HoodieInstant.getTimelineFileExtension(fileName);
+ return fileName.replace(fileExtension, "").equals(versionId + "");
+ }).findFirst().map(f -> new Path(hoodieMetaPath, f)).orElse(null);
+ if (candidateCommitFile != null) {
+ try {
+ byte[] data;
+ try (FSDataInputStream is = fs.open(candidateCommitFile)) {
+ data = FileIOUtils.readAsByteArray(is);
+ } catch (IOException e) {
+ throw e;
+ }
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATEST_SCHEMA);
+ if (latestInternalSchemaStr != null) {
+ return SerDeHelper.fromJson(latestInternalSchemaStr).orElse(null);
+ }
+ } catch (Exception e1) {
+ // swallow this exception.
Review comment:
fixed
##########
File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataMergedLogRecordReader.java
##########
@@ -65,7 +65,7 @@ private HoodieMetadataMergedLogRecordReader(FileSystem fs, String basePath, Stri
Option<InstantRange> instantRange, boolean enableFullScan) {
super(fs, basePath, logFilePaths, readerSchema, latestInstantTime, maxMemorySizeInBytes, false, false, bufferSize,
spillableMapBasePath, instantRange, false, diskMapType, isBitCaskDiskMapCompressionEnabled, false,
- enableFullScan, Option.of(partitionName));
+ enableFullScan, Option.of(partitionName), null);
Review comment:
fixed
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java
##########
@@ -73,7 +73,8 @@
INFLIGHT_COMPACTION_EXTENSION, REQUESTED_COMPACTION_EXTENSION,
REQUESTED_RESTORE_EXTENSION, INFLIGHT_RESTORE_EXTENSION, RESTORE_EXTENSION,
ROLLBACK_EXTENSION, REQUESTED_ROLLBACK_EXTENSION, INFLIGHT_ROLLBACK_EXTENSION,
- REQUESTED_REPLACE_COMMIT_EXTENSION, INFLIGHT_REPLACE_COMMIT_EXTENSION, REPLACE_COMMIT_EXTENSION));
+ REQUESTED_REPLACE_COMMIT_EXTENSION, INFLIGHT_REPLACE_COMMIT_EXTENSION, REPLACE_COMMIT_EXTENSION,
+ REQUESTED_SAVE_SCHEMA_ACTION_EXTENSION, INFLIGHT_SAVE_SCHEMA_ACTION_EXTENSION, SAVE_SCHEMA_ACTION_EXTENSION));
Review comment:
agree
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085371993
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634)
* 1f3a776922f8821917ee08adc51c097f3606fabc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085681097
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682)
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840410451
##########
File path: hudi-common/pom.xml
##########
@@ -108,6 +108,13 @@
<artifactId>jackson-databind</artifactId>
</dependency>
+ <!-- caffeine -->
+ <dependency>
+ <groupId>com.github.ben-manes.caffeine</groupId>
+ <artifactId>caffeine</artifactId>
+ <version>2.9.1</version>
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085388404
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 54aa92b9ddba8d567ea3b593700601460bb6ea53 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634)
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085875245
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* 929adaa89a13ba028801aaa49fdd41cb99594f96 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690)
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a85abe9d8517f591f43201d61b729066939b99a1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085877159
> @xiarixiaoyao : Finished reviewing new code changes. Making one final pass now. Meanwhile, please take a look at the comments.
>
> Also one more comment: Its good that we moved the version definition of caffeine to parent pom file. We would still need a dependency statement in hudi-common/pom.xml (without version) as caffeine is directly used in the code. Can you add the below patch
>
> ```
> diff --git a/hudi-common/pom.xml b/hudi-common/pom.xml
> index f60573875c..ece8d242ce 100644
> --- a/hudi-common/pom.xml
> +++ b/hudi-common/pom.xml
> @@ -117,6 +117,12 @@
> <artifactId>avro</artifactId>
> </dependency>
>
> + <!-- caffeine -->
> + <dependency>
> + <groupId>com.github.ben-manes.caffeine</groupId>
> + <artifactId>caffeine</artifactId>
> + </dependency>
> +
> <!-- Parquet -->
> <dependency>
> <groupId>org.apache.parquet</groupId>
> ```
Thanks for reminding, already fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840174776
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieMergeHelper.java
##########
@@ -78,12 +90,41 @@ public void runMerge(HoodieTable<T, HoodieData<HoodieRecord<T>>, HoodieData<Hood
BoundedInMemoryExecutor<GenericRecord, GenericRecord, Void> wrapper = null;
HoodieFileReader<GenericRecord> reader = HoodieFileReaderFactory.getFileReader(cfgForHoodieFile, mergeHandle.getOldFilePath());
+
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
Review comment:
yes
##########
File path: hudi-common/pom.xml
##########
@@ -108,6 +108,13 @@
<artifactId>jackson-databind</artifactId>
</dependency>
+ <!-- caffeine -->
+ <dependency>
+ <groupId>com.github.ben-manes.caffeine</groupId>
+ <artifactId>caffeine</artifactId>
+ <version>2.9.1</version>
Review comment:
agree
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085879542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
}, {
"hash" : "a85abe9d8517f591f43201d61b729066939b99a1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699",
"triggerID" : "a85abe9d8517f591f43201d61b729066939b99a1",
"triggerType" : "PUSH"
}, {
"hash" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a66629f12e982bc3eb1fc0c17420004ee3de2033",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* 929adaa89a13ba028801aaa49fdd41cb99594f96 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690)
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
* a85abe9d8517f591f43201d61b729066939b99a1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7699)
* a66629f12e982bc3eb1fc0c17420004ee3de2033 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1050835322
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c09a928506e41a69dd5e48f1cc2f7815216db1e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312)
* 4e04e2076296e16e1b5b60b510ed85d536873a93 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1053981830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* 4ff0d57275e8f907d945c60bd93c2bef227c7c3d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355)
* cb8c6f4233cb1bac50aa67de4145df8458499f6d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830504082
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkSchemaUtils.java
##########
@@ -0,0 +1,499 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.client.utils;
+
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.ArrayType;
+import org.apache.spark.sql.types.ArrayType$;
+import org.apache.spark.sql.types.BinaryType;
+import org.apache.spark.sql.types.BinaryType$;
+import org.apache.spark.sql.types.BooleanType;
+import org.apache.spark.sql.types.BooleanType$;
+import org.apache.spark.sql.types.ByteType;
+import org.apache.spark.sql.types.CharType;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.DateType;
+import org.apache.spark.sql.types.DateType$;
+import org.apache.spark.sql.types.Decimal;
+import org.apache.spark.sql.types.DecimalType;
+import org.apache.spark.sql.types.DecimalType$;
+import org.apache.spark.sql.types.DoubleType;
+import org.apache.spark.sql.types.DoubleType$;
+import org.apache.spark.sql.types.FloatType;
+import org.apache.spark.sql.types.FloatType$;
+import org.apache.spark.sql.types.IntegerType;
+import org.apache.spark.sql.types.IntegerType$;
+import org.apache.spark.sql.types.LongType;
+import org.apache.spark.sql.types.LongType$;
+import org.apache.spark.sql.types.MapType;
+import org.apache.spark.sql.types.MapType$;
+import org.apache.spark.sql.types.Metadata;
+import org.apache.spark.sql.types.ShortType;
+import org.apache.spark.sql.types.StringType;
+import org.apache.spark.sql.types.StringType$;
+import org.apache.spark.sql.types.StructField;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.types.StructType$;
+import org.apache.spark.sql.types.TimestampType;
+import org.apache.spark.sql.types.TimestampType$;
+import org.apache.spark.sql.types.UserDefinedType;
+import org.apache.spark.sql.types.VarcharType;
+
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class SparkSchemaUtils {
+ private SparkSchemaUtils() {
+
+ }
+
+ public static final String HOODIE_QUERY_SCHEMA = "hadoop.hoodie.querySchema";
Review comment:
sorry， no specifc reason。fixed
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkSchemaUtils.java
##########
@@ -0,0 +1,499 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.client.utils;
+
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.ArrayType;
+import org.apache.spark.sql.types.ArrayType$;
+import org.apache.spark.sql.types.BinaryType;
+import org.apache.spark.sql.types.BinaryType$;
+import org.apache.spark.sql.types.BooleanType;
+import org.apache.spark.sql.types.BooleanType$;
+import org.apache.spark.sql.types.ByteType;
+import org.apache.spark.sql.types.CharType;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.DateType;
+import org.apache.spark.sql.types.DateType$;
+import org.apache.spark.sql.types.Decimal;
+import org.apache.spark.sql.types.DecimalType;
+import org.apache.spark.sql.types.DecimalType$;
+import org.apache.spark.sql.types.DoubleType;
+import org.apache.spark.sql.types.DoubleType$;
+import org.apache.spark.sql.types.FloatType;
+import org.apache.spark.sql.types.FloatType$;
+import org.apache.spark.sql.types.IntegerType;
+import org.apache.spark.sql.types.IntegerType$;
+import org.apache.spark.sql.types.LongType;
+import org.apache.spark.sql.types.LongType$;
+import org.apache.spark.sql.types.MapType;
+import org.apache.spark.sql.types.MapType$;
+import org.apache.spark.sql.types.Metadata;
+import org.apache.spark.sql.types.ShortType;
+import org.apache.spark.sql.types.StringType;
+import org.apache.spark.sql.types.StringType$;
+import org.apache.spark.sql.types.StructField;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.types.StructType$;
+import org.apache.spark.sql.types.TimestampType;
+import org.apache.spark.sql.types.TimestampType$;
+import org.apache.spark.sql.types.UserDefinedType;
+import org.apache.spark.sql.types.VarcharType;
+
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class SparkSchemaUtils {
+ private SparkSchemaUtils() {
+
+ }
+
+ public static final String HOODIE_QUERY_SCHEMA = "hadoop.hoodie.querySchema";
+ public static final String HOODIE_TABLE_PATH = "hadoop.hoodie.tablePath";
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830504050
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkSchemaUtils.java
##########
@@ -0,0 +1,499 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.client.utils;
+
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+import org.apache.spark.sql.execution.vectorized.WritableColumnVector;
+import org.apache.spark.sql.types.ArrayType;
+import org.apache.spark.sql.types.ArrayType$;
+import org.apache.spark.sql.types.BinaryType;
+import org.apache.spark.sql.types.BinaryType$;
+import org.apache.spark.sql.types.BooleanType;
+import org.apache.spark.sql.types.BooleanType$;
+import org.apache.spark.sql.types.ByteType;
+import org.apache.spark.sql.types.CharType;
+import org.apache.spark.sql.types.DataType;
+import org.apache.spark.sql.types.DateType;
+import org.apache.spark.sql.types.DateType$;
+import org.apache.spark.sql.types.Decimal;
+import org.apache.spark.sql.types.DecimalType;
+import org.apache.spark.sql.types.DecimalType$;
+import org.apache.spark.sql.types.DoubleType;
+import org.apache.spark.sql.types.DoubleType$;
+import org.apache.spark.sql.types.FloatType;
+import org.apache.spark.sql.types.FloatType$;
+import org.apache.spark.sql.types.IntegerType;
+import org.apache.spark.sql.types.IntegerType$;
+import org.apache.spark.sql.types.LongType;
+import org.apache.spark.sql.types.LongType$;
+import org.apache.spark.sql.types.MapType;
+import org.apache.spark.sql.types.MapType$;
+import org.apache.spark.sql.types.Metadata;
+import org.apache.spark.sql.types.ShortType;
+import org.apache.spark.sql.types.StringType;
+import org.apache.spark.sql.types.StringType$;
+import org.apache.spark.sql.types.StructField;
+import org.apache.spark.sql.types.StructType;
+import org.apache.spark.sql.types.StructType$;
+import org.apache.spark.sql.types.TimestampType;
+import org.apache.spark.sql.types.TimestampType$;
+import org.apache.spark.sql.types.UserDefinedType;
+import org.apache.spark.sql.types.VarcharType;
+
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class SparkSchemaUtils {
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830504199
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkMergeHelper.java
##########
@@ -77,14 +89,39 @@ public void runMerge(HoodieTable<T, JavaRDD<HoodieRecord<T>>, JavaRDD<HoodieKey>
readSchema = mergeHandle.getWriterSchemaWithMetaFields();
}
+ Option<InternalSchema> querySchemaOpt = SerDeHelper.fromJson(table.getConfig().getInternalSchema());
+ Boolean needToReWriteRecord = false;
+ // to do support bootstrap
+ if (querySchemaOpt.isPresent() && !baseFile.getBootstrapBaseFile().isPresent()) {
Review comment:
SerDeHelper.fromJson do not return dummySchema，so it's ok
let me fixed it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r830918599
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/TableInternalSchemaUtils.java
##########
@@ -0,0 +1,140 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class TableInternalSchemaUtils {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
+ HoodieTableMetaClient metaClient = HoodieTableMetaClient.builder().setBasePath(tablePath).setConf(hadoopConf).build();
+ return searchSchemaAndCache(versionID, metaClient);
+ }
+
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient) {
+ Option<InternalSchema> candidateSchema = searchSchema(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || SerDeHelper.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return SerDeHelper.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> searchSchema(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATESTSCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getActiveTimeline().filterCompletedInstants().findInstantsBefore(compactionAndClusteringInstant);
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ try {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATESTSCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ } catch (Exception e) {
+ // swallow this exception
Review comment:
this is the reason why we swallow this exception ： If we has not done some DDL, load internalSchema will failed, schema evolution should not affect the main process of current compaction.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1073743737
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8a4ef3a507ee3b4483c409e5a3af76eb0c421e40 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095)
* def92ac982683bbef7ec8ecac85ea1bf97e24e2c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r831350807
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/SchemaChangePersistHelper.java
##########
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.action.TableChange;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.action.TableChangesHelper;
+
+import java.util.Arrays;
+
+public class SchemaChangePersistHelper {
Review comment:
i only extract InternalSchemaChangeApplier to mange the schema change for HoodieWriteClient.
since SchemaChangeUtils.class is also used by sparkSQL, i think we may no need to rewrite this class.
of course, if you have diff idea, i will changed it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1074306329
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1074498636
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
bvaradar commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r831639028
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/TableInternalSchemaUtils.java
##########
@@ -0,0 +1,140 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
+
+import org.apache.hadoop.conf.Configuration;
+import org.apache.hudi.common.model.HoodieCommitMetadata;
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.exception.HoodieException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.io.FileBasedInternalSchemaStorageManager;
+import org.apache.hudi.internal.schema.utils.SerDeHelper;
+
+import java.util.List;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class TableInternalSchemaUtils {
+ // use segment lock to reduce competition.
+ // the lock size should be powers of 2 for better hash.
+ private static Object[] lockList = new Object[16];
+
+ static {
+ for (int i = 0; i < lockList.length; i++) {
+ lockList[i] = new Object();
+ }
+ }
+
+ // historySchemas cache maintain a map about (tablePath, HistorySchemas).
+ // this is a Global cache, all threads in one container/executor share the same cache.
+ private static final Cache<String, TreeMap<Long, InternalSchema>>
+ HISTORICAL_SCHEMA_CACHE = Caffeine.newBuilder().maximumSize(1000).weakValues().build();
+
+ /**
+ * search internalSchema based on versionID.
+ * first step: try to get internalSchema from hoodie commit files, we no need to add lock.
+ * if we cannot get internalSchema by first step, then we try to get internalSchema from cache.
+ *
+ * @param versionID schema version_id need to search
+ * @param tablePath current hoodie table base path
+ * @param hadoopConf hadoopConf
+ * @return internalSchema
+ */
+ public static InternalSchema searchSchemaAndCache(long versionID, String tablePath, Configuration hadoopConf) {
+ HoodieTableMetaClient metaClient = HoodieTableMetaClient.builder().setBasePath(tablePath).setConf(hadoopConf).build();
+ return searchSchemaAndCache(versionID, metaClient);
+ }
+
+ public static InternalSchema searchSchemaAndCache(long versionID, HoodieTableMetaClient metaClient) {
+ Option<InternalSchema> candidateSchema = searchSchema(versionID, metaClient);
+ if (candidateSchema.isPresent()) {
+ return candidateSchema.get();
+ }
+ String tablePath = metaClient.getBasePath();
+ // use segment lock to reduce competition.
+ synchronized (lockList[tablePath.hashCode() & (lockList.length - 1)]) {
+ TreeMap<Long, InternalSchema> historicalSchemas = HISTORICAL_SCHEMA_CACHE.getIfPresent(tablePath);
+ if (historicalSchemas == null || SerDeHelper.searchSchema(versionID, historicalSchemas) == null) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ } else {
+ long maxVersionId = historicalSchemas.keySet().stream().max(Long::compareTo).get();
+ if (versionID > maxVersionId) {
+ historicalSchemas = getHistoricalSchemas(metaClient);
+ HISTORICAL_SCHEMA_CACHE.put(tablePath, historicalSchemas);
+ }
+ }
+ return SerDeHelper.searchSchema(versionID, historicalSchemas);
+ }
+ }
+
+ private static TreeMap<Long, InternalSchema> getHistoricalSchemas(HoodieTableMetaClient metaClient) {
+ TreeMap<Long, InternalSchema> result = new TreeMap<>();
+ FileBasedInternalSchemaStorageManager schemasManager = new FileBasedInternalSchemaStorageManager(metaClient);
+ String historySchemaStr = schemasManager.getHistorySchemaStr();
+ if (!StringUtils.isNullOrEmpty(historySchemaStr)) {
+ result = SerDeHelper.parseSchemas(historySchemaStr);
+ }
+ return result;
+ }
+
+ private static Option<InternalSchema> searchSchema(long versionID, HoodieTableMetaClient metaClient) {
+ try {
+ HoodieTimeline timeline = metaClient.getActiveTimeline().getCommitsTimeline().filterCompletedInstants();
+ List<HoodieInstant> instants = timeline.getInstants().filter(f -> f.getTimestamp().equals(String.valueOf(versionID))).collect(Collectors.toList());
+ if (instants.isEmpty()) {
+ return Option.empty();
+ }
+ byte[] data = timeline.getInstantDetails(instants.get(0)).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String latestInternalSchemaStr = metadata.getMetadata(SerDeHelper.LATESTSCHEMA);
+ return SerDeHelper.fromJson(latestInternalSchemaStr);
+ } catch (Exception e) {
+ throw new HoodieException("Failed to read schema from commit metadata", e);
+ }
+ }
+
+ public static Pair<Option<String>, Option<String>> getInternalSchemaAndAvroSchemaForClusteringAndCompaction(HoodieTableMetaClient metaClient, String compactionAndClusteringInstant) {
+ // try to load internalSchema to support Schema Evolution
+ HoodieTimeline timelineBeforeCurrentCompaction = metaClient.getActiveTimeline().filterCompletedInstants().findInstantsBefore(compactionAndClusteringInstant);
+ Option<HoodieInstant> lastInstantBeforeCurrentCompaction = timelineBeforeCurrentCompaction.lastInstant();
+ if (lastInstantBeforeCurrentCompaction.isPresent()) {
+ try {
+ // try to find internalSchema
+ byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();
+ HoodieCommitMetadata metadata = HoodieCommitMetadata.fromBytes(data, HoodieCommitMetadata.class);
+ String internalSchemaStr = metadata.getMetadata(SerDeHelper.LATESTSCHEMA);
+ if (internalSchemaStr != null) {
+ String existingSchemaStr = metadata.getMetadata(HoodieCommitMetadata.SCHEMA_KEY);
+ return Pair.of(Option.of(internalSchemaStr), Option.of(existingSchemaStr));
+ }
+ } catch (Exception e) {
+ // swallow this exception
Review comment:
hmmm, Shouldn't we be using empty schema in that case ? Can we make sure exception is thrown only during an error scenario in the first place.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1074566059
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* 8b468258eb102a5ff0accbb3431785a705f92eb4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1080099081
>
yes, let me addressed in another comments.
now focus on the questions: One specific question: For an existing table (0.10.1 or prior), Specifically, hoodie.metadata.enable is a writer side config. Readers (Query Engines) will only get to look at evolved schema when they exist as valid schema files. This is what I understood. Is this correct?
1）First of all, this PR does not affect the normal use of metatable. The current version of metaable is turned on by default. The test case in spark3DDL also proves that this PR and metatable can coexist normally.
2) yes, query engine only get to look at evolved schema when they exist as valid schema files.
**It must be noted that once schema evolution is enabled, it cannot be closed**,
Otherwise, if the internal schema cannot be found, the engine will directly fall back to the original logic of Hudi, which may lead to data reading failure
Eg: current schema: ID: string, name: int. now we use schema evolution to change it to ID: decimal, name: string
if we delete internalSchema， query engine will fall back to origin read， Obviously, Hudi can't read such data
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079469064
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079590948
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
* b61ba72e253a02c3176b1687eba89a22024b580b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079019848
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276)
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r835264913
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java
##########
@@ -0,0 +1,436 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import static org.apache.avro.Schema.Type.UNION;
+
+import org.apache.avro.AvroRuntimeException;
+import org.apache.avro.Conversions;
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.avro.SchemaCompatibility;
+import org.apache.avro.generic.GenericData;
+import org.apache.avro.generic.GenericFixed;
+import org.apache.avro.generic.GenericRecord;
+import org.apache.avro.generic.IndexedRecord;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.action.TableChanges;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+
+import java.math.BigDecimal;
+import java.math.BigInteger;
+import java.nio.charset.StandardCharsets;
+import java.sql.Date;
+import java.util.ArrayList;
+import java.util.Collection;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.Iterator;
+import java.util.List;
+import java.util.Map;
+import java.util.TimeZone;
+import java.util.TreeMap;
+import java.util.stream.Collectors;
+
+public class AvroSchemaUtil {
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079082718
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* c266a8e2797ef8ae829d6e14860c5a1091a933bb Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370)
* 544b64a34f4ba19ef742e606e23d8986284be43f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373)
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079591680
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* 2d71e26114bb0377a3be769cd851374217c1a70c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375)
* b61ba72e253a02c3176b1687eba89a22024b580b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r820527386
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/Types.java
##########
@@ -0,0 +1,716 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.internal.schema.Type.PrimitiveType;
+import org.apache.hudi.internal.schema.Type.NestedType;
+
+import java.io.Serializable;
+import java.util.Arrays;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Objects;
+import java.util.stream.Collectors;
+
+public class Types {
+ private Types() {
+ }
+
+ public static class BooleanType extends PrimitiveType {
+ private static final BooleanType INSTANCE = new BooleanType();
+
+ public static BooleanType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return Type.TypeID.BOOLEAN;
+ }
+
+ @Override
+ public String toString() {
+ return "boolean";
+ }
+ }
+
+ public static class IntType extends PrimitiveType {
+ private static final IntType INSTANCE = new IntType();
+
+ public static IntType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.INT;
+ }
+
+ @Override
+ public String toString() {
+ return "int";
+ }
+ }
+
+ public static class LongType extends PrimitiveType {
+ private static final LongType INSTANCE = new LongType();
+
+ public static LongType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.LONG;
+ }
+
+ @Override
+ public String toString() {
+ return "long";
+ }
+ }
+
+ public static class FloatType extends PrimitiveType {
+ private static final FloatType INSTANCE = new FloatType();
+
+ public static FloatType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.FLOAT;
+ }
+
+ @Override
+ public String toString() {
+ return "float";
+ }
+ }
+
+ public static class DoubleType extends PrimitiveType {
+ private static final DoubleType INSTANCE = new DoubleType();
+
+ public static DoubleType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.DOUBLE;
+ }
+
+ @Override
+ public String toString() {
+ return "double";
+ }
+ }
+
+ public static class DateType extends PrimitiveType {
+ private static final DateType INSTANCE = new DateType();
+
+ public static DateType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.DATE;
+ }
+
+ @Override
+ public String toString() {
+ return "date";
+ }
+ }
+
+ public static class TimeType extends PrimitiveType {
+ private static final TimeType INSTANCE = new TimeType();
+
+ public static TimeType get() {
+ return INSTANCE;
+ }
+
+ private TimeType() {
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.TIME;
+ }
+
+ @Override
+ public String toString() {
+ return "time";
+ }
+ }
+
+ public static class TimestampType extends PrimitiveType {
+ private static final TimestampType INSTANCE = new TimestampType();
+
+ public static TimestampType get() {
+ return INSTANCE;
+ }
+
+ private TimestampType() {
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.TIMESTAMP;
+ }
+
+ @Override
+ public String toString() {
+ return "timestamp";
+ }
+ }
+
+ public static class StringType extends PrimitiveType {
+ private static final StringType INSTANCE = new StringType();
+
+ public static StringType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.STRING;
+ }
+
+ @Override
+ public String toString() {
+ return "string";
+ }
+ }
+
+ public static class BinaryType extends PrimitiveType {
+ private static final BinaryType INSTANCE = new BinaryType();
+
+ public static BinaryType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.BINARY;
+ }
+
+ @Override
+ public String toString() {
+ return "binary";
+ }
+ }
+
+ public static class FixedType extends PrimitiveType {
+ public static FixedType getFixed(int size) {
+ return new FixedType(size);
+ }
+
+ private final int size;
+
+ private FixedType(int length) {
+ this.size = length;
+ }
+
+ public int getFixedSize() {
+ return size;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.FIXED;
+ }
+
+ @Override
+ public String toString() {
+ return String.format("fixed[%d]", size);
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o) {
+ return true;
+ } else if (!(o instanceof FixedType)) {
+ return false;
+ }
+
+ FixedType fixedType = (FixedType) o;
+ return size == fixedType.size;
+ }
+
+ @Override
+ public int hashCode() {
+ return Objects.hash(FixedType.class, size);
+ }
+ }
+
+ public static class DecimalType extends PrimitiveType {
+ public static DecimalType get(int precision, int scale) {
+ return new DecimalType(precision, scale);
+ }
+
+ private final int scale;
+ private final int precision;
+
+ private DecimalType(int precision, int scale) {
+ this.scale = scale;
+ this.precision = precision;
+ }
+
+ /**
+ * Returns whether this DecimalType is wider than `other`. If yes, it means `other`
+ * can be casted into `this` safely without losing any precision or range.
+ */
+ public boolean isWiderThan(PrimitiveType other) {
+ if (other instanceof DecimalType) {
+ DecimalType dt = (DecimalType) other;
+ return (precision - scale) >= (dt.precision - dt.scale) && scale > dt.scale;
+ }
+ if (other instanceof IntType) {
+ return isWiderThan(get(10, 0));
+ }
+ return false;
+ }
+
+ /**
+ * Returns whether this DecimalType is tighter than `other`. If yes, it means `this`
+ * can be casted into `other` safely without losing any precision or range.
+ */
+ public boolean isTighterThan(PrimitiveType other) {
+ if (other instanceof DecimalType) {
+ DecimalType dt = (DecimalType) other;
+ return (precision - scale) <= (dt.precision - dt.scale) && scale <= dt.scale;
+ }
+ if (other instanceof IntType) {
+ return isTighterThan(get(10, 0));
+ }
+ return false;
+ }
+
+ public int scale() {
+ return scale;
+ }
+
+ public int precision() {
+ return precision;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.DECIMAL;
+ }
+
+ @Override
+ public String toString() {
+ return String.format("decimal(%d, %d)", precision, scale);
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o) {
+ return true;
+ } else if (!(o instanceof DecimalType)) {
+ return false;
+ }
+
+ DecimalType that = (DecimalType) o;
+ if (scale != that.scale) {
+ return false;
+ }
+ return precision == that.precision;
+ }
+
+ @Override
+ public int hashCode() {
+ return Objects.hash(DecimalType.class, scale, precision);
+ }
+ }
+
+ public static class UUIDType extends PrimitiveType {
+ private static final UUIDType INSTANCE = new UUIDType();
+
+ public static UUIDType get() {
+ return INSTANCE;
+ }
+
+ @Override
+ public TypeID typeId() {
+ return TypeID.UUID;
+ }
+
+ @Override
+ public String toString() {
+ return "uuid";
+ }
+ }
+
+ /** A field within a record. */
+ public static class Field implements Serializable {
+ // Experimental method to support defaultValue
+ public static Field get(int id, boolean isOptional, String name, Type type, String doc, Object defaultValue) {
+ return new Field(isOptional, id, name, type, doc, defaultValue);
+ }
+
+ public static Field get(int id, boolean isOptional, String name, Type type, String doc) {
+ return new Field(isOptional, id, name, type, doc, null);
+ }
+
+ public static Field get(int id, boolean isOptional, String name, Type type) {
+ return new Field(isOptional, id, name, type, null, null);
+ }
+
+ public static Field get(int id, String name, Type type) {
+ return new Field(true, id, name, type, null, null);
+ }
+
+ private final boolean isOptional;
+ private final int id;
+ private final String name;
+ private final Type type;
+ private final String doc;
+ // Experimental properties
+ private final Object defaultValue;
+
+ private Field(boolean isOptional, int id, String name, Type type, String doc, Object defaultValue) {
+ this.isOptional = isOptional;
+ this.id = id;
+ this.name = name;
+ this.type = type;
+ this.doc = doc;
+ this.defaultValue = defaultValue;
+ }
+
+ public Object getDefaultValue() {
+ return defaultValue;
+ }
+
+ public boolean isOptional() {
+ return isOptional;
+ }
+
+ public int fieldId() {
+ return id;
+ }
+
+ public String name() {
+ return name;
+ }
+
+ public Type type() {
+ return type;
+ }
+
+ public String doc() {
+ return doc;
+ }
+
+ @Override
+ public String toString() {
+ return String.format("%d: %s: %s %s",
+ id, name, isOptional ? "optional" : "required", type) + (doc != null ? " (" + doc + ")" : "");
+ }
+
+ @Override
+ public boolean equals(Object o) {
+ if (this == o) {
+ return true;
+ } else if (!(o instanceof Field)) {
+ return false;
+ }
+
+ Field that = (Field) o;
+ if (isOptional != that.isOptional) {
+ return false;
+ } else if (id != that.id) {
+ return false;
+ } else if (!name.equals(that.name)) {
+ return false;
+ } else if (!Objects.equals(doc, that.doc)) {
+ return false;
+ }
+ return type.equals(that.type);
+ }
+
+ @Override
+ public int hashCode() {
+ return Objects.hash(Field.class, id, isOptional, name, type);
+ }
+ }
+
+ public static class RecordType extends NestedType {
+
+ public static RecordType get(List<Field> fields) {
+ return new RecordType(fields);
+ }
+
+ public static RecordType get(Field... fields) {
+ return new RecordType(Arrays.asList(fields));
+ }
+
+ private final Field[] fields;
+
+ private transient Map<String, Field> nameToFields = null;
+ private transient Map<Integer, Field> idToFields = null;
+
+ private RecordType(List<Field> fields) {
+ this.fields = new Field[fields.size()];
+ for (int i = 0; i < this.fields.length; i += 1) {
+ this.fields[i] = fields.get(i);
+ }
Review comment:
can we initialize `nameToFields` and `idToFields` here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] YannByron commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
YannByron commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r820538275
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/InternalSchema.java
##########
@@ -0,0 +1,292 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema;
+
+import org.apache.hudi.common.util.StringUtils;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.utils.InternalSchemaUtils;
+
+import java.io.Serializable;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Comparator;
+import java.util.List;
+import java.util.Locale;
+import java.util.Map;
+import java.util.Set;
+import java.util.stream.Collectors;
+
+/**
+ * Internal schema for hudi table.
+ * used to support schema evolution.
+ */
+public class InternalSchema implements Serializable {
+
+ private static final long DEFAULT_VERSION_ID = 0;
+
+ private final RecordType record;
+
+ private int maxColumnId;
+ private long versionId;
+
+ private transient Map<Integer, Field> idToField = null;
+ private transient Map<String, Integer> nameToId = null;
+ private transient Map<Integer, String> idToName = null;
+
+ public static InternalSchema getDummyInternalSchema() {
+ return new InternalSchema(-1L, new ArrayList<>());
+ }
+
+ public boolean isDummySchema() {
+ return versionId < 0;
+ }
+
+ public InternalSchema(List<Field> columns) {
+ this(DEFAULT_VERSION_ID, columns);
+ }
+
+ public InternalSchema(Field... columns) {
+ this(DEFAULT_VERSION_ID, Arrays.asList(columns));
+ }
+
+ public InternalSchema(long versionId, List<Field> cols) {
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ if (versionId >= 0) {
+ buildIdToName();
+ maxColumnId = idToName.keySet().stream().max(Comparator.comparing(Integer::valueOf)).get();
+ }
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, List<Field> cols) {
+ this.maxColumnId = maxColumnId;
+ this.versionId = versionId;
+ this.record = RecordType.get(cols);
+ buildIdToName();
+ }
+
+ public InternalSchema(long versionId, int maxColumnId, Field... cols) {
+ this(versionId, maxColumnId, Arrays.asList(cols));
+ }
+
+ public RecordType getRecord() {
+ return record;
+ }
+
+ private Map<Integer, String> buildIdToName() {
+ if (idToName == null) {
+ idToName = InternalSchemaUtils.buildIdToName(record);
+ }
+ return idToName;
+ }
+
+ private Map<String, Integer> buildNameToId() {
+ if (nameToId == null) {
+ if (idToName != null && !idToName.isEmpty()) {
+ nameToId = idToName.entrySet().stream().collect(Collectors.toMap(Map.Entry::getValue, Map.Entry::getKey));
+ return nameToId;
+ }
+ nameToId = InternalSchemaUtils.buildNameToId(record);
Review comment:
Both `nameToId ` and `idToName` must be empty or not empty at the same time. Here, maybe not. So init both inside of the construct method above.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085678313
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* 1f3a776922f8821917ee08adc51c097f3606fabc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674)
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682)
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1085848424
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
}, {
"hash" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9cc545cf661d7e3adc886ef70542e37426eee0d",
"triggerType" : "PUSH"
}, {
"hash" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4096466ae627f1c4ca46cae8899507c801e71d1f",
"triggerType" : "PUSH"
}, {
"hash" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "222bf09f67a09c3e30d57796cf435e9a2c594831",
"triggerType" : "PUSH"
}, {
"hash" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7370",
"triggerID" : "c266a8e2797ef8ae829d6e14860c5a1091a933bb",
"triggerType" : "PUSH"
}, {
"hash" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7373",
"triggerID" : "544b64a34f4ba19ef742e606e23d8986284be43f",
"triggerType" : "PUSH"
}, {
"hash" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ce6743ba070142bde59f8eaac5b911e6339c2212",
"triggerType" : "PUSH"
}, {
"hash" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ff8b85d83908184608cb59e67fb9236fcad26ea",
"triggerType" : "PUSH"
}, {
"hash" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7375",
"triggerID" : "2d71e26114bb0377a3be769cd851374217c1a70c",
"triggerType" : "PUSH"
}, {
"hash" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7389",
"triggerID" : "b61ba72e253a02c3176b1687eba89a22024b580b",
"triggerType" : "PUSH"
}, {
"hash" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7392",
"triggerID" : "5357ce8bff9b47bfe50816b178c267efed1d3b0e",
"triggerType" : "PUSH"
}, {
"hash" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7507",
"triggerID" : "a0f87c83ccb0239ca0b21dabcbc5771b56ccf9c7",
"triggerType" : "PUSH"
}, {
"hash" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7509",
"triggerID" : "aeaa837dd208456b9bb0ad07f1675f7d9ea1c175",
"triggerType" : "PUSH"
}, {
"hash" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b3d94a15f601a19a94beda555618eb8e5ea66e33",
"triggerType" : "PUSH"
}, {
"hash" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7537",
"triggerID" : "ccb5902d740a98ce9cbcbb09a26e344400a3cc17",
"triggerType" : "PUSH"
}, {
"hash" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7c80ff0e9ca20acc155b1ea631df9e5efe828adf",
"triggerType" : "PUSH"
}, {
"hash" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7541",
"triggerID" : "54f7f1cbb353fa5a14b1d0c97dde3cb5c7f48f38",
"triggerType" : "PUSH"
}, {
"hash" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7612",
"triggerID" : "5c147a6a52c3f118a154c9b36c09b9f245dd20e2",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"triggerType" : "PUSH"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7631",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7616",
"triggerID" : "1084325330",
"triggerType" : "MANUAL"
}, {
"hash" : "54aa92b9ddba8d567ea3b593700601460bb6ea53",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7634",
"triggerID" : "1084414042",
"triggerType" : "MANUAL"
}, {
"hash" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7674",
"triggerID" : "1f3a776922f8821917ee08adc51c097f3606fabc",
"triggerType" : "PUSH"
}, {
"hash" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d41e11819770e6a1ba1bd7331ac6e70dc59832d8",
"triggerType" : "PUSH"
}, {
"hash" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682",
"triggerID" : "c5329f90cfe00e70dc41c6be161a4c9d83af7bd3",
"triggerType" : "PUSH"
}, {
"hash" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6d510190d2ea85c09e15b8c2cce39cce7c1d06ad",
"triggerType" : "PUSH"
}, {
"hash" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690",
"triggerID" : "929adaa89a13ba028801aaa49fdd41cb99594f96",
"triggerType" : "PUSH"
}, {
"hash" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f431089820ddea16d41400b3dbdf4896ccfdf955",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* d9cc545cf661d7e3adc886ef70542e37426eee0d UNKNOWN
* 4096466ae627f1c4ca46cae8899507c801e71d1f UNKNOWN
* 222bf09f67a09c3e30d57796cf435e9a2c594831 UNKNOWN
* ce6743ba070142bde59f8eaac5b911e6339c2212 UNKNOWN
* 7ff8b85d83908184608cb59e67fb9236fcad26ea UNKNOWN
* b3d94a15f601a19a94beda555618eb8e5ea66e33 UNKNOWN
* 7c80ff0e9ca20acc155b1ea631df9e5efe828adf UNKNOWN
* d41e11819770e6a1ba1bd7331ac6e70dc59832d8 UNKNOWN
* c5329f90cfe00e70dc41c6be161a4c9d83af7bd3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7682)
* 6d510190d2ea85c09e15b8c2cce39cce7c1d06ad UNKNOWN
* 929adaa89a13ba028801aaa49fdd41cb99594f96 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7690)
* f431089820ddea16d41400b3dbdf4896ccfdf955 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840183964
##########
File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieDataSourceHelper.scala
##########
@@ -78,4 +81,11 @@ object HoodieDataSourceHelper extends PredicateHelper {
}
}
+ def getConfigurationForInternalSchema(conf: Configuration, internalSchema: InternalSchema, tablePath: String, validCommits: String): Configuration = {
Review comment:
agree
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao closed pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao closed pull request #4910:
URL: https://github.com/apache/hudi/pull/4910
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840410219
##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java
##########
@@ -588,6 +589,9 @@ public void archive(HoodieEngineContext context, List<HoodieInstant> instants) t
}
}
writeToFile(wrapperSchema, records);
+ // try to clean old history schema.
+ FileBasedInternalSchemaStorageManager fss = new FileBasedInternalSchemaStorageManager(metaClient);
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r840410660
##########
File path: pom.xml
##########
@@ -127,6 +127,8 @@
<flink.runtime.artifactId>flink-runtime</flink.runtime.artifactId>
<flink.table.runtime.artifactId>flink-table-runtime_${scala.binary.version}</flink.table.runtime.artifactId>
<flink.table.planner.artifactId>flink-table-planner_${scala.binary.version}</flink.table.planner.artifactId>
+ <spark31.version>3.1.2</spark31.version>
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on a change in pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#discussion_r831348169
##########
File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/InternalSchemaUtils.java
##########
@@ -0,0 +1,856 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.internal.schema.utils;
+
+import org.apache.avro.JsonProperties;
+import org.apache.avro.LogicalType;
+import org.apache.avro.LogicalTypes;
+import org.apache.avro.Schema;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.internal.schema.HoodieSchemaException;
+import org.apache.hudi.internal.schema.InternalSchema;
+import org.apache.hudi.internal.schema.Type;
+import org.apache.hudi.internal.schema.Types;
+import org.apache.hudi.internal.schema.Types.Field;
+import org.apache.hudi.internal.schema.Types.RecordType;
+import org.apache.hudi.internal.schema.action.InternalSchemaMerger;
+import org.apache.hudi.internal.schema.convert.AvroInternalSchemaConverter;
+import org.apache.hudi.internal.schema.visitor.InternalSchemaVisitor;
+import org.apache.hudi.internal.schema.visitor.NameToIDVisitor;
+
+import java.util.ArrayList;
+import java.util.Deque;
+import java.util.HashMap;
+import java.util.LinkedList;
+import java.util.List;
+import java.util.Map;
+import java.util.Set;
+import java.util.concurrent.atomic.AtomicInteger;
+import java.util.stream.Collectors;
+
+public class InternalSchemaUtils {
Review comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1075912859
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* f63e59e2924ada773f25904ebb90775c1d475c06 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184)
* 35845665ddbfb2c176c80ddbe30404422f01cfac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077383545
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6312",
"triggerID" : "9c09a928506e41a69dd5e48f1cc2f7815216db1e",
"triggerType" : "PUSH"
}, {
"hash" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6316",
"triggerID" : "4e04e2076296e16e1b5b60b510ed85d536873a93",
"triggerType" : "PUSH"
}, {
"hash" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6340",
"triggerID" : "e909b66fb05a4cdad405b144b041554f45664d3e",
"triggerType" : "PUSH"
}, {
"hash" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6342",
"triggerID" : "6ba1413ff8b09ec39ec823ae2e3816cd217df553",
"triggerType" : "PUSH"
}, {
"hash" : "758d417cc8f02537d8174f19c904c062b0873646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6343",
"triggerID" : "758d417cc8f02537d8174f19c904c062b0873646",
"triggerType" : "PUSH"
}, {
"hash" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6347",
"triggerID" : "2685177494a54601e91a21d849d2ffd6e284f4ba",
"triggerType" : "PUSH"
}, {
"hash" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52be34d7d5e025180415c46e64a3e2145c29e498",
"triggerType" : "PUSH"
}, {
"hash" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6348",
"triggerID" : "e6fb8cba2ee5c9129d6ed88ff3cf137e600cb14d",
"triggerType" : "PUSH"
}, {
"hash" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "78e86dd1953cc4d6bf10ca808a7bcffe22b4b587",
"triggerType" : "PUSH"
}, {
"hash" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6355",
"triggerID" : "4ff0d57275e8f907d945c60bd93c2bef227c7c3d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6380",
"triggerID" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"triggerType" : "PUSH"
}, {
"hash" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fa9cee18b16f1b11ed039a9da3c490f017775e8d",
"triggerType" : "PUSH"
}, {
"hash" : "cb8c6f4233cb1bac50aa67de4145df8458499f6d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6507",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"triggerType" : "PUSH"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6509",
"triggerID" : "1057988594",
"triggerType" : "MANUAL"
}, {
"hash" : "059686f6b26f16b4ce1e9def3087f8b7d860a778",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6535",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "3c293b72b3f4a11272f658a4be941028834c937f",
"triggerType" : "PUSH"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6536",
"triggerID" : "1058912634",
"triggerType" : "MANUAL"
}, {
"hash" : "3c293b72b3f4a11272f658a4be941028834c937f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6591",
"triggerID" : "1059912525",
"triggerType" : "MANUAL"
}, {
"hash" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7093",
"triggerID" : "066450fb1940cc6640afc0911e5416c1a827ba67",
"triggerType" : "PUSH"
}, {
"hash" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7094",
"triggerID" : "9fc0b7d6bde89a857aaa98e8b322b9854ff5279f",
"triggerType" : "PUSH"
}, {
"hash" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "60d9cf848b623c27078e1d0b9db329eb8f4cec94",
"triggerType" : "PUSH"
}, {
"hash" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9729597c54733bc6518b14418bdbe1cf7febb80b",
"triggerType" : "PUSH"
}, {
"hash" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a543ce26adebe58f6f0954a54524a4cb393c0a0c",
"triggerType" : "PUSH"
}, {
"hash" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7095",
"triggerID" : "8a4ef3a507ee3b4483c409e5a3af76eb0c421e40",
"triggerType" : "PUSH"
}, {
"hash" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7127",
"triggerID" : "def92ac982683bbef7ec8ecac85ea1bf97e24e2c",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7139",
"triggerID" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"triggerType" : "PUSH"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7145",
"triggerID" : "1074498225",
"triggerType" : "MANUAL"
}, {
"hash" : "8b468258eb102a5ff0accbb3431785a705f92eb4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7152",
"triggerID" : "1074565855",
"triggerType" : "MANUAL"
}, {
"hash" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f7a1729d2a9529f03b1f3d259b1b1ba4920f137e",
"triggerType" : "PUSH"
}, {
"hash" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7184",
"triggerID" : "f63e59e2924ada773f25904ebb90775c1d475c06",
"triggerType" : "PUSH"
}, {
"hash" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7216",
"triggerID" : "35845665ddbfb2c176c80ddbe30404422f01cfac",
"triggerType" : "PUSH"
}, {
"hash" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1816108f1144b1c918988022fc7147fbe7bb8f9d",
"triggerType" : "PUSH"
}, {
"hash" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "85cc0c336425a2b1c70694a5f4222c63f98fc3e5",
"triggerType" : "PUSH"
}, {
"hash" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7231",
"triggerID" : "d16fb4953f49ca231f49247924760cbb7a3efcb6",
"triggerType" : "PUSH"
}, {
"hash" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c41514d513eb6adc831ea580d48a65fd77f49da6",
"triggerType" : "PUSH"
}, {
"hash" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7237",
"triggerID" : "b52e9b156c672288291ba319c822dabf98a55e3a",
"triggerType" : "PUSH"
}, {
"hash" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "52b0671b08edd5d21053b4210e9001e11a7cca01",
"triggerType" : "PUSH"
}, {
"hash" : "1c95fe08a4c7e03188a98c531817294555d41505",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7250",
"triggerID" : "1c95fe08a4c7e03188a98c531817294555d41505",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263",
"triggerID" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"triggerType" : "PUSH"
}, {
"hash" : "da322a449f6bba3177dc7fb95800eb67bbd3a27b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276",
"triggerID" : "1077382443",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN
* 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN
* fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN
* 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN
* 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN
* a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN
* f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN
* 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN
* 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN
* c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN
* 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN
* da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
Posted by GitBox <gi...@apache.org>.
xiarixiaoyao commented on pull request #4910:
URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084032214
> @xiarixiaoyao : while you are fixing the integ-test bundle that @nsivabalan pointed out, can you rename the variables we are using to lookup schema to be instantTime consistently. (there are places (for eg: AbstractHoodieLogRecordReader.java) where are using names like "currentTime"). Thanks. We should use the name instant to represent HoodieInstant and instantTime to represent the string representation of the time referred by HoodieInstant)
sorry for later， let me fixed those problem。 thanks very much
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org