You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/07/27 17:48:52 UTC
[GitHub] [hudi] alexeykudinkin opened a new pull request, #6227: [WIP] Expanding tests run against all Spark versions
alexeykudinkin opened a new pull request, #6227:
URL: https://github.com/apache/hudi/pull/6227
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
*(For example: This pull request adds quick-start document.)*
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1205448056
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510)
* cb79510068baa4769fe6496867c1e26754502f40 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1292846461
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
}, {
"hash" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"triggerType" : "PUSH"
}, {
"hash" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540",
"triggerID" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"triggerType" : "PUSH"
}, {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0 UNKNOWN
* 897aac606d8f112dab9e01e59b2271c5ecb5f9a4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201536420
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4afc010560157d3dc0e92396e23e6fa194094913 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1005945009
##########
pom.xml:
##########
@@ -1728,6 +1736,9 @@
<hudi.spark.common.module>hudi-spark3-common</hudi.spark.common.module>
<scalatest.version>${scalatest.spark3.version}</scalatest.version>
<kafka.version>${kafka.spark3.version}</kafka.version>
+ <parquet.version>1.10.1</parquet.version>
Review Comment:
this is the default version. but it's good to explicitly state it to keep in sync with spark
##########
packaging/hudi-flink-bundle/pom.xml:
##########
@@ -639,7 +639,6 @@
<groupId>org.apache.orc</groupId>
<artifactId>orc-core</artifactId>
<version>${orc.version}</version>
- <classifier>nohive</classifier>
Review Comment:
looks like flink bundle does not shade orc. this change may impact on flink usage. let's have this change and shading in a separate PR?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1287564769
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 454cd1dc4e04aadfb8836553a45e201dc9abb8dc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405)
* b236a680cc0abd5b1583c09570002bad77d9ad6f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1287565916
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 454cd1dc4e04aadfb8836553a45e201dc9abb8dc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405)
* b236a680cc0abd5b1583c09570002bad77d9ad6f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1286264362
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cb79510068baa4769fe6496867c1e26754502f40 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588)
* 4a6c6a488d8ff2307833653d5f45df7ff0247ad3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1289805300
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
}, {
"hash" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"triggerType" : "PUSH"
}, {
"hash" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540",
"triggerID" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2ff9e3c52bc858b1ba1258988d70a06996fe6ae6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519)
* 05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0 UNKNOWN
* 456474d875da7bbb33b0a2a0b9ca38f3c52b04fc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1312321252
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
}, {
"hash" : "5e0784bd73612d73d100152d6a5aeec7ddddc11c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12965",
"triggerID" : "5e0784bd73612d73d100152d6a5aeec7ddddc11c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5e0784bd73612d73d100152d6a5aeec7ddddc11c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12965)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201618307
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 282b11763f8fc892685a84fc136e59b564ec988e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1199966546
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 745c015e848fde5d7a78c21e828af97705efa0d0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1200042181
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 745c015e848fde5d7a78c21e828af97705efa0d0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463)
* c771a314e72284d22cd682a48eb0013aaf09b3cb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201466111
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c771a314e72284d22cd682a48eb0013aaf09b3cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466)
* 4afc010560157d3dc0e92396e23e6fa194094913 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1312239697
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
}, {
"hash" : "5e0784bd73612d73d100152d6a5aeec7ddddc11c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12965",
"triggerID" : "5e0784bd73612d73d100152d6a5aeec7ddddc11c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 897aac606d8f112dab9e01e59b2271c5ecb5f9a4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605)
* 5e0784bd73612d73d100152d6a5aeec7ddddc11c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12965)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan merged pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
xushiyan merged PR #6227:
URL: https://github.com/apache/hudi/pull/6227
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201546583
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4afc010560157d3dc0e92396e23e6fa194094913 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504)
* 282b11763f8fc892685a84fc136e59b564ec988e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201470927
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c771a314e72284d22cd682a48eb0013aaf09b3cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466)
* 4afc010560157d3dc0e92396e23e6fa194094913 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
codope commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r938462895
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala:
##########
@@ -223,6 +215,20 @@ private[sql] class AvroSerializer(
val numFields = st.length
(getter, ordinal) => structConverter(getter.getStruct(ordinal, numFields))
+ ////////////////////////////////////////////////////////////////////////////////////////////
+ // Following section is amended to the original (Spark's) implementation
+ // >>> BEGINS
+ ////////////////////////////////////////////////////////////////////////////////////////////
+
+ case (st: StructType, UNION) =>
Review Comment:
Very good point! Sounds good. Let's make sure that the annotation is common across code, easily searchable. Probably, we should put this in coding guidelines as well? https://hudi.apache.org/contribute/developer-setup#coding-guidelines
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1289797044
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
}, {
"hash" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2ff9e3c52bc858b1ba1258988d70a06996fe6ae6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519)
* 05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1200043467
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 745c015e848fde5d7a78c21e828af97705efa0d0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463)
* c771a314e72284d22cd682a48eb0013aaf09b3cb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1292403187
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
}, {
"hash" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"triggerType" : "PUSH"
}, {
"hash" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540",
"triggerID" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"triggerType" : "PUSH"
}, {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0 UNKNOWN
* 456474d875da7bbb33b0a2a0b9ca38f3c52b04fc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540)
* 897aac606d8f112dab9e01e59b2271c5ecb5f9a4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1006577226
##########
packaging/hudi-flink-bundle/pom.xml:
##########
@@ -639,7 +639,6 @@
<groupId>org.apache.orc</groupId>
<artifactId>orc-core</artifactId>
<version>${orc.version}</version>
- <classifier>nohive</classifier>
Review Comment:
understood. we're aligned then. also the orc version we use with flink bundle should align with flink's orc versions under flink profiles. we may have to use a separate version property like `orc.flink.version` vs `orc.spark.version` in case there are discrepancies
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1292380180
@xushiyan good catch! Updated
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1286353847
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4a6c6a488d8ff2307833653d5f45df7ff0247ad3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402)
* 454cd1dc4e04aadfb8836553a45e201dc9abb8dc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201673911
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 282b11763f8fc892685a84fc136e59b564ec988e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509)
* 1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201742930
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201551134
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4afc010560157d3dc0e92396e23e6fa194094913 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504)
* 282b11763f8fc892685a84fc136e59b564ec988e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1286703120
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 454cd1dc4e04aadfb8836553a45e201dc9abb8dc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1288641984
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b236a680cc0abd5b1583c09570002bad77d9ad6f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439)
* 2ff9e3c52bc858b1ba1258988d70a06996fe6ae6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1289279531
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2ff9e3c52bc858b1ba1258988d70a06996fe6ae6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1289801368
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
}, {
"hash" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"triggerType" : "PUSH"
}, {
"hash" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2ff9e3c52bc858b1ba1258988d70a06996fe6ae6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519)
* 05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0 UNKNOWN
* 456474d875da7bbb33b0a2a0b9ca38f3c52b04fc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1312237008
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
}, {
"hash" : "5e0784bd73612d73d100152d6a5aeec7ddddc11c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5e0784bd73612d73d100152d6a5aeec7ddddc11c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 897aac606d8f112dab9e01e59b2271c5ecb5f9a4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605)
* 5e0784bd73612d73d100152d6a5aeec7ddddc11c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1005995625
##########
pom.xml:
##########
@@ -1728,6 +1736,9 @@
<hudi.spark.common.module>hudi-spark3-common</hudi.spark.common.module>
<scalatest.version>${scalatest.spark3.version}</scalatest.version>
<kafka.version>${kafka.spark3.version}</kafka.version>
+ <parquet.version>1.10.1</parquet.version>
Review Comment:
Good call. This is an invariant though for all profiles, so we need to call it out holistically
##########
packaging/hudi-flink-bundle/pom.xml:
##########
@@ -639,7 +639,6 @@
<groupId>org.apache.orc</groupId>
<artifactId>orc-core</artifactId>
<version>${orc.version}</version>
- <classifier>nohive</classifier>
Review Comment:
We can't have it in a separate PR, since our code-change is making it incompatible w/ previous "nohive" version.
And we can't shade Orc or Parquet or any other format which is interfacing w/ the execution engine b/c we share the classes w/ it (meaning that we pass these classes' objects from Hudi to the engine, and back)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1200056209
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c771a314e72284d22cd682a48eb0013aaf09b3cb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
xushiyan commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1312551175
@danny0405 let's have some follow-up discussion and change if needed:
in flink bundle
- the whole parquet dependency is included while other bundles we only include parquet-avro as the convention
- avro is shaded but not for parquet and orc
We need to make some decisions and address these discrepancies
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1020578572
##########
packaging/hudi-flink-bundle/pom.xml:
##########
@@ -639,7 +639,6 @@
<groupId>org.apache.orc</groupId>
<artifactId>orc-core</artifactId>
<version>${orc.version}</version>
- <classifier>nohive</classifier>
Review Comment:
@danny0405 can you help us understand how Orc is used w/in the Flink bundle?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r934791644
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala:
##########
@@ -223,6 +215,20 @@ private[sql] class AvroSerializer(
val numFields = st.length
(getter, ordinal) => structConverter(getter.getStruct(ordinal, numFields))
+ ////////////////////////////////////////////////////////////////////////////////////////////
+ // Following section is amended to the original (Spark's) implementation
+ // >>> BEGINS
+ ////////////////////////////////////////////////////////////////////////////////////////////
+
+ case (st: StructType, UNION) =>
Review Comment:
Folks, we need to be careful when we add support for Spark 3.3 we should review the changes against previous versions b/c some of the code we re-home from Spark has actually our own fixes which we can't upstream to Spark in a timely fashion.
This change in particular if missed would have made Column Stats Index unreadable on Spark 3.3.
I had added annotations like you can see here to make it more catchy to the eye that this code isn't just a verbatim copy from Spark, but we need to be careful when we try to back-port the changes.
I'd recommend following procedure:
1. By default, carry over implementation from previous Spark version.
2. Then reconcile it w/ the latest Spark version (back-porting)
cc @CTTY @rahil-c @umehrot2 @nsivabalan @yihua @codope @xushiyan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1293141129
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 897aac606d8f112dab9e01e59b2271c5ecb5f9a4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1293134993
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 897aac606d8f112dab9e01e59b2271c5ecb5f9a4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1292480897
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
}, {
"hash" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"triggerType" : "PUSH"
}, {
"hash" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540",
"triggerID" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"triggerType" : "PUSH"
}, {
"hash" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605",
"triggerID" : "897aac606d8f112dab9e01e59b2271c5ecb5f9a4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0 UNKNOWN
* 456474d875da7bbb33b0a2a0b9ca38f3c52b04fc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540)
* 897aac606d8f112dab9e01e59b2271c5ecb5f9a4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12605)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1006233623
##########
packaging/hudi-flink-bundle/pom.xml:
##########
@@ -639,7 +639,6 @@
<groupId>org.apache.orc</groupId>
<artifactId>orc-core</artifactId>
<version>${orc.version}</version>
- <classifier>nohive</classifier>
Review Comment:
> When you say "interfacing w/ the execution engine" it's meant for class loading, which should be addressed at code level, like avoid calling APIs that load hardcoded classes, which i think it's rare situations (Kryo is one of those)
It's not only that, it's that you might be creating an object of class X and passing it to the execution engine -- in that case both have to share the class X (therefore you can't shade it in one of them).
Please check my other comment though, i don't think this is the case for us, and so we should be able to shade actually.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1289992454
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
}, {
"hash" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0",
"triggerType" : "PUSH"
}, {
"hash" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540",
"triggerID" : "456474d875da7bbb33b0a2a0b9ca38f3c52b04fc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 05eb8988fb1e9b462e5c2dbc1db32b2a56b8edf0 UNKNOWN
* 456474d875da7bbb33b0a2a0b9ca38f3c52b04fc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12540)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1205528330
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cb79510068baa4769fe6496867c1e26754502f40 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1205442383
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510)
* cb79510068baa4769fe6496867c1e26754502f40 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1001198399
##########
pom.xml:
##########
@@ -1728,6 +1736,9 @@
<hudi.spark.common.module>hudi-spark3-common</hudi.spark.common.module>
<scalatest.version>${scalatest.spark3.version}</scalatest.version>
<kafka.version>${kafka.spark3.version}</kafka.version>
+ <parquet.version>1.10.1</parquet.version>
Review Comment:
These were missing
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1287641416
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b236a680cc0abd5b1583c09570002bad77d9ad6f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1286350693
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cb79510068baa4769fe6496867c1e26754502f40 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588)
* 4a6c6a488d8ff2307833653d5f45df7ff0247ad3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402)
* 454cd1dc4e04aadfb8836553a45e201dc9abb8dc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1201678511
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 282b11763f8fc892685a84fc136e59b564ec988e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509)
* 1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1199968461
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 745c015e848fde5d7a78c21e828af97705efa0d0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1200009286
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 745c015e848fde5d7a78c21e828af97705efa0d0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1006119882
##########
packaging/hudi-flink-bundle/pom.xml:
##########
@@ -639,7 +639,6 @@
<groupId>org.apache.orc</groupId>
<artifactId>orc-core</artifactId>
<version>${orc.version}</version>
- <classifier>nohive</classifier>
Review Comment:
in principle hudi should not include file formats in the bundles, and just use provided ones and also make sure hudi using APIs correctly. But if we include some libs, we should shade for hudi's use. There are inconsistencies about this across bundles, for flink bundle, avro is shaded but parquet is not. When you say "interfacing w/ the execution engine" it's meant for class loading, which should be addressed at code level, like avoid calling APIs that load hardcoded classes, which i think it's rare situations (Kryo is one of those)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #6227:
URL: https://github.com/apache/hudi/pull/6227#discussion_r1006125869
##########
packaging/hudi-flink-bundle/pom.xml:
##########
@@ -639,7 +639,6 @@
<groupId>org.apache.orc</groupId>
<artifactId>orc-core</artifactId>
<version>${orc.version}</version>
- <classifier>nohive</classifier>
Review Comment:
@xushiyan let me take back my 2d point:
We should actually not be depending on this modules directly -- for reading these file-formats we're relying on readers provided by the execution engine(s) and therefore should not depend on these modules directly for that.
The only other use-case i see us depending on these modules for are schema conversions in hive-sync, hadoop-mr bundles. For that we can (and should) shade these deps indeed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1288659835
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10463",
"triggerID" : "745c015e848fde5d7a78c21e828af97705efa0d0",
"triggerType" : "PUSH"
}, {
"hash" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10466",
"triggerID" : "c771a314e72284d22cd682a48eb0013aaf09b3cb",
"triggerType" : "PUSH"
}, {
"hash" : "4afc010560157d3dc0e92396e23e6fa194094913",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10504",
"triggerID" : "4afc010560157d3dc0e92396e23e6fa194094913",
"triggerType" : "PUSH"
}, {
"hash" : "282b11763f8fc892685a84fc136e59b564ec988e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10509",
"triggerID" : "282b11763f8fc892685a84fc136e59b564ec988e",
"triggerType" : "PUSH"
}, {
"hash" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10510",
"triggerID" : "1178b0e8b43f0ab020b688db3d197e7cb9dd1ef0",
"triggerType" : "PUSH"
}, {
"hash" : "cb79510068baa4769fe6496867c1e26754502f40",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=10588",
"triggerID" : "cb79510068baa4769fe6496867c1e26754502f40",
"triggerType" : "PUSH"
}, {
"hash" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12402",
"triggerID" : "4a6c6a488d8ff2307833653d5f45df7ff0247ad3",
"triggerType" : "PUSH"
}, {
"hash" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12405",
"triggerID" : "454cd1dc4e04aadfb8836553a45e201dc9abb8dc",
"triggerType" : "PUSH"
}, {
"hash" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439",
"triggerID" : "b236a680cc0abd5b1583c09570002bad77d9ad6f",
"triggerType" : "PUSH"
}, {
"hash" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519",
"triggerID" : "2ff9e3c52bc858b1ba1258988d70a06996fe6ae6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b236a680cc0abd5b1583c09570002bad77d9ad6f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12439)
* 2ff9e3c52bc858b1ba1258988d70a06996fe6ae6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12519)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #6227: [HUDI-4496] Fixing Orc support broken for Spark 3.x and more
Posted by GitBox <gi...@apache.org>.
xushiyan commented on PR #6227:
URL: https://github.com/apache/hudi/pull/6227#issuecomment-1292347611
@alexeykudinkin LGTM. can you please also update the PR description? some content looks obsolete
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org