You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/01/27 23:07:33 UTC
[GitHub] [hudi] alexeykudinkin opened a new pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
alexeykudinkin opened a new pull request #4705:
URL: https://github.com/apache/hudi/pull/4705
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
Parquet Column Range metadata extraction utility was simplistically assuming that Decimal types are only represented by INT32, while they representation varies depending on precision.
More details could be found here:
https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#DECIMAL
## Brief change log
- Fixing Parquet Column Range metadata extraction
- Added test validating Parquet column-range metadata extraction
## Verify this pull request
This change added tests
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028285810
@manojpec good call, let me cut those down
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1023728937
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1023727154
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028457685
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
}, {
"hash" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
* e6c57d02768a5561537546c4380ed141a4a497e0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028430624
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026224356
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] manojpec edited a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
manojpec edited a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026457070
@alexeykudinkin
Can the test fixtures be concise? The json files are huge. Any ways to trim what we are testing here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028331080
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024841207
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026221672
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026224356
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028457685
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
}, {
"hash" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
* e6c57d02768a5561537546c4380ed141a4a497e0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1023725427
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024841207
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028324920
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] manojpec commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
manojpec commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026457070
Can the test fixtures be concise? The json files are huge. Any ways to trim what we are testing here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028380423
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028430200
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028430624
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028399211
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on a change in pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#discussion_r794116319
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieColumnRangeMetadata.java
##########
@@ -31,15 +29,13 @@
private final T minValue;
private final T maxValue;
private final long numNulls;
- private final PrimitiveStringifier stringifier;
- public HoodieColumnRangeMetadata(final String filePath, final String columnName, final T minValue, final T maxValue, final long numNulls, final PrimitiveStringifier stringifier) {
+ public HoodieColumnRangeMetadata(final String filePath, final String columnName, final T minValue, final T maxValue, final long numNulls) {
Review comment:
Not sure i follow. Am actually removing it since it ain't used anywhere
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/columnstats/ColumnStatsIndexHelper.java
##########
@@ -447,8 +448,8 @@ private static String composeZIndexColName(String col, String statName) {
new Float(colMetadata.getMaxValue().toString()));
} else if (colType instanceof BinaryType) {
return Pair.of(
- ((Binary) colMetadata.getMinValue()).getBytes(),
- ((Binary) colMetadata.getMaxValue()).getBytes());
+ ((ByteBuffer) colMetadata.getMinValue()).array(),
Review comment:
Good catch!
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java
##########
@@ -360,24 +361,56 @@ public Boolean apply(String recordKey) {
return new HoodieColumnRangeMetadata<T>(
one.getFilePath(),
- one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls(), one.getStringifier());
+ one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls());
}
private static Comparable<?> convertToNativeJavaType(PrimitiveType primitiveType, Comparable val) {
if (primitiveType.getOriginalType() == OriginalType.DECIMAL) {
- DecimalMetadata decimalMetadata = primitiveType.getDecimalMetadata();
- return BigDecimal.valueOf((Integer) val, decimalMetadata.getScale());
+ return extractDecimal(val, primitiveType.getDecimalMetadata());
} else if (primitiveType.getOriginalType() == OriginalType.DATE) {
// NOTE: This is a workaround to address race-condition in using
// {@code SimpleDataFormat} concurrently (w/in {@code DateStringifier})
// TODO cleanup after Parquet upgrade to 1.12
synchronized (primitiveType.stringifier()) {
+ // Date logical type is implemented as a signed INT32
Review comment:
It's not yet
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java
##########
@@ -360,24 +361,56 @@ public Boolean apply(String recordKey) {
return new HoodieColumnRangeMetadata<T>(
one.getFilePath(),
- one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls(), one.getStringifier());
+ one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls());
}
private static Comparable<?> convertToNativeJavaType(PrimitiveType primitiveType, Comparable val) {
if (primitiveType.getOriginalType() == OriginalType.DECIMAL) {
- DecimalMetadata decimalMetadata = primitiveType.getDecimalMetadata();
- return BigDecimal.valueOf((Integer) val, decimalMetadata.getScale());
+ return extractDecimal(val, primitiveType.getDecimalMetadata());
} else if (primitiveType.getOriginalType() == OriginalType.DATE) {
// NOTE: This is a workaround to address race-condition in using
// {@code SimpleDataFormat} concurrently (w/in {@code DateStringifier})
// TODO cleanup after Parquet upgrade to 1.12
synchronized (primitiveType.stringifier()) {
+ // Date logical type is implemented as a signed INT32
+ // REF: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md
return java.sql.Date.valueOf(
primitiveType.stringifier().stringify((Integer) val)
);
}
+ } else if (primitiveType.getOriginalType() == OriginalType.UTF8) {
+ // NOTE: UTF8 type designates a byte array that should be interpreted as a
+ // UTF-8 encoded character string
+ // REF: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md
+ return ((Binary) val).toStringUsingUTF8();
+ } else if (primitiveType.getPrimitiveTypeName() == PrimitiveType.PrimitiveTypeName.BINARY) {
+ // NOTE: `getBytes` access makes a copy of the underlying byte buffer
+ return ((Binary) val).toByteBuffer();
}
return val;
}
+
+ @Nonnull
+ private static BigDecimal extractDecimal(Object val, DecimalMetadata decimalMetadata) {
+ // In Parquet, Decimal could be represented as either of
+ // 1. INT32 (for 1 <= precision <= 9)
+ // 2. INT64 (for 1 <= precision <= 18)
+ // 3. FIXED_LEN_BYTE_ARRAY (precision is limited by the array size. Length n can store <= floor(log_10(2^(8*n - 1) - 1)) base-10 digits)
+ // 4. BINARY (precision is not limited)
+ // REF: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#DECIMAL
+ int scale = decimalMetadata.getScale();
+ if (val == null) {
+ return null;
+ } else if (val instanceof Integer) {
+ return BigDecimal.valueOf((Integer) val, scale);
+ } else if (val instanceof Long) {
+ return BigDecimal.valueOf((Long) val, scale);
+ } else if (val instanceof Binary) {
+ // NOTE: Unscaled number is stored in BE format (most significant byte is 0th)
+ return new BigDecimal(new BigInteger(((Binary)val).getBytesUnsafe()), scale);
+ } else {
+ throw new UnsupportedOperationException("not supported");
Review comment:
Good call
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] manojpec commented on a change in pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
manojpec commented on a change in pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#discussion_r794119507
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieColumnRangeMetadata.java
##########
@@ -31,15 +29,13 @@
private final T minValue;
private final T maxValue;
private final long numNulls;
- private final PrimitiveStringifier stringifier;
- public HoodieColumnRangeMetadata(final String filePath, final String columnName, final T minValue, final T maxValue, final long numNulls, final PrimitiveStringifier stringifier) {
+ public HoodieColumnRangeMetadata(final String filePath, final String columnName, final T minValue, final T maxValue, final long numNulls) {
Review comment:
I misread. We are good here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024840853
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024840853
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024861487
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028331080
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1023727154
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028326061
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026948277
@manojpec : can I to ahead and land this or do you have any more comments to be resolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028380423
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028469893
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
}, {
"hash" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5693",
"triggerID" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
* e6c57d02768a5561537546c4380ed141a4a497e0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5693)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
nsivabalan merged pull request #4705:
URL: https://github.com/apache/hudi/pull/4705
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028455703
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
}, {
"hash" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
* e6c57d02768a5561537546c4380ed141a4a497e0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028469893
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
}, {
"hash" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5693",
"triggerID" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
* e6c57d02768a5561537546c4380ed141a4a497e0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5693)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028399211
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024861487
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1023725427
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028299334
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028455703
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
}, {
"hash" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690)
* e6c57d02768a5561537546c4380ed141a4a497e0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028299334
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024848478
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1024848478
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1023758380
looks like there are some CI failures. can you check them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026279791
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1023728937
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] manojpec commented on a change in pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
manojpec commented on a change in pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#discussion_r794079202
##########
File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/columnstats/ColumnStatsIndexHelper.java
##########
@@ -447,8 +448,8 @@ private static String composeZIndexColName(String col, String statName) {
new Float(colMetadata.getMaxValue().toString()));
} else if (colType instanceof BinaryType) {
return Pair.of(
- ((Binary) colMetadata.getMinValue()).getBytes(),
- ((Binary) colMetadata.getMaxValue()).getBytes());
+ ((ByteBuffer) colMetadata.getMinValue()).array(),
Review comment:
Now that `convertToNativeJavaType()` returns a java String type for ParquetUTF8BinaryStringType, Line 426 needs to change right? No need for Binary casting there.
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieColumnRangeMetadata.java
##########
@@ -31,15 +29,13 @@
private final T minValue;
private final T maxValue;
private final long numNulls;
- private final PrimitiveStringifier stringifier;
- public HoodieColumnRangeMetadata(final String filePath, final String columnName, final T minValue, final T maxValue, final long numNulls, final PrimitiveStringifier stringifier) {
+ public HoodieColumnRangeMetadata(final String filePath, final String columnName, final T minValue, final T maxValue, final long numNulls) {
Review comment:
Each data type has its own Stringifier type. A common one is sufficient here?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java
##########
@@ -360,24 +361,56 @@ public Boolean apply(String recordKey) {
return new HoodieColumnRangeMetadata<T>(
one.getFilePath(),
- one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls(), one.getStringifier());
+ one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls());
}
private static Comparable<?> convertToNativeJavaType(PrimitiveType primitiveType, Comparable val) {
if (primitiveType.getOriginalType() == OriginalType.DECIMAL) {
- DecimalMetadata decimalMetadata = primitiveType.getDecimalMetadata();
- return BigDecimal.valueOf((Integer) val, decimalMetadata.getScale());
+ return extractDecimal(val, primitiveType.getDecimalMetadata());
} else if (primitiveType.getOriginalType() == OriginalType.DATE) {
// NOTE: This is a workaround to address race-condition in using
// {@code SimpleDataFormat} concurrently (w/in {@code DateStringifier})
// TODO cleanup after Parquet upgrade to 1.12
synchronized (primitiveType.stringifier()) {
+ // Date logical type is implemented as a signed INT32
+ // REF: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md
return java.sql.Date.valueOf(
primitiveType.stringifier().stringify((Integer) val)
);
}
+ } else if (primitiveType.getOriginalType() == OriginalType.UTF8) {
+ // NOTE: UTF8 type designates a byte array that should be interpreted as a
+ // UTF-8 encoded character string
+ // REF: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md
+ return ((Binary) val).toStringUsingUTF8();
+ } else if (primitiveType.getPrimitiveTypeName() == PrimitiveType.PrimitiveTypeName.BINARY) {
+ // NOTE: `getBytes` access makes a copy of the underlying byte buffer
+ return ((Binary) val).toByteBuffer();
}
return val;
}
+
+ @Nonnull
+ private static BigDecimal extractDecimal(Object val, DecimalMetadata decimalMetadata) {
+ // In Parquet, Decimal could be represented as either of
+ // 1. INT32 (for 1 <= precision <= 9)
+ // 2. INT64 (for 1 <= precision <= 18)
+ // 3. FIXED_LEN_BYTE_ARRAY (precision is limited by the array size. Length n can store <= floor(log_10(2^(8*n - 1) - 1)) base-10 digits)
+ // 4. BINARY (precision is not limited)
+ // REF: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#DECIMAL
+ int scale = decimalMetadata.getScale();
+ if (val == null) {
+ return null;
+ } else if (val instanceof Integer) {
+ return BigDecimal.valueOf((Integer) val, scale);
+ } else if (val instanceof Long) {
+ return BigDecimal.valueOf((Long) val, scale);
+ } else if (val instanceof Binary) {
+ // NOTE: Unscaled number is stored in BE format (most significant byte is 0th)
+ return new BigDecimal(new BigInteger(((Binary)val).getBytesUnsafe()), scale);
+ } else {
+ throw new UnsupportedOperationException("not supported");
Review comment:
Throwing error with some extra details will be helpful for debugging. Maybe the val type or value ?
##########
File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestColumnStatsIndex.scala
##########
@@ -268,11 +276,86 @@ class TestColumnStatsIndex extends HoodieClientTestBase {
df.selectExpr(exprs: _*)
.collect()
- }),
+ }).asJava,
indexSchema
)
}
+ @Test
+ def testParquetMetadataRangeExtraction(): Unit = {
+ val df = generateRandomDataFrame(spark)
+
+ val pathStr = tempDir.resolve("min-max").toAbsolutePath.toString
+
+ df.write.format("parquet")
+ .mode(SaveMode.Overwrite)
+ .save(pathStr)
+
+ val utils = new ParquetUtils
Review comment:
nit: few white lines can be trimmed here
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java
##########
@@ -360,24 +361,56 @@ public Boolean apply(String recordKey) {
return new HoodieColumnRangeMetadata<T>(
one.getFilePath(),
- one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls(), one.getStringifier());
+ one.getColumnName(), minValue, maxValue, one.getNumNulls() + another.getNumNulls());
}
private static Comparable<?> convertToNativeJavaType(PrimitiveType primitiveType, Comparable val) {
if (primitiveType.getOriginalType() == OriginalType.DECIMAL) {
- DecimalMetadata decimalMetadata = primitiveType.getDecimalMetadata();
- return BigDecimal.valueOf((Integer) val, decimalMetadata.getScale());
+ return extractDecimal(val, primitiveType.getDecimalMetadata());
} else if (primitiveType.getOriginalType() == OriginalType.DATE) {
// NOTE: This is a workaround to address race-condition in using
// {@code SimpleDataFormat} concurrently (w/in {@code DateStringifier})
// TODO cleanup after Parquet upgrade to 1.12
synchronized (primitiveType.stringifier()) {
+ // Date logical type is implemented as a signed INT32
Review comment:
I heard Parquet is already upgraded. If so, can we remove this sync workaround ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028326061
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683)
* 2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1026279791
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* 1c680c1381798065c51a5e6a7958238b1b540027 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4705: [HUDI-3337] Fixing Parquet Column Range metadata extraction
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4705:
URL: https://github.com/apache/hudi/pull/4705#issuecomment-1028521054
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fc6f1f4af2201fb5541aeae70c745e7b6dc3981e",
"triggerType" : "PUSH"
}, {
"hash" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5564",
"triggerID" : "1ce429a085e29115d1f97ba2b4dd5a8e8ecc867c",
"triggerType" : "PUSH"
}, {
"hash" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2fa66c4290ee2555973e29934ca7ecb8e4a0e709",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5601",
"triggerID" : "1c680c1381798065c51a5e6a7958238b1b540027",
"triggerType" : "PUSH"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5628",
"triggerID" : "1026221672",
"triggerType" : "MANUAL"
}, {
"hash" : "1c680c1381798065c51a5e6a7958238b1b540027",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5683",
"triggerID" : "1028324920",
"triggerType" : "MANUAL"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5684",
"triggerID" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"triggerType" : "PUSH"
}, {
"hash" : "2ad2dcddf911dea6b73d6fb7a394aaaadbbb5297",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5690",
"triggerID" : "1028430200",
"triggerType" : "MANUAL"
}, {
"hash" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5693",
"triggerID" : "e6c57d02768a5561537546c4380ed141a4a497e0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fc6f1f4af2201fb5541aeae70c745e7b6dc3981e UNKNOWN
* 2fa66c4290ee2555973e29934ca7ecb8e4a0e709 UNKNOWN
* e6c57d02768a5561537546c4380ed141a4a497e0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=5693)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org