You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "majian1998 (via GitHub)" <gi...@apache.org> on 2024/01/11 04:45:21 UTC
[PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats During Data Skipping [hudi]
majian1998 opened a new pull request, #10485:
URL: https://github.com/apache/hudi/pull/10485
In the current implementation of data skipping, column statistics for the entire table are read and then subjected to data skipping filtering operations based on these stats. When the table has a large volume of data and a high number of partitions, this approach can reduce the efficiency of data skipping, as partition pruning conditions are not utilized.
By pushing down the conditions for partition filtering to after the column statistics are read and applying pruning at that point, the size of the column stats that are subsequently involved in data skipping will be significantly reduced. This not only saves time on later computations but also conserves memory.
During a test conducted on a table with a total of 22TB distributed across 60 subpartitions, a query was performed on one of the subpartitions, which was 1.4TB in size. Overall, this simple test demonstrated that data skipping can lead to a savings of several seconds. In scenarios involving partition pruning, time savings are indeed achievable. Additionally, there will be a substantial reduction in the memory footprint for the list of candidate files needed for further computation.
In scenarios where partition pruning is not applied, this query would only result in a minimal increase in cost. This minor cost increase is inconsequential either when the data volume is large—making these seconds-level overheads negligible—or when the data volume is small, eliminating the need for partitioning altogether, in which case the filter operation would not be time-consuming.
### Change Logs
Pushing Down Partition Pruning Conditions to Column Stats During Data Skipping
### Impact
None
### Risk level (write none, low medium or high below)
low
### Documentation Update
None
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886750286
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
}, {
"hash" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928",
"triggerID" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 92cd13d2bac87ff68dce1ec60bf06427d4b88d94 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926)
* 02cf31984f93fe6d147a400a55d7039dc87a38cf Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886332817
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c58ddb3ade3d8d54c0610991a0ad141330061b49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922)
* d7ef9f4481a1bef75266e204bcc02cbc74bd225e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886288752
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c58ddb3ade3d8d54c0610991a0ad141330061b49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886240515
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c58ddb3ade3d8d54c0610991a0ad141330061b49 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886985630
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
}, {
"hash" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928",
"triggerID" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"triggerType" : "PUSH"
}, {
"hash" : "55a5918fb3706f76a41b9fba793c777566e09363",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "55a5918fb3706f76a41b9fba793c777566e09363",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 02cf31984f93fe6d147a400a55d7039dc87a38cf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928)
* 55a5918fb3706f76a41b9fba793c777566e09363 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886709580
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 92cd13d2bac87ff68dce1ec60bf06427d4b88d94 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886735750
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
}, {
"hash" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 92cd13d2bac87ff68dce1ec60bf06427d4b88d94 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926)
* 02cf31984f93fe6d147a400a55d7039dc87a38cf UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886948753
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
}, {
"hash" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928",
"triggerID" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 02cf31984f93fe6d147a400a55d7039dc87a38cf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "majian1998 (via GitHub)" <gi...@apache.org>.
majian1998 closed pull request #10485: [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping
URL: https://github.com/apache/hudi/pull/10485
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1887067482
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
}, {
"hash" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928",
"triggerID" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"triggerType" : "PUSH"
}, {
"hash" : "55a5918fb3706f76a41b9fba793c777566e09363",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21929",
"triggerID" : "55a5918fb3706f76a41b9fba793c777566e09363",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 02cf31984f93fe6d147a400a55d7039dc87a38cf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928)
* 55a5918fb3706f76a41b9fba793c777566e09363 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21929)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1887171861
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
}, {
"hash" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21928",
"triggerID" : "02cf31984f93fe6d147a400a55d7039dc87a38cf",
"triggerType" : "PUSH"
}, {
"hash" : "55a5918fb3706f76a41b9fba793c777566e09363",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21929",
"triggerID" : "55a5918fb3706f76a41b9fba793c777566e09363",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 55a5918fb3706f76a41b9fba793c777566e09363 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21929)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886526246
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c58ddb3ade3d8d54c0610991a0ad141330061b49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922)
* d7ef9f4481a1bef75266e204bcc02cbc74bd225e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924)
* 92cd13d2bac87ff68dce1ec60bf06427d4b88d94 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886612148
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
}, {
"hash" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926",
"triggerID" : "92cd13d2bac87ff68dce1ec60bf06427d4b88d94",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d7ef9f4481a1bef75266e204bcc02cbc74bd225e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924)
* 92cd13d2bac87ff68dce1ec60bf06427d4b88d94 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21926)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7291] Pushing Down Partition Pruning Conditions to Column Stats Earlier During Data Skipping [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #10485:
URL: https://github.com/apache/hudi/pull/10485#issuecomment-1886388255
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922",
"triggerID" : "c58ddb3ade3d8d54c0610991a0ad141330061b49",
"triggerType" : "PUSH"
}, {
"hash" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924",
"triggerID" : "d7ef9f4481a1bef75266e204bcc02cbc74bd225e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c58ddb3ade3d8d54c0610991a0ad141330061b49 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21922)
* d7ef9f4481a1bef75266e204bcc02cbc74bd225e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=21924)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org