You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2023/04/25 11:13:25 UTC
[GitHub] [spark] jackylee-ch opened a new pull request, #40944: [SPARK-40708][SQL][WIP] Auto update partition statistics based on write metrics
jackylee-ch opened a new pull request, #40944:
URL: https://github.com/apache/spark/pull/40944
What changes were proposed in this pull request?
Support collect partition statistics while task running and auto update partition statistics in catalog.
Does this PR introduce any user-facing change?
No
How was this patch tested?
unit tests and some added tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] melin commented on pull request #40944: [SPARK-40708][SQL][WIP] Auto update partition statistics based on write metrics
Posted by "melin (via GitHub)" <gi...@apache.org>.
melin commented on PR #40944:
URL: https://github.com/apache/spark/pull/40944#issuecomment-1521887284
Great feature. For example, based on statistics, users can determine whether to merge small files.
Support non-partitioned table statistics?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] github-actions[bot] commented on pull request #40944: [SPARK-40708][SQL] Auto update partition statistics based on write metrics
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40944:
URL: https://github.com/apache/spark/pull/40944#issuecomment-1712669147
We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] github-actions[bot] closed pull request #40944: [SPARK-40708][SQL] Auto update partition statistics based on write metrics
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed pull request #40944: [SPARK-40708][SQL] Auto update partition statistics based on write metrics
URL: https://github.com/apache/spark/pull/40944
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] jackylee-ch commented on pull request #40944: [SPARK-40708][SQL][WIP] Auto update partition statistics based on write metrics
Posted by "jackylee-ch (via GitHub)" <gi...@apache.org>.
jackylee-ch commented on PR #40944:
URL: https://github.com/apache/spark/pull/40944#issuecomment-1521969391
> Support non-partitioned table statistics?
Yeap, it is supported in this pr.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org