You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by GitBox <gi...@apache.org> on 2021/03/17 07:43:53 UTC
[GitHub] [hive] rbalamohan opened a new pull request #2082: HIVE-24892: Replace getContentSummary::getLength with listStatus(recu…
rbalamohan opened a new pull request #2082:
URL: https://github.com/apache/hive/pull/2082
HIVE-24892: Replace getContentSummary::getLength with listStatus(recursive) for blobstores
### What changes were proposed in this pull request?
https://issues.apache.org/jira/browse/HIVE-24892
getContentSummary is super slow for blobstores and makes lots of network calls. Replacing it with listStatus(path, recursive) which is a lot more performant (e.g in consistent s3).
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
No
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org
[GitHub] [hive] rbalamohan commented on pull request #2082: HIVE-24892: Replace getContentSummary::getLength with listStatus(recu…
Posted by GitBox <gi...@apache.org>.
rbalamohan commented on pull request #2082:
URL: https://github.com/apache/hive/pull/2082#issuecomment-801557134
Thanks for the review @ashutoshc
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org
[GitHub] [hive] ashutoshc commented on pull request #2082: HIVE-24892: Replace getContentSummary::getLength with listStatus(recu…
Posted by GitBox <gi...@apache.org>.
ashutoshc commented on pull request #2082:
URL: https://github.com/apache/hive/pull/2082#issuecomment-801237671
+1 LGTM
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org
[GitHub] [hive] rbalamohan merged pull request #2082: HIVE-24892: Replace getContentSummary::getLength with listStatus(recu…
Posted by GitBox <gi...@apache.org>.
rbalamohan merged pull request #2082:
URL: https://github.com/apache/hive/pull/2082
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org