You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by GitBox <gi...@apache.org> on 2021/02/04 20:17:52 UTC

[GitHub] [hive] vihangk1 opened a new pull request #1948: HIVE-24741: get_partitions_ps_with_auth performance improvement

vihangk1 opened a new pull request #1948:
URL: https://github.com/apache/hive/pull/1948


   ### What changes were proposed in this pull request?
   This PR improves the performance of get_partitions_ps_with_auth for certain cases when it is requesting for all the partitions. get_partitions_ps_with_auth is not directSQL enabled and if it is requesting for all the partitions, we can redirect it to a faster partitions API which supports directSQL. When filters are provided the API continues to use existing datanuclues path so there is no change with that behaviour.
   
   ### Why are the changes needed?
   Performance improvement for a HMS API.
   
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   Modified existing unit-test to make sure it is working as expected. Also tested on a real-world workload where performance improvement was substantial.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


[GitHub] [hive] vihangk1 merged pull request #1948: HIVE-24741: get_partitions_ps_with_auth performance improvement

Posted by GitBox <gi...@apache.org>.
vihangk1 merged pull request #1948:
URL: https://github.com/apache/hive/pull/1948


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


[GitHub] [hive] vihangk1 commented on pull request #1948: HIVE-24741: get_partitions_ps_with_auth performance improvement

Posted by GitBox <gi...@apache.org>.
vihangk1 commented on pull request #1948:
URL: https://github.com/apache/hive/pull/1948#issuecomment-776799287


   Thanks for the review @nrg4878! Merged into master.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org