You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by GitBox <gi...@apache.org> on 2020/09/18 03:05:08 UTC

[GitHub] [hive] jcamachor opened a new pull request #1504: HIVE-24176: Create query-level cache for HMS requests and extend existing local HS2 HMS cache

jcamachor opened a new pull request #1504:
URL: https://github.com/apache/hive/pull/1504


   ### What changes were proposed in this pull request?
   
   This PR creates a query-level cache for HMS requests. The lifecycle of that cache is associated to the lifecycle of the query. This basically means that each unique request to certain HMS APIs should only be served once from HMS, while follow-up repetitive calls will be retrieved from cache. The initial implementation includes caching for 19 APIs.
   
   This PR also extends existing local HS2 HMS cache implementation introduced in HIVE-23949 to support other requests (getTableColumnStatistics, getPartitionsByNames). In fact, implementation relies on some of the logic introduced in that JIRA since there are some commonalities.
   
   
   ### Why are the changes needed?
   
   This should improve compilation latency.
   
   
   ### Does this PR introduce _any_ user-facing change?
   
   No.
   
   
   ### How was this patch tested?
   
   Existing tests.
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

[GitHub] [hive] jcamachor merged pull request #1504: HIVE-24176: Create query-level cache for HMS requests and extend existing local HS2 HMS cache

Posted by GitBox <gi...@apache.org>.
jcamachor merged pull request #1504:
URL: https://github.com/apache/hive/pull/1504


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

[GitHub] [hive] vineetgarg02 commented on pull request #1504: HIVE-24176: Create query-level cache for HMS requests and extend existing local HS2 HMS cache

Posted by GitBox <gi...@apache.org>.
vineetgarg02 commented on pull request #1504:
URL: https://github.com/apache/hive/pull/1504#issuecomment-695115290


   LGTM, just one question : If i understand it this query cache will always trigger i.e. it is not controlled by any config value right?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

[GitHub] [hive] jcamachor closed pull request #1504: HIVE-24176: Create query-level cache for HMS requests and extend existing local HS2 HMS cache

Posted by GitBox <gi...@apache.org>.
jcamachor closed pull request #1504:
URL: https://github.com/apache/hive/pull/1504


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

[GitHub] [hive] jcamachor commented on pull request #1504: HIVE-24176: Create query-level cache for HMS requests and extend existing local HS2 HMS cache

Posted by GitBox <gi...@apache.org>.
jcamachor commented on pull request #1504:
URL: https://github.com/apache/hive/pull/1504#issuecomment-695135122


   Thanks @vineetgarg02 . That's a very good point, I was planning to add it (mostly for debugging purposes) and forgot about it. I have pushed a new commit.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org