You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Slim Bouguerra (Jira)" <ji...@apache.org> on 2019/11/13 18:00:00 UTC

[jira] [Updated] (HIVE-22492) Amortize lock contention due to LRFU accounting

     [ https://issues.apache.org/jira/browse/HIVE-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Slim Bouguerra updated HIVE-22492:
----------------------------------
    Attachment: llap-lock-contention.svg

> Amortize lock contention due to LRFU accounting
> -----------------------------------------------
>
>                 Key: HIVE-22492
>                 URL: https://issues.apache.org/jira/browse/HIVE-22492
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Slim Bouguerra
>            Assignee: Slim Bouguerra
>            Priority: Major
>         Attachments: llap-lock-contention.svg
>
>
> LRFU eviction policy can be a major source of contention under high load.
> This can be see on the following profiles.
> To fix this the idea is to use a batching wrapper to amortize the locking contention.
> The trick i a common way to amortize locking as explained here http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf



--
This message was sent by Atlassian Jira
(v8.3.4#803005)