You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2015/08/20 09:16:45 UTC

[jira] [Updated] (TEZ-2731) Fix Tez GenericCounter performance bottleneck

     [ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gopal V updated TEZ-2731:
-------------------------
    Attachment: lock-inc.png
                mr-reader-next.png

> Fix Tez GenericCounter performance bottleneck
> ---------------------------------------------
>
>                 Key: TEZ-2731
>                 URL: https://issues.apache.org/jira/browse/TEZ-2731
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Gopal V
>         Attachments: lock-inc.png, mr-reader-next.png
>
>
> GenericCounter::increment(1) shows up as a ~16% performance penalty inside the unvectorized codepath of Hive queries.
> The vectorized codepath amortizes this entirely by running through that exactly once every 1024 rows & the performance improvement is dramatic.
> Optimize the GenericCounter impl for mostly uncontested atomic operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)