You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2015/09/03 02:26:45 UTC
[jira] [Commented] (TEZ-2731) Fix Tez GenericCounter performance
bottleneck
[ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728281#comment-14728281 ]
Hitesh Shah commented on TEZ-2731:
----------------------------------
+1 for backport to 0.7
> Fix Tez GenericCounter performance bottleneck
> ---------------------------------------------
>
> Key: TEZ-2731
> URL: https://issues.apache.org/jira/browse/TEZ-2731
> Project: Apache Tez
> Issue Type: Sub-task
> Affects Versions: 0.6.0, 0.7.0, 0.8.0-alpha
> Reporter: Gopal V
> Assignee: Gopal V
> Fix For: 0.8.0-alpha
>
> Attachments: TEZ-2731.1.patch, atomic-long-cntr.png, lock-inc.png, mr-reader-next.png
>
>
> GenericCounter::increment(1) shows up as a ~16% performance penalty inside the unvectorized codepath of Hive queries.
> The vectorized codepath amortizes this entirely by running through that exactly once every 1024 rows & the performance improvement is dramatic.
> !lock-inc.png!
> !mr-reader-next.png!
> Optimize the GenericCounter impl for mostly uncontested atomic operations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)