You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2017/03/11 01:29:04 UTC

[jira] [Created] (KUDU-1930) Improve performance of dictionary builder

Todd Lipcon created KUDU-1930:
---------------------------------

             Summary: Improve performance of dictionary builder
                 Key: KUDU-1930
                 URL: https://issues.apache.org/jira/browse/KUDU-1930
             Project: Kudu
          Issue Type: Bug
          Components: cfile, perf
    Affects Versions: 1.3.0
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon


I locally tweaked tpch_real_world to use hash partitioning instead of range partitioning, so that the different threads overlapped on the same tablets, simulating a more realistic parallel load scenario. I noticed that the MM threads were CPU bound, with a high percentage of CPU in AddCodeWords(). Initial prototypes indicate that optimizing the hashmap used here would be an easy win.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)