You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/04/13 04:18:00 UTC

[jira] [Created] (ARROW-16177) [C++] Replace ThreadIndexer with a more performant thread-local implementation

Weston Pace created ARROW-16177:
-----------------------------------

             Summary: [C++] Replace ThreadIndexer with a more performant thread-local implementation
                 Key: ARROW-16177
                 URL: https://issues.apache.org/jira/browse/ARROW-16177
             Project: Apache Arrow
          Issue Type: Bug
          Components: C++
            Reporter: Weston Pace


Many of the ExecNode operations use thread local state (mostly temporary buffers) to avoid per-batch allocation.  Currently we are using ThreadIndexer but to get the thread local state requires locking a mutex and a map lookup.  For some of the critical sections we are developing in hash-join this has become a bottleneck.  Ideally we can replace this with something that relies on thread local state instead of a map shared across all threads. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)