You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Michal Nowakiewicz (Jira)" <ji...@apache.org> on 2021/08/03 06:34:00 UTC

[jira] [Created] (ARROW-13532) [C++][Compute] Join: add set membership test method to the grouper

Michal Nowakiewicz created ARROW-13532:
------------------------------------------

             Summary: [C++][Compute] Join: add set membership test method to the grouper
                 Key: ARROW-13532
                 URL: https://issues.apache.org/jira/browse/ARROW-13532
             Project: Apache Arrow
          Issue Type: Improvement
            Reporter: Michal Nowakiewicz


Hash table used in group by provides one main method: map. 
This method will find an existing matching key in the hash table and output the corresponding group id, it the key already has been inserted in the hash table. Otherwise it will insert a new key and assign a new group id value to it.

This interface is tailored for the group by. In order to reuse the same hash table implementation in join, there must be a way to skip insertion of new keys into the hash table when looking up existing keys. When join processes probe side it needs to filter input rows based on finding a match in the hash table, but keeping hash table immutable and not automatically adding missing keys to it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)