You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2021/06/09 13:23:00 UTC

[jira] [Commented] (ARROW-3978) [C++] Implement hashing, dictionary-encoding for StructArray

    [ https://issues.apache.org/jira/browse/ARROW-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360064#comment-17360064 ] 

Wes McKinney commented on ARROW-3978:
-------------------------------------

[~bkietz] [~michalno] seems like this could be supported pretty soon using the new hash table machinery? 

> [C++] Implement hashing, dictionary-encoding for StructArray
> ------------------------------------------------------------
>
>                 Key: ARROW-3978
>                 URL: https://issues.apache.org/jira/browse/ARROW-3978
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++
>            Reporter: Wes McKinney
>            Priority: Major
>              Labels: query-engine
>
> This is a central requirement for hash-aggregations such as
> {code}
> SELECT AGG_FUNCTION(expr)
> FROM table
> GROUP BY expr1, expr2, ...
> {code}
> The materialized keys in the GROUP BY section form a struct, which can be incrementally hashed to produce dictionary codes suitable for computing aggregates or any other purpose. 
> There are a few subtasks related to this, such as efficiently constructing a record (that can be hashed quickly) to identify each "row" in the struct. Maybe we should start with that first



--
This message was sent by Atlassian Jira
(v8.3.4#803005)