You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Michal Nowakiewicz (Jira)" <ji...@apache.org> on 2021/09/16 05:57:00 UTC

[jira] [Commented] (ARROW-12726) [C++][Compute] GroupBy: add parallelism to hash group by

    [ https://issues.apache.org/jira/browse/ARROW-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415890#comment-17415890 ] 

Michal Nowakiewicz commented on ARROW-12726:
--------------------------------------------

Parallelism is implemented in hash group by. What remains is to benchmark to see how well it behaves for a set of varying dimensions, fix performance issues, investigate improvements for different cardinalities of groups, implement the improvements. 

> [C++][Compute] GroupBy: add parallelism to hash group by
> --------------------------------------------------------
>
>                 Key: ARROW-12726
>                 URL: https://issues.apache.org/jira/browse/ARROW-12726
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>    Affects Versions: 4.0.0
>            Reporter: Michal Nowakiewicz
>            Priority: Major
>             Fix For: 6.0.0
>
>
> Implement parallel processing for hash group by. 
> Make sure it works well (scales) for different cardinalities of groups.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)