You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Ben Kietzman (Jira)" <ji...@apache.org> on 2020/11/17 15:55:00 UTC

[jira] [Commented] (ARROW-10630) [C++][Compute] Support sharing KernelState between processes

    [ https://issues.apache.org/jira/browse/ARROW-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233684#comment-17233684 ] 

Ben Kietzman commented on ARROW-10630:
--------------------------------------

[~wesm]

> [C++][Compute] Support sharing KernelState between processes
> ------------------------------------------------------------
>
>                 Key: ARROW-10630
>                 URL: https://issues.apache.org/jira/browse/ARROW-10630
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>    Affects Versions: 2.0.0
>            Reporter: Ben Kietzman
>            Priority: Major
>
> From the mailing list discussion: https://lists.apache.org/thread.html/ra2a8f9fc5cf621bd79a6db4e578ad133dd921722f24e4c220e4ba07f%40%3Cdev.arrow.apache.org%3E
> In a distributed context, it would be useful to send a KernelState from one process to another. For example when distributing computation of mean, the completed states of each process must be merged before finalization. This could be supported by adding to the KernelState interface ({{KernelState::{Serialize, Deserialize}}} or by adding functions to ScalarAggregateKernel.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)