You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/07/14 23:12:00 UTC

[jira] [Resolved] (ARROW-16523) [C++] Move ExecPlan scheduling into the plan

     [ https://issues.apache.org/jira/browse/ARROW-16523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Weston Pace resolved ARROW-16523.
---------------------------------
    Fix Version/s: 9.0.0
       Resolution: Fixed

Issue resolved by pull request 13143
[https://github.com/apache/arrow/pull/13143]

> [C++] Move ExecPlan scheduling into the plan
> --------------------------------------------
>
>                 Key: ARROW-16523
>                 URL: https://issues.apache.org/jira/browse/ARROW-16523
>             Project: Apache Arrow
>          Issue Type: Sub-task
>          Components: C++
>            Reporter: Weston Pace
>            Assignee: Sasha Krassovsky
>            Priority: Major
>              Labels: pull-request-available, query-engine
>             Fix For: 9.0.0
>
>          Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> Source nodes and pipeline breakers need to schedule new thread tasks.  These tasks run entire fused pipelines (e.g. the thread task could be thought of as analogous to a "driver" in some other models).
> At the moment every node that needs to schedule tasks (scan node, hash-join node, aggregate node, etc.) handles this independently.  The result is a lot of similar looking code and bugs like ARROW-15221 where one node takes care of cleanup but another doesn't.
> We can centralize this by moving this scheduling into the ExecPlan itself and giving nodes an ability to schedule tasks via the ExecPlan.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)