You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/07/22 02:10:00 UTC

[jira] [Created] (ARROW-17180) [C++] Backpressure should resume as a new task, assuming executor is present

Weston Pace created ARROW-17180:
-----------------------------------

             Summary: [C++] Backpressure should resume as a new task, assuming executor is present
                 Key: ARROW-17180
                 URL: https://issues.apache.org/jira/browse/ARROW-17180
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace


As brought up on the mailing list: https://lists.apache.org/thread/hscjqyw7lpt95vlkzoslm6pyhy9x6wso

When we resume producing in the source node, we should run the continuation (which starts scanning again) as a new task.  This will avoid potential stack overflow (if we pause and start many times) and help make for more understandable stack traces.  The continuation is unlikely to have anything to do with the task that is calling resume and so there is not as much downside to a context switch.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)