You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/04/20 03:00:00 UTC

[jira] [Created] (ARROW-16246) [C++] Add backpressure to hash-join node

Weston Pace created ARROW-16246:
-----------------------------------

             Summary: [C++] Add backpressure to hash-join node
                 Key: ARROW-16246
                 URL: https://issues.apache.org/jira/browse/ARROW-16246
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace


There are two elements to this:

First, if the sink is slow, the hash-join node needs to pause emitting batches (after the hash table has been built, only applicable if we are doing spillover)

Second, if the left input to the hash join node is slow we may want to pause reading from the right input while we wait for the left input to catch up (I may have this backwards).  This is useful even if we don't have spillover.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)