You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Mike Seddon (Jira)" <ji...@apache.org> on 2021/02/18 07:11:00 UTC

[jira] [Created] (ARROW-11687) [Rust][DataFusion] RepartitionExec Hanging

Mike Seddon created ARROW-11687:
-----------------------------------

             Summary: [Rust][DataFusion] RepartitionExec Hanging
                 Key: ARROW-11687
                 URL: https://issues.apache.org/jira/browse/ARROW-11687
             Project: Apache Arrow
          Issue Type: Bug
            Reporter: Mike Seddon
            Assignee: Mike Seddon


Found an interesting defect where the final partition of the `RepartitionExec::execute` thread spawner was consistently not being spawned via `tokio::spawn`. This meant that `RepartitionStream::poll_next` was sitting waiting forever for data that never arrived.

It looks like a race condition where the `JoinHandle` was not being `await`ed and something strange going on with the internals of tokio like lazy evaluation?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)