You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2020/10/06 19:51:00 UTC

[jira] [Commented] (ARROW-10183) Create a ForEach library function that runs on an iterator of futures

    [ https://issues.apache.org/jira/browse/ARROW-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209104#comment-17209104 ] 

Weston Pace commented on ARROW-10183:
-------------------------------------

This is also a bit of a mental investigation on my part to be sure this can be done without exploding the stack.  Since this is essentially iterator.next().then(iterator.next().then(iterator.next().then(...  My understanding is that it can, and there are numerous articles on continuations and avoiding stack busting while doing this kind of thing.  I have yet to synthesize all that knowledge and put it into practice.

> Create a ForEach library function that runs on an iterator of futures
> ---------------------------------------------------------------------
>
>                 Key: ARROW-10183
>                 URL: https://issues.apache.org/jira/browse/ARROW-10183
>             Project: Apache Arrow
>          Issue Type: Sub-task
>            Reporter: Weston Pace
>            Priority: Major
>
> This method should take in an iterator of futures and a callback and pull an item off the iterator, "await" it, run the callback on it, and then fetch the next item from the iterator.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)