You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2020/10/06 19:51:00 UTC
[jira] [Commented] (ARROW-10183) Create a ForEach library function
that runs on an iterator of futures
[ https://issues.apache.org/jira/browse/ARROW-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209104#comment-17209104 ]
Weston Pace commented on ARROW-10183:
-------------------------------------
This is also a bit of a mental investigation on my part to be sure this can be done without exploding the stack. Since this is essentially iterator.next().then(iterator.next().then(iterator.next().then(... My understanding is that it can, and there are numerous articles on continuations and avoiding stack busting while doing this kind of thing. I have yet to synthesize all that knowledge and put it into practice.
> Create a ForEach library function that runs on an iterator of futures
> ---------------------------------------------------------------------
>
> Key: ARROW-10183
> URL: https://issues.apache.org/jira/browse/ARROW-10183
> Project: Apache Arrow
> Issue Type: Sub-task
> Reporter: Weston Pace
> Priority: Major
>
> This method should take in an iterator of futures and a callback and pull an item off the iterator, "await" it, run the callback on it, and then fetch the next item from the iterator.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)