You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/05/02 11:16:19 UTC

[GitHub] [arrow-rs] jorgecarleitao commented on issue #200: Use iterators to increase performance of creating Arrow arrays

jorgecarleitao commented on issue #200:
URL: https://github.com/apache/arrow-rs/issues/200#issuecomment-830792750


   I have been following it and I think this makes a lot of sense; I think we are fully aligned.
   
   fwiw parquet2 uses an equivalent approach, AFAI understood, the difference is that it expects uncompressed pages on the iterator and performs all CPU-intensive operations inside the iteration. Regardless, I think that this is definitely something to PR and merge.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org