You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2026/04/16 13:58:53 UTC

Re: [I] Support Morsel output for Parquet known to be non blocking [datafusion]

alamb commented on issue #21598:
URL: https://github.com/apache/datafusion/issues/21598#issuecomment-4260640449

   Actually, I was poking around the API in the context of https://github.com/apache/arrow-rs/pull/9697 and I actually think we have the API we needed for this:
   
   https://docs.rs/parquet/58.0.0/parquet/arrow/push_decoder/struct.ParquetPushDecoder.html#method.try_next_reader
   
   So the idea is that a morsel planner could call try_next_reader and retrn that as the morsel 🤔 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org