You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2025/08/11 12:05:51 UTC

Re: [I] Decouple IO and CPU operations in the Parquet Reader (push decoder) [arrow-rs]

alamb commented on issue #7983:
URL: https://github.com/apache/arrow-rs/issues/7983#issuecomment-3174484286

   > I guess: you push bytes into the decoder (by polling its state), vs the decoder pulls bytes from a stream
   
   Yes, exactly, I think this is the intention. 
   
   The Json `Decoder` in this crate https://docs.rs/arrow-json/56.0.0/arrow_json/reader/struct.Decoder.html also uses a similar terminology:
   
   > The push-based interface facilitates integration with sources that yield arbitrarily delimited bytes ranges, such as [BufRead](https://doc.rust-lang.org/nightly/std/io/trait.BufRead.html), or a chunked byte stream received from object storage


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org