[I] Push down (scalar) filters down to Parquet encoders [arrow-rs]

["Dandandan (via GitHub)" <gi...@apache.org>]

Dandandan opened a new issue, #9442:
URL: https://github.com/apache/arrow-rs/issues/9442

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   Currently we always decode the 
   
   **Describe the solution you'd like**
   
   We can push down certain operations (e.g. scalar equality / inequality) down to the (dictionary / RLE) encoders.
   As we only have to consider the dictionary values, we can make this much more efficient than having to work on the decoded data (and e.g. avoiding creating string views).
   
   In a quick test this seems  saving 10-20% time on various queries in the `arrow_reader_clickbench` benchmarks.
   
   **Describe alternatives you've considered**
   **Additional context**
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Push down (scalar) filters down to Parquet encoders [arrow-rs]

["lyang24 (via GitHub)" <gi...@apache.org>]

lyang24 commented on issue #9442:
URL: https://github.com/apache/arrow-rs/issues/9442#issuecomment-3939123502

   take


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org