You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/06/05 09:56:37 UTC

[GitHub] [arrow-datafusion] nevi-me opened a new issue #507: Support pruning on string columns using starts_with

nevi-me opened a new issue #507:
URL: https://github.com/apache/arrow-datafusion/issues/507


   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   
   From looking at the pruning logic, it appears that we can prune inputs based on `col = 'string_value'`, but we can't prune on `col LIKE 'value%'`.
   
   We should be able to support `LIKE` and `NOT LIKE`.
   
   **Describe the solution you'd like**
   
   Extend the pruning logic to generate a pruning filter for `LIKE` and `NOT LIKE`.
   
   **Describe alternatives you've considered**
   
   None
   
   **Additional context**
   
   Spark will push down a `LIKE` filter if it can be converted to a `starts_with`, normally by checking if the string doesn't start with `%`. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org