You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "lyne7-sc (via GitHub)" <gi...@apache.org> on 2026/05/27 12:33:23 UTC

[I] LIKE 'prefix%' pruning fails on Utf8View and LargeUtf8 columns [datafusion]

lyne7-sc opened a new issue, #22561:
URL: https://github.com/apache/datafusion/issues/22561

   ### Describe the bug
   
   `LIKE 'prefix%'` predicates produce `predicate_evaluation_errors` on `Utf8View` and `LargeUtf8` columns, causing row group and page index pruning to be skipped entirely.
   
   ```
   predicate=name@1 LIKE B%
   pruning_predicate=name_null_count@2 != row_count@3 AND name_min@0 <= C AND B <= name_max@1
   row_groups_pruned_statistics=0 total → 0 matched
   page_index_pag
   page_index_rows_pruned=4.17 M total → 4.17 M matched
   bytes_scanned=29.68 M
   num_predicate_creation_errors=12
   predicate_evaluation_errors=20
   ```
   
   LargeUtf8 columns are affected for the same reason.
   
   ### To Reproduce
   
   Any Parquet file with a string column, using default settings:
   
   ```
   CREATE EXTERNAL TABLE t STORED AS PARQUET LOCATION test.parquet;
   EXPLAIN ANALYZE SELECT COUNT(*) FROM t WHERE str_col LIKE 'a%';
   ```
   
   ### Expected behavior
   
   LIKE 'prefix%' predicates should produce the same row group statistics and page index pruning that they do for Utf8 columns.
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] LIKE 'prefix%' pruning fails on Utf8View and LargeUtf8 columns [datafusion]

Posted by "lyne7-sc (via GitHub)" <gi...@apache.org>.
lyne7-sc commented on issue #22561:
URL: https://github.com/apache/datafusion/issues/22561#issuecomment-4554555135

   take


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] LIKE 'prefix%' pruning fails on Utf8View and LargeUtf8 columns [datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #22561: LIKE 'prefix%' pruning fails on Utf8View and LargeUtf8 columns
URL: https://github.com/apache/datafusion/issues/22561


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org