You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/10/29 16:01:58 UTC

[GitHub] [arrow-datafusion] Ted-Jiang commented on issue #4002: Wrong results when parquet page index filtering is enabled

Ted-Jiang commented on issue #4002:
URL: https://github.com/apache/arrow-datafusion/issues/4002#issuecomment-1295882864

   @alamb find error in my local branch 
   ```❯ select count(*) from foo where container = 'backend_container_1';
   
   [2022-10-29T15:51:31Z ERROR datafusion::physical_plan::file_format::parquet] 
   Error evaluating page index predicate values Error during planning: 
   Can not create statistics record batch: Invalid argument error:
      Column 'container_min' is declared as non-nullable but contains null values
   ```
   Seems can not create  batch in `build_statistics_record_batch`  will `NULL` valuse. 
   Because `container` col:
   ```
   container:           REQUIRED BINARY L:STRING R:0 D:0
   ```
   now not support `BINARY` type which will return a null array now, will add a fallback .
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org