[I] `ExecutionOptions::ignore_subdirectory` skipping hive style partitions [arrow-datafusion]

["esheppa (via GitHub)" <gi...@apache.org>]

esheppa opened a new issue, #9206:
URL: https://github.com/apache/arrow-datafusion/issues/9206

   ### Describe the bug
   
   In the [documentation](https://docs.rs/datafusion/latest/datafusion/common/config/struct.ExecutionOptions.html#structfield.listing_table_ignore_subdirectory) `ignore_subdirectory` defaults to true, meaning sub directories are skipped, but only if they are not hive partitions. Currently all subdirectories including hive partitions are skipped.
   
   ### To Reproduce
   
   
   ```rust
   let url = ListingTableUrl::parse("file:///var/data/mytable/").unwrap();
   
   assert!(url.contains(
       &Path::parse("/var/data/mytable/year=2024/data.parquet").unwrap(),
       true
   ));
   
   ```
   
   ### Expected behavior
   
   the assertion should pass, but it currently does not
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] `ExecutionOptions::ignore_subdirectory` skipping hive style partitions [arrow-datafusion]

["alamb (via GitHub)" <gi...@apache.org>]

alamb closed issue #9206: `ExecutionOptions::ignore_subdirectory` skipping hive style partitions
URL: https://github.com/apache/arrow-datafusion/issues/9206


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org