You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by al...@apache.org on 2025/09/05 18:39:14 UTC
(datafusion) branch main updated: Re-enable page index for encrypted Parquet (#17426)
This is an automated email from the ASF dual-hosted git repository.
alamb pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/main by this push:
new ec4413e7d7 Re-enable page index for encrypted Parquet (#17426)
ec4413e7d7 is described below
commit ec4413e7d7b41c381c98eda909e5ab650be4c5e5
Author: Adam Reeve <ad...@gr-oss.io>
AuthorDate: Sat Sep 6 06:39:10 2025 +1200
Re-enable page index for encrypted Parquet (#17426)
---
datafusion/datasource-parquet/src/opener.rs | 7 +------
1 file changed, 1 insertion(+), 6 deletions(-)
diff --git a/datafusion/datasource-parquet/src/opener.rs b/datafusion/datasource-parquet/src/opener.rs
index 7ae3f83b77..93a3d4af54 100644
--- a/datafusion/datasource-parquet/src/opener.rs
+++ b/datafusion/datasource-parquet/src/opener.rs
@@ -150,18 +150,13 @@ impl FileOpener for ParquetOpener {
let expr_adapter_factory = self.expr_adapter_factory.clone();
let mut predicate_file_schema = Arc::clone(&self.logical_file_schema);
- let mut enable_page_index = self.enable_page_index;
+ let enable_page_index = self.enable_page_index;
let encryption_context = self.get_encryption_context();
Ok(Box::pin(async move {
let file_decryption_properties = encryption_context
.get_file_decryption_properties(&file_location)
.await?;
- // For now, page index does not work with encrypted files. See:
- // https://github.com/apache/arrow-rs/issues/7629
- if file_decryption_properties.is_some() {
- enable_page_index = false;
- }
// Prune this file using the file level statistics and partition values.
// Since dynamic filters may have been updated since planning it is possible that we are able
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org