(datafusion-comet) branch main updated: pref: New Configuration from shared conf to avoid high costs (#2402)

[mb...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

mbutrovich pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git


The following commit(s) were added to refs/heads/main by this push:
     new 5b10b9f61 pref: New Configuration from shared conf to avoid high costs (#2402)
5b10b9f61 is described below

commit 5b10b9f6194e15bbba382f335be9cd5d0ff5b81d
Author: Zhen Wang <64...@qq.com>
AuthorDate: Tue Sep 16 22:44:29 2025 +0800

    pref: New Configuration from shared conf to avoid high costs (#2402)
---
 common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java b/common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java
index 7595242c3..5c56e332b 100644
--- a/common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java
+++ b/common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java
@@ -433,7 +433,7 @@ public class NativeBatchReader extends RecordReader<Void, ColumnarBatch> impleme
   private ParquetColumn getParquetColumn(MessageType schema, StructType sparkSchema) {
     // We use a different config from the config that is passed in.
     // This follows the setting  used in Spark's SpecificParquetRecordReaderBase
-    Configuration config = new Configuration();
+    Configuration config = new Configuration(conf);
     config.setBoolean(SQLConf.PARQUET_BINARY_AS_STRING().key(), false);
     config.setBoolean(SQLConf.PARQUET_INT96_AS_TIMESTAMP().key(), false);
     config.setBoolean(SQLConf.CASE_SENSITIVE().key(), false);


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org