[arrow-rs] branch master updated: Fix reading gzip file with multiple gzip headers in parquet-fromcsv. (#4419)

[tu...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

tustvold pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git


The following commit(s) were added to refs/heads/master by this push:
     new 993a7cc46 Fix reading gzip file with multiple gzip headers in parquet-fromcsv. (#4419)
993a7cc46 is described below

commit 993a7cc4688b380e1c4d2af44903ecd0673f4645
Author: Gert Hulselmans <ge...@kuleuven.be>
AuthorDate: Fri Jun 16 07:55:38 2023 +0200

    Fix reading gzip file with multiple gzip headers in parquet-fromcsv. (#4419)
    
    Fix reading gzip file with multiple gzip headers in parquet-fromcsv.
    
    Closes: #4173
---
 parquet/src/bin/parquet-fromcsv.rs | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/parquet/src/bin/parquet-fromcsv.rs b/parquet/src/bin/parquet-fromcsv.rs
index f2a911c00..1ff6fecf5 100644
--- a/parquet/src/bin/parquet-fromcsv.rs
+++ b/parquet/src/bin/parquet-fromcsv.rs
@@ -381,7 +381,7 @@ fn convert_csv_to_parquet(args: &Args) -> Result<(), ParquetFromCsvError> {
             Box::new(snap::read::FrameDecoder::new(input_file)) as Box<dyn Read>
         }
         Compression::GZIP(_) => {
-            Box::new(flate2::read::GzDecoder::new(input_file)) as Box<dyn Read>
+            Box::new(flate2::read::MultiGzDecoder::new(input_file)) as Box<dyn Read>
         }
         Compression::BROTLI(_) => {
             Box::new(brotli::Decompressor::new(input_file, 0)) as Box<dyn Read>