You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "metesynnada (via GitHub)" <gi...@apache.org> on 2023/03/17 07:28:12 UTC

[GitHub] [arrow-datafusion] metesynnada opened a new pull request, #5629: Update default behaviour of compression algorithms

metesynnada opened a new pull request, #5629:
URL: https://github.com/apache/arrow-datafusion/pull/5629

   # Which issue does this PR close?
   
   Closes #5628.
   
   # Rationale for this change
   
   Support larger compressed files with multi-members.
   
   # What changes are included in this PR?
   
   Changing `convert_read`
   
   # Are these changes tested?
   
   Yes
   
   # Are there any user-facing changes?
   
   No


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] alamb merged pull request #5629: Update default behaviour of compression algorithms (support multistreams)

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb merged PR #5629:
URL: https://github.com/apache/arrow-datafusion/pull/5629


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] alamb commented on a diff in pull request #5629: Update default behaviour of compression algorithms (support multistreams)

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on code in PR #5629:
URL: https://github.com/apache/arrow-datafusion/pull/5629#discussion_r1140117223


##########
datafusion/core/src/datasource/file_format/file_type.rs:
##########
@@ -30,10 +30,10 @@ use async_compression::tokio::bufread::{
 };
 use bytes::Bytes;
 #[cfg(feature = "compression")]
-use bzip2::read::BzDecoder;
+use bzip2::read::MultiBzDecoder;

Review Comment:
   https://docs.rs/bzip2/0.4.4/bzip2/read/struct.MultiBzDecoder.html 👍 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org