You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by xi...@apache.org on 2021/02/03 01:01:21 UTC

[incubator-pinot] branch fixing_big_tar_gz_file_issue created (now 9fa79be)

This is an automated email from the ASF dual-hosted git repository.

xiangfu pushed a change to branch fixing_big_tar_gz_file_issue
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


      at 9fa79be  Allow tar gz with > 8gb size

This branch includes the following new commits:

     new 9fa79be  Allow tar gz with > 8gb size

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[incubator-pinot] 01/01: Allow tar gz with > 8gb size

Posted by xi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

xiangfu pushed a commit to branch fixing_big_tar_gz_file_issue
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git

commit 9fa79be8e6d68ce91f2561dc8f8130fe34fa53ed
Author: Xiang Fu <fx...@gmail.com>
AuthorDate: Tue Feb 2 16:59:31 2021 -0800

    Allow tar gz with > 8gb size
---
 .../main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java   | 1 +
 1 file changed, 1 insertion(+)

diff --git a/pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java b/pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java
index 40aee31..bb2da81 100644
--- a/pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java
+++ b/pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java
@@ -62,6 +62,7 @@ public class TarGzCompressionUtils {
         BufferedOutputStream bufferedOut = new BufferedOutputStream(fileOut);
         OutputStream gzipOut = new GzipCompressorOutputStream(bufferedOut);
         TarArchiveOutputStream tarGzOut = new TarArchiveOutputStream(gzipOut)) {
+      tarGzOut.setBigNumberMode(TarArchiveOutputStream.BIGNUMBER_STAR);
       tarGzOut.setLongFileMode(TarArchiveOutputStream.LONGFILE_GNU);
       addFileToTarGz(tarGzOut, inputFile, "");
     }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org