You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@commons.apache.org by "Stefan Bodewig (JIRA)" <ji...@apache.org> on 2018/10/08 06:02:00 UTC
[jira] [Updated] (COMPRESS-466) Opening of a very large zip file is
extremely slow compared to java.util.zip.ZipFile
[ https://issues.apache.org/jira/browse/COMPRESS-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stefan Bodewig updated COMPRESS-466:
------------------------------------
Issue Type: Improvement (was: Bug)
> Opening of a very large zip file is extremely slow compared to java.util.zip.ZipFile
> ------------------------------------------------------------------------------------
>
> Key: COMPRESS-466
> URL: https://issues.apache.org/jira/browse/COMPRESS-466
> Project: Commons Compress
> Issue Type: Improvement
> Components: Compressors
> Affects Versions: 1.18
> Environment: Tested both on Linux and OSX 10.13.6.
> Reporter: Jakob Sultan Ericsson
> Priority: Major
> Fix For: 1.19
>
>
> We have a quite large zip file 35 gb and try to open this with ZipFile.
> {code:java}
> try (ZipFile zf = new ZipFile(new File("35gb.zip"))) {
> System.out.println("File opened..." + (System.currentTimeMillis() - start));
> }
> {code}
> This code takes about 300 000 - 400 000 ms (5-6 minutes).
> If I run this with JDK-builtin java.util.zip.ZipFile, same code takes 300 ms (less than a second).
> I'm not totally sure what it is the problem but I did some debugging and basically all time is spent in
> {code:java}
> private void resolveLocalFileHeaderData(final Map<ZipArchiveEntry, NameAndComment> entriesWithoutUTF8Flag)
> {code}
> Anything that can be done to improve this?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)