[jira] [Created] (JENA-744) Error importing from large gzip

["Michael Kozakov (JIRA)" <ji...@apache.org>]

Michael Kozakov created JENA-744:
------------------------------------

             Summary: Error importing from large gzip
                 Key: JENA-744
                 URL: https://issues.apache.org/jira/browse/JENA-744
             Project: Apache Jena
          Issue Type: Bug
          Components: TDB
            Reporter: Michael Kozakov
         Attachments: gzip.png

gzip has a documented bug: 

http://www.freebsd.org/cgi/man.cgi?query=gzip#end

"According to RFC 1952, the	recorded file size is stored in	a 32-bit inte-
     ger, therefore, it	can not	represent files	larger than 4GB.  This limita-
     tion also applies to -l option of gzip utility."

As a result, a 26gb compressed gz shows that the uncompressed size is 1.6gb. (screenshot attached)

It seems like tdbloader relies on this information to know when to stop importing, and as a result, the database is incomplete. In other words, I have to extract the archive before using tdbloader to import the database, otherwise it will be missing the majority of items.



--
This message was sent by Atlassian JIRA
(v6.2#6252)