You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Thorsten Schöning <ts...@am-soft.de> on 2018/12/12 09:40:32 UTC
Are my repos properly using ZLIB compression level 9?
Hi all,
I upgraded all my repos using dump/load and changed the compression
settings to use ZLIB 9, because I manage some pretty good compressable
files at a low commit rate and want to preserve as much storage as
possible for those. I used the following version of svnadmin and
changed the following setting in fsfs.conf only:
> svnadmin, Version 1.9.3 (r1718519)
> [deltification]
> compression-level = 9
Overall memory of all my repos dropped significantly, so I guess
thinks work as expected. But I didn't have a look at each individual
revision file, instead I simply committed some textual changes in some
text file in some test repo and found clear, readable text as DELTA in
the created revision file on the server.
Is this expected behaviour? I would have thought that all datas are
unreadable because of compression. Or is there some threshold or such?
What do I need to look for to make sure that ZLIB 9 is used?
Thanks!
Mit freundlichen Grüßen,
Thorsten Schöning
--
Thorsten Schöning E-Mail: Thorsten.Schoening@AM-SoFT.de
AM-SoFT IT-Systeme http://www.AM-SoFT.de/
Telefon...........05151- 9468- 55
Fax...............05151- 9468- 88
Mobil..............0178-8 9468- 04
AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln
AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow
Re: Are my repos properly using ZLIB compression level 9?
Posted by Branko Čibej <br...@apache.org>.
On 12.12.2018 10:40, Thorsten Schöning wrote:
> Hi all,
>
> I upgraded all my repos using dump/load and changed the compression
> settings to use ZLIB 9, because I manage some pretty good compressable
> files at a low commit rate and want to preserve as much storage as
> possible for those. I used the following version of svnadmin and
> changed the following setting in fsfs.conf only:
>
>> svnadmin, Version 1.9.3 (r1718519)
>> [deltification]
>> compression-level = 9
> Overall memory of all my repos dropped significantly,
^^^ this is a pretty good indicator that "something" is working as you
expect. :)
> so I guess
> thinks work as expected. But I didn't have a look at each individual
> revision file, instead I simply committed some textual changes in some
> text file in some test repo and found clear, readable text as DELTA in
> the created revision file on the server.
>
> Is this expected behaviour? I would have thought that all datas are
> unreadable because of compression. Or is there some threshold or such?
> What do I need to look for to make sure that ZLIB 9 is used?
In general, you can't just look at the compressed data and guess what
the compression level setting was.
Regarding plain text in "compressed" data, it really depends on the size
of the changes and type of data. Many compression algorithms — including
the text-delta algorithm used by Subversion, and I presume ZLIB, too —
will at some point decide that it makes no sense to try compressing some
parts of the data, because the compressed representation would be larger
than the plain source (due to overhead for dictionaries etc.). However
if you're seeing pages of uncompressed plain text, then we'll have to
investigate further.
-- Brane
Re: Are my repos properly using ZLIB compression level 9?
Posted by Thorsten Schöning <ts...@am-soft.de>.
Guten Tag Mark Phippard,
am Mittwoch, 12. Dezember 2018 um 14:21 schrieben Sie:
> Are you saying you are seeing the word DELTA or you are seeing this
> word + your plain text source code?[...]
The latter and Brane's explanation sounds reasonable: My test commit
was simply damn small. :-) I've attached the DIFF and revision file
for reference, forgot it before, but don't think anymore that there's
any problem.
Thanks to both of you!
Mit freundlichen Grüßen,
Thorsten Schöning
--
Thorsten Schöning E-Mail: Thorsten.Schoening@AM-SoFT.de
AM-SoFT IT-Systeme http://www.AM-SoFT.de/
Telefon...........05151- 9468- 55
Fax...............05151- 9468- 88
Mobil..............0178-8 9468- 04
AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln
AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow
Re: Are my repos properly using ZLIB compression level 9?
Posted by Mark Phippard <ma...@gmail.com>.
On Wed, Dec 12, 2018 at 4:40 AM Thorsten Schöning <ts...@am-soft.de>
wrote:
> revision file, instead I simply committed some textual changes in some
> text file in some test repo and found clear, readable text as DELTA in
> the created revision file on the server.
>
Are you saying you are seeing the word DELTA or you are seeing this word +
your plain text source code? Because I believe the former is expected. I
think the compression only applies to your revision content, not the
metadata that SVN adds to the revision files.
If it is the latter, then probably Brane's explanation is the reason.
--
Thanks
Mark Phippard
http://markphip.blogspot.com/