You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@couchdb.apache.org by James Marca <jm...@translab.its.uci.edu> on 2009/11/25 21:24:03 UTC

view compaction gives me a factor of 10 reduction in storage space required

Hi All,

As a follow-up to a question I asked earlier about view cleanup,  the
reply included a note that there was a view compaction api call.
I tried it and it worked really well for me.  I saw a factor of 10
reduction in the storage space:

Before:

james@lysithia ~ $ ls -lrth /data/couchdb/.d12_2007_06morehash_design/
total 65G
-rw-r--r-- 1 couchdb couchdb 26G 2009-11-23 15:55 172235a8f385d7dc0e0818e5d003aad2.view
-rw-r--r-- 1 couchdb couchdb 39G 2009-11-23 15:55 433c5bd5313e5509b96b67a6eb3d1145.view

james@lysithia ~ $ ls -lrth /data/couchdb/.d12_2007_05morehash_design/
total 67G
-rw-r--r-- 1 couchdb couchdb 27G 2009-11-23 15:44 fac1d532c1edf011f15a08b0e9e64bd1.view
-rw-r--r-- 1 couchdb couchdb 40G 2009-11-23 15:44 433c5bd5313e5509b96b67a6eb3d1145.view

After:

james@lysithia ~ $ ls -lrth /data/couchdb/.d12_2007_06morehash_design/
total 6.1G
-rw-r--r-- 1 couchdb couchdb 2.8G 2009-11-23 19:09 172235a8f385d7dc0e0818e5d003aad2.view
-rw-r--r-- 1 couchdb couchdb 3.4G 2009-11-23 20:35 433c5bd5313e5509b96b67a6eb3d1145.view

james@lysithia ~ $ ls -lrth /data/couchdb/.d12_2007_05morehash_design/
total 6.2G
-rw-r--r-- 1 couchdb couchdb 2.8G 2009-11-23 19:25 fac1d532c1edf011f15a08b0e9e64bd1.view
-rw-r--r-- 1 couchdb couchdb 3.5G 2009-11-23 20:35 433c5bd5313e5509b96b67a6eb3d1145.view

Regards,
James Marca

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.


Re: view compaction gives me a factor of 10 reduction in storage space required

Posted by Adam Kocoloski <ko...@apache.org>.
On Nov 25, 2009, at 3:24 PM, James Marca wrote:

> Hi All,
> 
> As a follow-up to a question I asked earlier about view cleanup,  the
> reply included a note that there was a view compaction api call.
> I tried it and it worked really well for me.  I saw a factor of 10
> reduction in the storage space:

Yep, sounds about right to me.  Access times should improve after compaction, too, because there are fewer irrelevant parts of the view file, and thus the kernel does a more efficient job of caching it.  Best,

Adam