[GitHub] jiangpengcheng opened a new issue #3071: delete old activations doesn't free disk space

[GitBox <gi...@apache.org>]

jiangpengcheng opened a new issue #3071: delete old activations doesn't free disk space
URL: https://github.com/apache/incubator-openwhisk/issues/3071
 
 
   the `delete` in couchdb is an `update` actually, so it will increase the usage of disk space, and while the `purge` is not implemented in couchdb right now, looks like we have no way to free the disk space.
   
   I do a test to insert 10 millions documents to couchdb, and delete them later, below is my test result:
   
   ## before insert:
   ```
   root@bf83420db0ec:/opt/couchdb# du -h --max-depth=1
   64K    ./bin
   5.8M    ./erts-6.2
   40K    ./etc
   19M    ./lib
   244K    ./releases
   3.2M    ./share
   0      ./var
   7.5M    ./data
   36M    .
   ```
   
   ## after insert 10 millions documents:
   ```
   root@bf83420db0ec:/opt/couchdb# du -h --max-depth=1
   64K    ./bin
   5.8M    ./erts-6.2
   40K    ./etc
   19M    ./lib
   244K    ./releases
   3.2M    ./share
   0      ./var
   2.1G    ./data
   2.2G    .
   ```
   
   ## after create the `activations/byDate` view:
   ```
   root@bf83420db0ec:/opt/couchdb# du -h --max-depth=1
   64K    ./bin
   5.8M    ./erts-6.2
   40K    ./etc
   19M    ./lib
   244K    ./releases
   3.2M    ./share
   0      ./var
   4.6G    ./data
   4.6G    .
   ```
   
   ## after delete all test documents(the used space increase)
   ```
   root@bf83420db0ec:/opt/couchdb# du -h --max-depth=1
   64K    ./bin
   5.8M    ./erts-6.2
   40K    ./etc
   19M    ./lib
   244K    ./releases
   3.2M    ./share
   0      ./var
   6.9G    ./data
   6.9G    .
   ```
   
   ### after compact db
   ```
   root@bf83420db0ec:/opt/couchdb# du -h --max-depth=1
   64K    ./bin
   5.8M    ./erts-6.2
   40K    ./etc
   19M    ./lib
   244K    ./releases
   3.2M    ./share
   0      ./var
   4.5G    ./data
   4.5G    .
   ```
   
   
   ### after compact view
   ```
   root@bf83420db0ec:/opt/couchdb# du -h --max-depth=1
   64K    ./bin
   5.8M    ./erts-6.2
   40K    ./etc
   19M    ./lib
   244K    ./releases
   3.2M    ./share
   0      ./var
   2.3G    ./data
   2.3G    .
   ```
   
   So even after compact the db and view, the usage of disk size doesn't reduce a lot(it is bigger instead)
   
   I know this is related to couchdb, but I wonder if there are someone has some experience to solve this problem.
   
   This can be a problem in the production environment as the used disk size will keep growing

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services