[GitHub] ondra-novak opened a new issue #1010: Compaction of a heavily updated view - file descriptor leak (known as ".deleted" issue)

[GitBox <gi...@apache.org>]

ondra-novak opened a new issue #1010: Compaction of a heavily updated view - file descriptor leak (known as ".deleted" issue)
URL: https://github.com/apache/couchdb/issues/1010
 
 
   Race condition can cause that compaction of heavily update view leads to file descriptor leak. The leaked descriptor is shown as deleted file, which still consumes the space on the storage device.
   
   It is very hard to reproduce, currently I am unable to make easy example which would reproduce the issue. But the bug is there, i was able to record in on a video (twice in row)
   
   https://youtu.be/dQb7Fm3gAUQ
   
   Please fix it as soon as possible, because it is real problem. I also found, that this problem was reported in earlier versions 
   
   https://issues.apache.org/jira/browse/COUCHDB-1652 (version 1.2)
   
   The bug can be reproduced on the version 1.7.1. The recorded version is 1.6.0
   
   
   
   ## Expected Behavior
   No files should left open
   
   ## Current Behavior
   Deleted files left open after compaction
   
   ## Possible Solution
   
   
   ## Steps to Reproduce (for bugs)
   It is hard to reproduce. The view is heavily updated. The bug is not triggered always. It seems that
   it happens during "Restarting" phase.
   
   
   
   ```
   [Sun, 19 Nov 2017 20:54:14 GMT] [info] [<0.4067.0>] Compaction restarting for db: btcusd-orders idx: _design/index
   [Sun, 19 Nov 2017 20:54:14 GMT] [info] [<0.4067.0>] Compaction started for db: btcusd-orders idx: _design/index
   [Sun, 19 Nov 2017 20:54:14 GMT] [info] [<0.4067.0>] Compaction finished for db: btcusd-orders idx: _design/index
   
   ```
   
   The bug is only the view related, not database related
   
   I am going to continue in investigation. Please do not wait, and start to locate bug using currently known information.
   
   ## Context
   
   ## Your Environment
   Recorded on 1.6.0
   Ubuntu 16.04
   
   Thank You!

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services