You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@couchdb.apache.org by "Russell van der Walt (JIRA)" <ji...@apache.org> on 2010/10/26 10:26:21 UTC

[jira] Created: (COUCHDB-926) Compaction does not release file descriptors

Compaction does not release file descriptors
--------------------------------------------

                 Key: COUCHDB-926
                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
             Project: CouchDB
          Issue Type: Bug
          Components: Database Core
    Affects Versions: 1.0.1
         Environment: Ubuntu 9.04/10.4
            Reporter: Russell van der Walt


When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.

There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Paul Joseph Davis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paul Joseph Davis updated COUCHDB-926:
--------------------------------------

    Skill Level: Committers Level (Medium to Hard)

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Adam Kocoloski (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12924961#action_12924961 ] 

Adam Kocoloski commented on COUCHDB-926:
----------------------------------------

Do you have views on the database?  How reproducible is the problem?  If you perform restart the server and compact the database without querying any views are the old file descriptors released?

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Russell van der Walt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925359#action_12925359 ] 

Russell van der Walt commented on COUCHDB-926:
----------------------------------------------

I'm not sure that it is always the case, as in my first test, only the database wasn't released.

The script is in C# using the Divan library, but I'm sure you'll get the gist of it:


            var dbname =  "storage-test";
            var server = new CouchServer("192.168.1.21");
            if (server.HasDatabase(dbname)) 
                server.DeleteDatabase(dbname);
    
            var database = server.GetNewDatabase(dbname);

            var design = database.NewDesignDocument("attached");
            design.AddView("id", @" function(doc) { if (doc.type && doc.type == 'telemetry') { emit(doc.id, null); } }");
            database.WriteDocument(design);

            var id = Guid.NewGuid().ToString();

            using (var timer = new LoopTimer("records")) {
                var terminated = false;
                while (!terminated) {

                    var item = new {
                        id = id,
                        ownerId = Guid.Empty,
                        originId = Guid.NewGuid(),
                        linked = new Guid[] { Guid.NewGuid(), Guid.NewGuid() },
                        date = DateTime.Now.ToUniversalTime(),
                        received = DateTime.Now.ToUniversalTime(),
                        active = true,
                        status = new string[] { "ignition_on" },
                        type = "record"
                    };

                    database.TouchView("attached", "id");

                    var doc = database.GetDocument(id);
                    if (doc != null) {
                        database.SaveDocument(new CouchJsonDocument(Json.Encode(item), id, doc.Rev));
                    } else
                        database.SaveDocument(new CouchJsonDocument(Json.Encode(item), id));

                    timer.Increment();
                    terminated = Console.KeyAvailable;
                    
                }
            }

            Console.ReadKey();
            Console.WriteLine("Press any key to compact");
            Console.ReadLine();

            database.Compact(true); // compact database and views




> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Russell van der Walt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925295#action_12925295 ] 

Russell van der Walt commented on COUCHDB-926:
----------------------------------------------

Sorry, I just realized I didn't actually answer your last question.

Having dug around a bit more, I can confirm that it only if the view file is open.

If you compact the database without opening the database after a restart, no problem.
If you compact the database after opening it, but not querying any of the views, no problem.

If however you compact after querying a view, file handles are left behind.

If appears that both views and database files are left behind:

Before compaction:

root@ubuntu904:~# lsof | grep -P 'COMMAND|/var/data/couchdb/'
COMMAND     PID       USER   FD      TYPE             DEVICE      SIZE       NODE NAME
beam      22022       root   13u      REG              252,0      4185    3653752 /var/data/couchdb/_users.couch
beam      22022       root   20u      REG              252,0  18128988    3653679 /var/data/couchdb/storage-test.couch
beam      22022       root   21u      REG              252,0     12377    3884278 /var/data/couchdb/.storage-test_design/800b1d5fe6334f272f2a8ad9feb9e0d9.view

After compaction:

root@ubuntu904:~# lsof | grep -P 'COMMAND|/var/data/couchdb/'
COMMAND     PID       USER   FD      TYPE             DEVICE      SIZE       NODE NAME
beam      22022       root   13u      REG              252,0      4185    3653752 /var/data/couchdb/_users.couch
beam      22022       root   20u      REG              252,0  18128988    3653679 /var/data/couchdb/.delete/3d7816bb09602b0ac9092e1d9fba9172 (deleted)
beam      22022       root   21u      REG              252,0     12377    3884278 /var/data/couchdb/.delete/cb1436e9818a0fde236d7e130cf02fbe (deleted)
beam      22022       root   23u      REG              252,0      4185    3884279 /var/data/couchdb/.storage-test_design/800b1d5fe6334f272f2a8ad9feb9e0d9.view
beam      22022       root   25u      REG              252,0     32860    3654908 /var/data/couchdb/storage-test.couch


> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Adam Kocoloski (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925357#action_12925357 ] 

Adam Kocoloski commented on COUCHDB-926:
----------------------------------------

Oh, now that's interesting - both views and DBs are not being released.

Can you share the script?

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Adam Kocoloski (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12976051#action_12976051 ] 

Adam Kocoloski commented on COUCHDB-926:
----------------------------------------

Hi Mathias, Filipe already backported the fix to the 1.0.x branch. It will be included in 1.0.2.

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>            Assignee: Filipe Manana
>             Fix For: 1.0.2, 1.1
>
>         Attachments: test_comp.sh
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Russell van der Walt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12924976#action_12924976 ] 

Russell van der Walt commented on COUCHDB-926:
----------------------------------------------

Yes, the database has views and it happens always. I'm not sure about whether the querying has any effect, but I will put together a test case tomorrow and let you know.

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Adam Kocoloski (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925013#action_12925013 ] 

Adam Kocoloski commented on COUCHDB-926:
----------------------------------------

Thanks Russell.  One of the patches that has been discussed dealt explicitly with view queries, so if the problem persists without any queries we'll know we need to look elsewhere to track it down.

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Filipe Manana (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Filipe Manana reassigned COUCHDB-926:
-------------------------------------

    Assignee: Filipe Manana

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>            Assignee: Filipe Manana
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Filipe Manana (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Filipe Manana updated COUCHDB-926:
----------------------------------

    Attachment: test_comp.sh

Attaching the script used to reproduce the issue.

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>            Assignee: Filipe Manana
>             Fix For: 1.0.2, 1.1
>
>         Attachments: test_comp.sh
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Filipe Manana (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Filipe Manana closed COUCHDB-926.
---------------------------------

    Resolution: Fixed

Fix applied to trunk (revision 1036294) and branch 1.0.x (revision 1036295).

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>            Assignee: Filipe Manana
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Adam Kocoloski (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Adam Kocoloski updated COUCHDB-926:
-----------------------------------

    Fix Version/s: 1.1
                   1.0.2

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Russell van der Walt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925292#action_12925292 ] 

Russell van der Walt commented on COUCHDB-926:
----------------------------------------------

Hi Adam,

Have now confirmed that it is only applicable to databases with views. No view, no problem.

I set up a test that simply kept updating a single document in a loop (and touching the view after every update), with the following map function: 

function(doc) { if (doc.type && doc.type == 'record') { emit(doc.id, null); } }

I let that run for a bit and then when exiting the loop, compacted the database and the views. The database and view file size goes down as expected, but "df" does not show an increase in free size.

lsof has the following output which I reckon sums it up nicely:

root@ubuntu904:~# lsof | grep -P 'COMMAND|/var/data/couchdb/'
COMMAND     PID       USER   FD      TYPE             DEVICE      SIZE       NODE NAME
beam      21197       root   13u      REG              252,0      4185    3653752 /var/data/couchdb/_users.couch
beam      21197       root   14u      REG              252,0 191959757    3653679 /var/data/couchdb/.delete/33acca4299388cfa73e271ca6b662518 (deleted)
beam      21197       root   18u      REG              252,0      8281    3884279 /var/data/couchdb/.storage-test_design/800b1d5fe6334f272f2a8ad9feb9e0d9.view
beam      21197       root   20u      REG              252,0     36956    3654908 /var/data/couchdb/storage-test.couch

Note the deleted view file still being held open by beam.

Hope this helps.

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>             Fix For: 1.0.2, 1.1
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Mathias Leppich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12975229#action_12975229 ] 

Mathias Leppich commented on COUCHDB-926:
-----------------------------------------

this is a major bug for all running a production environment.
any date when you're releasing v1.0.2, which hopefully include the fix (rev 1036295)?

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>            Assignee: Filipe Manana
>             Fix For: 1.0.2, 1.1
>
>         Attachments: test_comp.sh
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-926) Compaction does not release file descriptors

Posted by "Bob Clary (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12991951#comment-12991951 ] 

Bob Clary commented on COUCHDB-926:
-----------------------------------

While the situation in 1.0.2 is much improved over 1.0.1, there are still cases where the deleted files are not released and are still held open by beam. I don't have specific steps to reproduce however it appears to be related to heavy load with couchdb crashing after compacting views and leaving the original file open.

> Compaction does not release file descriptors
> --------------------------------------------
>
>                 Key: COUCHDB-926
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-926
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 1.0.1
>         Environment: Ubuntu 9.04/10.4
>            Reporter: Russell van der Walt
>            Assignee: Filipe Manana
>             Fix For: 1.0.2, 1.1
>
>         Attachments: test_comp.sh
>
>
> When couch compacts a database, file descriptors of the deleted files are left open, causing the freed disk space to not be released to the system. With regular compaction, the system eventually runs out of disk space.
> There is a conversation thread in the user mailing list titled "Couch not releasing deleted files" that gives more insight into the problem, but I have been unable to find a bug report for it, so please accept my apologies if this has already been dealt with.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira