You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@couchdb.apache.org by "Sergey Kurtsev (JIRA)" <ji...@apache.org> on 2008/06/12 17:22:45 UTC

[jira] Created: (COUCHDB-78) CouchDB crashed Erland

CouchDB crashed Erland
----------------------

                 Key: COUCHDB-78
                 URL: https://issues.apache.org/jira/browse/COUCHDB-78
             Project: CouchDB
          Issue Type: Bug
          Components: Database Core
    Affects Versions: 0.8
         Environment: Linux 2.6.25.4-30.fc9.i686 #1 SMP Wed May 21 18:12:35 EDT 2008 i686 i686 i386 GNU/Linux

            Reporter: Sergey Kurtsev


Not sure if this is a CouchDB or Erlang bug or both. Please, forward to Erland team if appropriate.

What happened:
I've started several thousands of atomic inserts with modified sample php script from http://wiki.apache.org/couchdb/GettingStartedWithPhp
In the middle of insert loop I initiated database compact from localhost:5984/_utils interface.
Several thousands of inserts later CouchDB dumped the following error and terminated:

[ ...similar successfull POSTs are cut 'till this point... ]
[info] [<0.23823.0>] 127.0.0.1 - - "POST /test" 201
[info] [<0.91.0>] Compaction file still behind main file (update seq=8728. compact update seq=8727). Retrying.
[info] [<0.23830.0>] 127.0.0.1 - - "POST /test" 201
[info] [<0.91.0>] Compaction file still behind main file (update seq=8729. compact update seq=8728). Retrying.
[error] [emulator] Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}



=ERROR REPORT==== 12-Jun-2008::19:06:07 ===
Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}

[error] [<0.47.0>] {error_report,<0.22.0>,
    {<0.47.0>,supervisor_report,
     [{supervisor,{local,couch_server_sup}},
      {errorContext,child_terminated},
      {reason,
          {{case_clause,
               {error,
                   {{badmatch,{error,emfile}},
                    [{couch_file,init,1},
                     {gen_server,init_it,6},
                     {proc_lib,init_p,5}]}}},
           [{couch_db,start_copy_compact_int,2}]}},
      {offender,
          [{pid,<0.90.0>},
           {name,"test"},
           {mfa,
               {couch_db,create,
                   ["test","/usr/local/var/lib/apache-couchdb/test.couch",
                    []]}},
           {restart_type,transient},
           {shutdown,infinity},
           {child_type,supervisor}]}]}}
[error] [<0.47.0>] {error_report,<0.22.0>,
    {<0.47.0>,supervisor_report,
     [{supervisor,{local,couch_server_sup}},
      {errorContext,start_error},
      {reason,file_exists},
      {offender,
          [{pid,<0.90.0>},
           {name,"test"},
           {mfa,
               {couch_db,create,
                   ["test","/usr/local/var/lib/apache-couchdb/test.couch",
                    []]}},
           {restart_type,transient},
           {shutdown,infinity},
           {child_type,supervisor}]}]}}
[error] [<0.47.0>] {error_report,<0.22.0>,
    {<0.47.0>,supervisor_report,
     [{supervisor,{local,couch_server_sup}},
      {errorContext,start_error},
      {reason,file_exists},
      {offender,
          [{pid,<0.90.0>},
           {name,"test"},
           {mfa,
               {couch_db,create,
                   ["test","/usr/local/var/lib/apache-couchdb/test.couch",
                    []]}},
           {restart_type,transient},
           {shutdown,infinity},
           {child_type,supervisor}]}]}}
[error] [<0.47.0>] {error_report,<0.22.0>,
    {<0.47.0>,supervisor_report,
     [{supervisor,{local,couch_server_sup}},
      {errorContext,start_error},
      {reason,file_exists},
      {offender,
          [{pid,<0.90.0>},
           {name,"test"},
           {mfa,
               {couch_db,create,
                   ["test","/usr/local/var/lib/apache-couchdb/test.couch",
                    []]}},
           {restart_type,transient},
           {shutdown,infinity},
           {child_type,supervisor}]}]}}
[info] [<0.23837.0>] HTTP Error (code 500): {'EXIT',
                        {{{case_clause,
                           {error,
                            {{badmatch,{error,emfile}},
                             [{couch_file,init,1},
                              {gen_server,init_it,6},
                              {proc_lib,init_p,5}]}}},
                          [{couch_db,start_copy_compact_int,2}]},
                         {gen_server,call,
                          [<0.90.0>,
                           {update_docs,
                            [[{doc,"a2f6aac30a31e34aedc253ae17c3eaa2",
                               ["4020863542"],
                               {obj,[{"index",5777},{"data","Foo"}]},
                               [],false,[]}]],
                            [new_edits]}]}}}
[error] [<0.47.0>] {error_report,<0.22.0>,
    {<0.47.0>,supervisor_report,
     [{supervisor,{local,couch_server_sup}},
      {errorContext,start_error},
      {reason,file_exists},
      {offender,
          [{pid,<0.90.0>},
           {name,"test"},
           {mfa,
               {couch_db,create,
                   ["test","/usr/local/var/lib/apache-couchdb/test.couch",
                    []]}},
           {restart_type,transient},
           {shutdown,infinity},
           {child_type,supervisor}]}]}}
[error] [<0.47.0>] {error_report,<0.22.0>,
    {<0.47.0>,supervisor_report,
     [{supervisor,{local,couch_server_sup}},
      {errorContext,start_error},
      {reason,file_exists},
      {offender,
          [{pid,<0.90.0>},
           {name,"test"},
           {mfa,
               {couch_db,create,
                   ["test","/usr/local/var/lib/apache-couchdb/test.couch",
                    []]}},
           {restart_type,transient},
           {shutdown,infinity},
           {child_type,supervisor}]}]}}
{"init terminating in do_boot",shutdown}


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (COUCHDB-78) CouchDB crashed Erland

Posted by "Sergey Kurtsev (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sergey Kurtsev updated COUCHDB-78:
----------------------------------

    Attachment: erl_crash.dump

Erlang crash dump is in attached file.



Erlang version R12B-1.1.fc9  is from Fedora repository.

> CouchDB crashed Erland
> ----------------------
>
>                 Key: COUCHDB-78
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-78
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 0.8
>         Environment: Linux 2.6.25.4-30.fc9.i686 #1 SMP Wed May 21 18:12:35 EDT 2008 i686 i686 i386 GNU/Linux
>            Reporter: Sergey Kurtsev
>         Attachments: erl_crash.dump
>
>
> Not sure if this is a CouchDB or Erlang bug or both. Please, forward to Erland team if appropriate.
> What happened:
> I've started several thousands of atomic inserts with modified sample php script from http://wiki.apache.org/couchdb/GettingStartedWithPhp
> In the middle of insert loop I initiated database compact from localhost:5984/_utils interface.
> Several thousands of inserts later CouchDB dumped the following error and terminated:
> [ ...similar successfull POSTs are cut 'till this point... ]
> [info] [<0.23823.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8728. compact update seq=8727). Retrying.
> [info] [<0.23830.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8729. compact update seq=8728). Retrying.
> [error] [emulator] Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> =ERROR REPORT==== 12-Jun-2008::19:06:07 ===
> Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,child_terminated},
>       {reason,
>           {{case_clause,
>                {error,
>                    {{badmatch,{error,emfile}},
>                     [{couch_file,init,1},
>                      {gen_server,init_it,6},
>                      {proc_lib,init_p,5}]}}},
>            [{couch_db,start_copy_compact_int,2}]}},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [info] [<0.23837.0>] HTTP Error (code 500): {'EXIT',
>                         {{{case_clause,
>                            {error,
>                             {{badmatch,{error,emfile}},
>                              [{couch_file,init,1},
>                               {gen_server,init_it,6},
>                               {proc_lib,init_p,5}]}}},
>                           [{couch_db,start_copy_compact_int,2}]},
>                          {gen_server,call,
>                           [<0.90.0>,
>                            {update_docs,
>                             [[{doc,"a2f6aac30a31e34aedc253ae17c3eaa2",
>                                ["4020863542"],
>                                {obj,[{"index",5777},{"data","Foo"}]},
>                                [],false,[]}]],
>                             [new_edits]}]}}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> {"init terminating in do_boot",shutdown}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (COUCHDB-78) CouchDB crashed Erland

Posted by "Sergey Kurtsev (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sergey Kurtsev updated COUCHDB-78:
----------------------------------

    Comment: was deleted

> CouchDB crashed Erland
> ----------------------
>
>                 Key: COUCHDB-78
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-78
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 0.8
>         Environment: Linux 2.6.25.4-30.fc9.i686 #1 SMP Wed May 21 18:12:35 EDT 2008 i686 i686 i386 GNU/Linux
>            Reporter: Sergey Kurtsev
>         Attachments: erl_crash.dump
>
>
> Not sure if this is a CouchDB or Erlang bug or both. Please, forward to Erland team if appropriate.
> What happened:
> I've started several thousands of atomic inserts with modified sample php script from http://wiki.apache.org/couchdb/GettingStartedWithPhp
> In the middle of insert loop I initiated database compact from localhost:5984/_utils interface.
> Several thousands of inserts later CouchDB dumped the following error and terminated:
> [ ...similar successfull POSTs are cut 'till this point... ]
> [info] [<0.23823.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8728. compact update seq=8727). Retrying.
> [info] [<0.23830.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8729. compact update seq=8728). Retrying.
> [error] [emulator] Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> =ERROR REPORT==== 12-Jun-2008::19:06:07 ===
> Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,child_terminated},
>       {reason,
>           {{case_clause,
>                {error,
>                    {{badmatch,{error,emfile}},
>                     [{couch_file,init,1},
>                      {gen_server,init_it,6},
>                      {proc_lib,init_p,5}]}}},
>            [{couch_db,start_copy_compact_int,2}]}},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [info] [<0.23837.0>] HTTP Error (code 500): {'EXIT',
>                         {{{case_clause,
>                            {error,
>                             {{badmatch,{error,emfile}},
>                              [{couch_file,init,1},
>                               {gen_server,init_it,6},
>                               {proc_lib,init_p,5}]}}},
>                           [{couch_db,start_copy_compact_int,2}]},
>                          {gen_server,call,
>                           [<0.90.0>,
>                            {update_docs,
>                             [[{doc,"a2f6aac30a31e34aedc253ae17c3eaa2",
>                                ["4020863542"],
>                                {obj,[{"index",5777},{"data","Foo"}]},
>                                [],false,[]}]],
>                             [new_edits]}]}}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> {"init terminating in do_boot",shutdown}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (COUCHDB-78) CouchDB crashed Erland

Posted by "Sergey Kurtsev (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/COUCHDB-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12604541#action_12604541 ] 

Sergey Kurtsev commented on COUCHDB-78:
---------------------------------------

Erlang crash dump is in attached file.



Erlang version R12B-1.1.fc9  is from Fedora repository.

> CouchDB crashed Erland
> ----------------------
>
>                 Key: COUCHDB-78
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-78
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 0.8
>         Environment: Linux 2.6.25.4-30.fc9.i686 #1 SMP Wed May 21 18:12:35 EDT 2008 i686 i686 i386 GNU/Linux
>            Reporter: Sergey Kurtsev
>         Attachments: erl_crash.dump
>
>
> Not sure if this is a CouchDB or Erlang bug or both. Please, forward to Erland team if appropriate.
> What happened:
> I've started several thousands of atomic inserts with modified sample php script from http://wiki.apache.org/couchdb/GettingStartedWithPhp
> In the middle of insert loop I initiated database compact from localhost:5984/_utils interface.
> Several thousands of inserts later CouchDB dumped the following error and terminated:
> [ ...similar successfull POSTs are cut 'till this point... ]
> [info] [<0.23823.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8728. compact update seq=8727). Retrying.
> [info] [<0.23830.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8729. compact update seq=8728). Retrying.
> [error] [emulator] Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> =ERROR REPORT==== 12-Jun-2008::19:06:07 ===
> Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,child_terminated},
>       {reason,
>           {{case_clause,
>                {error,
>                    {{badmatch,{error,emfile}},
>                     [{couch_file,init,1},
>                      {gen_server,init_it,6},
>                      {proc_lib,init_p,5}]}}},
>            [{couch_db,start_copy_compact_int,2}]}},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [info] [<0.23837.0>] HTTP Error (code 500): {'EXIT',
>                         {{{case_clause,
>                            {error,
>                             {{badmatch,{error,emfile}},
>                              [{couch_file,init,1},
>                               {gen_server,init_it,6},
>                               {proc_lib,init_p,5}]}}},
>                           [{couch_db,start_copy_compact_int,2}]},
>                          {gen_server,call,
>                           [<0.90.0>,
>                            {update_docs,
>                             [[{doc,"a2f6aac30a31e34aedc253ae17c3eaa2",
>                                ["4020863542"],
>                                {obj,[{"index",5777},{"data","Foo"}]},
>                                [],false,[]}]],
>                             [new_edits]}]}}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> {"init terminating in do_boot",shutdown}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Re: [jira] Closed: (COUCHDB-78) CouchDB crashed Erland

Posted by Jan Lehnardt <ja...@apache.org>.
On Jun 12, 2008, at 21:47, Сергей Курцев wrote:

> Damien,
>
> thanks for you replies. I've put them into wiki since it will be  
> useful
> to others
> http://wiki.apache.org/couchdb/Compaction

Good thinking, thanks Sergey!

Cheers
Jan
--

>
>
> With best regards,
> Sergey.
>
> On Thu, 12/06/2008 at 15:02 -0400, Damien Katz wrote:
>> CouchDB works like this to have the least impact possible on
>> clients,
>> the database remains online and fully functional to readers and
>> writers. Yes, its a design limitation that database compaction can't
>> complete when at capacity for write load, however I don't think its
>> unreasonable to schedule compactions during off-peak hours either.
>> As
>> you point out, in a clustered environment the write load can
>> switched
>> off for any node during compaction and brought back up to date with
>> replication once complete.
>>
>> In the future, a single couchdb node can be changed to stop or fail
>> other updates if the write load is too heavy for it to complete in a
>> reasonable time.
>
>


Re: [jira] Closed: (COUCHDB-78) CouchDB crashed Erland

Posted by Сергей Курцев <sk...@gmail.com>.
Damien,

thanks for you replies. I've put them into wiki since it will be useful
to others
http://wiki.apache.org/couchdb/Compaction

With best regards,
Sergey.

On Thu, 12/06/2008 at 15:02 -0400, Damien Katz wrote:
> CouchDB works like this to have the least impact possible on
> clients,  
> the database remains online and fully functional to readers and  
> writers. Yes, its a design limitation that database compaction can't  
> complete when at capacity for write load, however I don't think its  
> unreasonable to schedule compactions during off-peak hours either.
> As  
> you point out, in a clustered environment the write load can
> switched  
> off for any node during compaction and brought back up to date with  
> replication once complete.
> 
> In the future, a single couchdb node can be changed to stop or fail  
> other updates if the write load is too heavy for it to complete in a  
> reasonable time.


Re: [jira] Closed: (COUCHDB-78) CouchDB crashed Erland

Posted by Damien Katz <da...@gmail.com>.
CouchDB works like this to have the least impact possible on clients,  
the database remains online and fully functional to readers and  
writers. Yes, its a design limitation that database compaction can't  
complete when at capacity for write load, however I don't think its  
unreasonable to schedule compactions during off-peak hours either. As  
you point out, in a clustered environment the write load can switched  
off for any node during compaction and brought back up to date with  
replication once complete.

In the future, a single couchdb node can be changed to stop or fail  
other updates if the write load is too heavy for it to complete in a  
reasonable time.

On Jun 12, 2008, at 2:41 PM, Сергей Курцев wrote:

> Hello, Damien.
>
> Thanks for clearing that out. But according to your, I assume that
> CouchDB may run on high-loaded servers in future. That means that the
> only way to compact database on write-heavy systems is when using
> several replicated CouchDB servers. We then should stop serving  
> requests
> by the specific CouchDB while others continue with replicated copies  
> and
> proceed with compact.
>
> Not sure that this is the best way, but it shall work. But on the  
> single
> running copy of CouchDB it still may be a problem, I guess.
>
>
>


Re: [jira] Closed: (COUCHDB-78) CouchDB crashed Erland

Posted by Сергей Курцев <sk...@gmail.com>.
Hello, Damien.

Thanks for clearing that out. But according to your, I assume that
CouchDB may run on high-loaded servers in future. That means that the
only way to compact database on write-heavy systems is when using
several replicated CouchDB servers. We then should stop serving requests
by the specific CouchDB while others continue with replicated copies and
proceed with compact.

Not sure that this is the best way, but it shall work. But on the single
running copy of CouchDB it still may be a problem, I guess.






Thu, 12/06/2008 at 11:24 -0700, Damien Katz (JIRA) wrote:
> [ https://issues.apache.org/jira/browse/COUCHDB-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
> 
> Damien Katz closed COUCHDB-78.
> ------------------------------
> 
>        Resolution: Fixed
>     Fix Version/s: 0.8
>          Assignee: Damien Katz
> 
> Problem was couchdb failing to close file handles during compaction reattempts. Fixed in revision 667188.
> 
> Note, it is not a good idea to attempt compaction on a database is near full capacity for its write load. The problem is the compaction process may never catch up with the writes if they never let up, and eventually it will run out of disk space.
> 
> Compaction should be attempted when the write load is less than full capacity. Read load won't affect its ability to complete however.
> 
> > CouchDB crashed Erland
> > ----------------------
> >
> >                 Key: COUCHDB-78
> >                 URL: https://issues.apache.org/jira/browse/COUCHDB-78
> >             Project: CouchDB
> >          Issue Type: Bug
> >          Components: Database Core
> >    Affects Versions: 0.8
> >         Environment: Linux 2.6.25.4-30.fc9.i686 #1 SMP Wed May 21 18:12:35 EDT 2008 i686 i686 i386 GNU/Linux
> >            Reporter: Sergey Kurtsev
> >            Assignee: Damien Katz
> >             Fix For: 0.8
> >
> >         Attachments: erl_crash.dump
> >
> >
> > Not sure if this is a CouchDB or Erlang bug or both. Please, forward to Erland team if appropriate.
> > What happened:
> > I've started several thousands of atomic inserts with modified sample php script from http://wiki.apache.org/couchdb/GettingStartedWithPhp
> > In the middle of insert loop I initiated database compact from localhost:5984/_utils interface.
> > Several thousands of inserts later CouchDB dumped the following error and terminated:
> > [ ...similar successfull POSTs are cut 'till this point... ]



[jira] Closed: (COUCHDB-78) CouchDB crashed Erland

Posted by "Damien Katz (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/COUCHDB-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Damien Katz closed COUCHDB-78.
------------------------------

       Resolution: Fixed
    Fix Version/s: 0.8
         Assignee: Damien Katz

Problem was couchdb failing to close file handles during compaction reattempts. Fixed in revision 667188.

Note, it is not a good idea to attempt compaction on a database is near full capacity for its write load. The problem is the compaction process may never catch up with the writes if they never let up, and eventually it will run out of disk space.

Compaction should be attempted when the write load is less than full capacity. Read load won't affect its ability to complete however.

> CouchDB crashed Erland
> ----------------------
>
>                 Key: COUCHDB-78
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-78
>             Project: CouchDB
>          Issue Type: Bug
>          Components: Database Core
>    Affects Versions: 0.8
>         Environment: Linux 2.6.25.4-30.fc9.i686 #1 SMP Wed May 21 18:12:35 EDT 2008 i686 i686 i386 GNU/Linux
>            Reporter: Sergey Kurtsev
>            Assignee: Damien Katz
>             Fix For: 0.8
>
>         Attachments: erl_crash.dump
>
>
> Not sure if this is a CouchDB or Erlang bug or both. Please, forward to Erland team if appropriate.
> What happened:
> I've started several thousands of atomic inserts with modified sample php script from http://wiki.apache.org/couchdb/GettingStartedWithPhp
> In the middle of insert loop I initiated database compact from localhost:5984/_utils interface.
> Several thousands of inserts later CouchDB dumped the following error and terminated:
> [ ...similar successfull POSTs are cut 'till this point... ]
> [info] [<0.23823.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8728. compact update seq=8727). Retrying.
> [info] [<0.23830.0>] 127.0.0.1 - - "POST /test" 201
> [info] [<0.91.0>] Compaction file still behind main file (update seq=8729. compact update seq=8728). Retrying.
> [error] [emulator] Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> =ERROR REPORT==== 12-Jun-2008::19:06:07 ===
> Error in process <0.23848.0> with exit value: {{case_clause,{error,{{badmatch,{error,emfile}},[{couch_file,init,1},{gen_server,init_it,6},{proc_lib,init_p,5}]}}},[{couch_db,start_copy_compact_int,2}]}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,child_terminated},
>       {reason,
>           {{case_clause,
>                {error,
>                    {{badmatch,{error,emfile}},
>                     [{couch_file,init,1},
>                      {gen_server,init_it,6},
>                      {proc_lib,init_p,5}]}}},
>            [{couch_db,start_copy_compact_int,2}]}},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [info] [<0.23837.0>] HTTP Error (code 500): {'EXIT',
>                         {{{case_clause,
>                            {error,
>                             {{badmatch,{error,emfile}},
>                              [{couch_file,init,1},
>                               {gen_server,init_it,6},
>                               {proc_lib,init_p,5}]}}},
>                           [{couch_db,start_copy_compact_int,2}]},
>                          {gen_server,call,
>                           [<0.90.0>,
>                            {update_docs,
>                             [[{doc,"a2f6aac30a31e34aedc253ae17c3eaa2",
>                                ["4020863542"],
>                                {obj,[{"index",5777},{"data","Foo"}]},
>                                [],false,[]}]],
>                             [new_edits]}]}}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> [error] [<0.47.0>] {error_report,<0.22.0>,
>     {<0.47.0>,supervisor_report,
>      [{supervisor,{local,couch_server_sup}},
>       {errorContext,start_error},
>       {reason,file_exists},
>       {offender,
>           [{pid,<0.90.0>},
>            {name,"test"},
>            {mfa,
>                {couch_db,create,
>                    ["test","/usr/local/var/lib/apache-couchdb/test.couch",
>                     []]}},
>            {restart_type,transient},
>            {shutdown,infinity},
>            {child_type,supervisor}]}]}}
> {"init terminating in do_boot",shutdown}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.