You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@couchdb.apache.org by GitBox <gi...@apache.org> on 2017/10/24 07:24:55 UTC

[GitHub] azul opened a new issue #912: Replication fails with 500 in couch 1.6.0

azul opened a new issue #912: Replication fails with 500 in couch 1.6.0
URL: https://github.com/apache/couchdb/issues/912
 
 
   <!--- Provide a general summary of the issue in the Title above -->
   
   We regularly replicate some of our couch databases on the same couch to a different database. Occasionally this fails with a 500 error code.
   
   ## Expected Behavior
   
   Replication should run as usual and in this particular case it should replicate tokens_581 database to tokens_582
   
   ## Current Behavior
   
   Request to start the replication results in a 500 http response code. Couch logs look like this:
   
   ```
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.790.723>] 127.0.0.1 - - HEAD /tokens_582 404
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.790.723>] 127.0.0.1 - - PUT /tokens_582 201
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.790.723>] 127.0.0.1 - - PUT /tokens_582/_design/rotation_filter 201
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.790.723>] 127.0.0.1 - - GET /tokens_582/_design/Token 404
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.790.723>] 127.0.0.1 - - PUT /tokens_582/_design/Token 201
   [Fri, 20 Oct 2017 00:00:07 GMT] [error] [<0.18896.725>] Could not open file /var/lib/couchdb/tokens.couch: no such file or directory
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.8646.722>] 127.0.0.1 - - HEAD /tokens 404
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.2371.726>] 127.0.0.1 - - HEAD /tokens_581 200
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.790.723>] 127.0.0.1 - - PUT /tokens_581/_design/rotation_filter 201
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.15850.724>] Retrying HEAD request to http://admin:*****@localhost:4000/tokens_582/ in 0.25 seconds due to error {conn_failed,{error,econnrefused}}
   [Fri, 20 Oct 2017 00:00:07 GMT] [info] [<0.15850.724>] Retrying HEAD request to http://admin:*****@localhost:4000/tokens_582/ in 0.5 seconds due to error {conn_failed,{error,econnrefused}}
   [Fri, 20 Oct 2017 00:00:08 GMT] [info] [<0.15850.724>] Retrying HEAD request to http://admin:*****@localhost:4000/tokens_582/ in 1.0 seconds due to error {conn_failed,{error,econnrefused}}
   [Fri, 20 Oct 2017 00:00:09 GMT] [info] [<0.15850.724>] Retrying HEAD request to http://admin:*****@localhost:4000/tokens_582/ in 2.0 seconds due to error {conn_failed,{error,econnrefused}}
   [Fri, 20 Oct 2017 00:00:11 GMT] [info] [<0.15850.724>] Retrying HEAD request to http://admin:*****@localhost:4000/tokens_582/ in 4.0 seconds due to error {conn_failed,{error,econnrefused}}
   [Fri, 20 Oct 2017 00:00:15 GMT] [info] [<0.15850.724>] Retrying HEAD request to http://admin:*****@localhost:4000/tokens_582/ in 8.0 seconds due to error {conn_failed,{error,econnrefused}}
   [Fri, 20 Oct 2017 00:00:23 GMT] [info] [<0.15850.724>] Retrying HEAD request to http://admin:*****@localhost:4000/tokens_582/ in 16.0 seconds due to error {conn_failed,{error,econnrefused}}
   [Fri, 20 Oct 2017 00:00:37 GMT] [info] [<0.790.723>] 127.0.0.1 - - POST /_replicate 500
   [Fri, 20 Oct 2017 00:00:37 GMT] [error] [<0.22669.724>] ** Generic server <0.22669.724> terminating
   ** Last message in was {'EXIT',<0.15850.724>,killed}
   ** When Server state == {state,"http://admin:...@localhost:4000/tokens_582/",
                                  20,[],[],
                                  {[],[]}}
   ** Reason for termination ==
   ** killed
   
   [Fri, 20 Oct 2017 00:00:37 GMT] [error] [<0.22669.724>] {error_report,<0.31.0>,
                            {<0.22669.724>,crash_report,
                             [[{initial_call,
                                {couch_replicator_httpc_pool,init,
                                 ['Argument__1']}},
                               {pid,<0.22669.724>},
                               {registered_name,[]},
                               {error_info,
                                {exit,killed,
                                 [{gen_server,terminate,6,
                                   [{file,"gen_server.erl"},{line,737}]},
                                  {proc_lib,init_p_do_apply,3,
                                   [{file,"proc_lib.erl"},{line,237}]}]}},
                               {ancestors,
                                [<0.15850.724>,couch_replicator_job_sup,
                                 couch_primary_services,couch_server_sup,
                                 <0.32.0>]},
                               {messages,[]},
                               {links,[]},
                               {dictionary,[]},
                               {trap_exit,true},
                               {status,running},
                               {heap_size,376},
                               {stack_size,27},
                               {reductions,488}],
                              []]}}
   [Fri, 20 Oct 2017 00:00:37 GMT] [error] [<0.790.723>] httpd 500 error response:
    {"error":"timeout"}
   ```
   
   Maybe this is fixed already in a later version of couch. Upgrading will take some time and as i said this is non-deterministic for us. But I thought i'd report it anyway. Maybe it's still an issue and clear from the error message what is happening.
   
   ## Context
   
   The filter mentioned in the logs is:
   ```
   {"_id":"_design/rotation_filter","_rev":"1-d4f7b95e8ad4e8f6d3721038178dd428","filters":{"not_expired":"function(doc, req) {
     if (doc._deleted) {
       return false;
     } else if (typeof(doc.last_seen_at) != "undefined") {
       return Date.now() < (new Date(doc.last_seen_at)).getTime() + 3600;
     } else {
       return true;
     }
   }"}}
   ```
   
   We are currently rotating our databases with temporary data to keep them from growing due to deleted records. We're aware that this is not what couch is meant for and will migrate to a different solution in the long run.
   
   ## Your Environment
   * Version used: 1.6.0
   * Operating System and version (desktop or mobile): debian jessie linux
   * Link to your project: https://leap.se
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services