You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@couchdb.apache.org by GitBox <gi...@apache.org> on 2018/01/22 12:08:06 UTC

[GitHub] sergey-safarov opened a new issue #1119: Could not open shard

sergey-safarov opened a new issue #1119: Could not open shard
URL: https://github.com/apache/couchdb/issues/1119
 
 
   ## Expected Behavior
   CouchDB must open shards without any error.
   
   ## Current Behavior
   When replicated database from other server to standalone CouchDB time to time i see errors like this
   ```
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:47.577647Z couchdb@couchdb1.kazoo <0.25708.3> -------- 10.0.9.10 - - GET / 200
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:47.880163Z couchdb@couchdb1.kazoo <0.25433.3> -------- Retrying GET request to http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/ in 4.0 seconds due to error {code,500}
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.893174Z couchdb@couchdb1.kazoo <0.25726.3> -------- Could not open file ./data/shards/00000000-1fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.893399Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/00000000-1fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.894595Z couchdb@couchdb1.kazoo <0.25730.3> -------- Could not open file ./data/shards/20000000-3fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.895033Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/20000000-3fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.895562Z couchdb@couchdb1.kazoo <0.25734.3> -------- Could not open file ./data/shards/40000000-5fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.895868Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/40000000-5fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.896352Z couchdb@couchdb1.kazoo <0.25738.3> -------- Could not open file ./data/shards/60000000-7fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.896630Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/60000000-7fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.897154Z couchdb@couchdb1.kazoo <0.25742.3> -------- Could not open file ./data/shards/80000000-9fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.897454Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/80000000-9fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.897923Z couchdb@couchdb1.kazoo <0.25746.3> -------- Could not open file ./data/shards/a0000000-bfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.898239Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/a0000000-bfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.898754Z couchdb@couchdb1.kazoo <0.25750.3> -------- Could not open file ./data/shards/c0000000-dfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.899083Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/c0000000-dfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.899571Z couchdb@couchdb1.kazoo <0.25754.3> -------- Could not open file ./data/shards/e0000000-ffffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.899888Z couchdb@couchdb1.kazoo <0.206.0> -------- open_result error {not_found,no_db_file} for shards/e0000000-ffffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.900597Z couchdb@couchdb1.kazoo <0.25433.3> -------- Replicator, request GET to "http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/" failed due to error {code,500}
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.900935Z couchdb@couchdb1.kazoo <0.25433.3> -------- exit:{http_error_code,500,<<"GET http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/">>}: Replication 77d0d1cc310aa875647f25011de294cf+create_target failed to start "http://217.12.247.210:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/" -> "http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/" doc null:null stack:[{couch_replicator_api_wrap,db_open,3,[{file,"src/couch_replicator_api_wrap.erl"},{line,119}]},{couch_replicator_scheduler_job,init_state,1,[{file,"src/couch_replicator_scheduler_job.erl"},{line,590}]}]
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.901167Z couchdb@couchdb1.kazoo <0.357.0> -------- couch_replicator_scheduler : Transient job {"77d0d1cc310aa875647f25011de294cf","+create_target"} failed, removing. Error: <<"{http_error_code,500,\n                 <<\"GET http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/\">>}">>
   Jan 15 10:34:48 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:48.682942Z couchdb@couchdb1.kazoo <0.25757.3> 8f8d36eae3 undefined 10.0.9.10 undefined GET / 200 ok 0
   Jan 15 10:34:49 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:49.578731Z couchdb@couchdb1.kazoo <0.25774.3> -------- 10.0.9.10 - - GET / 200
   ```
   
   ## Possible Solution
   Not sure but this may by thread sync issue. Similar error is described here for other erlang program.
   [link 1](https://github.com/2600hz/kazoo/pull/3809)
   [link2](https://2600hz.atlassian.net/browse/KAZOO-5354)
   
   ## Steps to Reproduce (for bugs)
   
   1. start docker container
   2. start replication about 1500 databases (total 25 Gb) from other server. 
   
   ## Context
   I want migrate date from other CouchDB server.
   
   ## Your Environment
   * Version used: [docker image](https://hub.docker.com/r/apache/couchdb/) tag 2.1.1
   * Browser Name and version: Google Chrome 63.0.3239.132 (Official Build) (64-bit)
   * Operating System and version (desktop or mobile): Fedora 27 + Docker 17.12.0-ce
   * Link to your project: none
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services