You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@couchdb.apache.org by GitBox <gi...@apache.org> on 2020/07/14 11:59:49 UTC
[GitHub] [couchdb] tkrapp opened a new issue #3004: HTTP-Error - CouchDB View does not return all data
tkrapp opened a new issue #3004:
URL: https://github.com/apache/couchdb/issues/3004
When querying a couchdb view from our database it happens many times that the http client stops telling that not all data could be read from the source.
## Description
When querying a rather large view from our database (more than 40k rows), couchdb does not return all data (not in all but in many cases).
Curl for example gives the following error message "transfer closed with outstanding read data remaining".
This may happen with all views in the database and on any server (clustered or stand-alone).
## Steps to Reproduce
curl "http://[user]:[pw]@localhost/[database]/_view/[some-view]?reduce=false
## Expected Behaviour
The view should return all results without stopping in the middle of the response.
## Your Environment
couchdb "Welcome"
version "3.1.0"
git_sha "ff0feea20"
uuid "369f5878acd1e0e1aa8c14522d23aa56"
features
0 "access-ready"
1 "partitioned"
2 "pluggable-storage-engines"
3 "reshard"
4 "scheduler"
vendor
name "The Apache Software Foundation"
* CouchDB version used: 3.1.0
* Browser name and version: Not applicable
* Operating system and version: Ubuntu 18.04 or 20.04
## Additional Context
Lines from couchdb.log
[error]
2020-07-14T08:47:30.513433Z
couchdb@127.0.0.1 <0.25462.8114> 4c2c6c44a3
rexi_server: from: couchdb@127.0.0.1(<0.31707.8101>)
mfa: fabric_rpc:map_view/5 exit:{
noproc,{
gen_server,call,
[
<0.10111.8113>,
{
pread_iolist,269711614
}
]
}
}
[
{
gen_server,
call,
2,
[
{file,"gen_server.erl"},
{line,206}
]
},
{
couch_file,
pread_iolist,
2,
[
{file,"src/couch_file.erl"},
{line,177}
]
},
{
couch_file,
pread_binary,
2,
[
{file,"src/couch_file.erl"},
{line,172}
]
},
{
couch_file,
pread_term,
2,
[
{file,"src/couch_file.erl"},
{line,160}
]
},
{
couch_btree,
get_node,
2,
[
{file,"src/couch_btree.erl"},
{line,435}
]
},
{
couch_btree,
stream_node,
7,
[
{file,"src/couch_btree.erl"},
{line,764}
]
},
{
couch_btree,
stream_kp_node,
7,
[
{file,"src/couch_btree.erl"},
{line,778}
]
},
{
couch_btree,
fold,
4,
[
{file,"src/couch_btree.erl"},
{line,224}
]
}
]
[error]
2020-07-14T08:47:30.513607Z
couchdb@127.0.0.1 <0.31707.8101> 4c2c6c44a3
req_err(2774351384)
noproc : {
gen_server,
call,
[
<0.10111.8113>,
{pread_iolist,269711614}
]
}
[notice]
2020-07-14T08:47:30.513700Z
couchdb@127.0.0.1 <0.31707.8101> 4c2c6c44a3
localhost:5984 127.0.0.1
XXX GET /xxx/_design/xxx/_view/open?startkey=...&endkey=...&reduce=false&include_docs=true 200 aborted 1838
[error]
2020-07-14T08:47:30.513842Z
couchdb@127.0.0.1 <0.31707.8101> 4c2c6c44a3
Response abnormally terminated: {
noproc,
{
gen_server,
call,
[
<0.10111.8113>,
{pread_iolist,269711614}
]
},
[
{
gen_server,
call,
2,
[
{file,"gen_server.erl"},{line,206}
]
},
{
couch_file,
pread_iolist,
2,
[
{file,"src/couch_file.erl"},{line,177}
]
},
{
couch_file,
pread_binary,
2,
[
{file,"src/couch_file.erl"},{line,172}
]
},
{
couch_file,
pread_term,
2,
[
{file,"src/couch_file.erl"},{line,160}
]
},
{
couch_btree,
get_node,
2,
[
{file,"src/couch_btree.erl"},{line,435}
]
},
{
couch_btree,
stream_node,
7,
[
{file,"src/couch_btree.erl"},{line,764}
]
},
{
couch_btree,
stream_kp_node,
7,
[
{file,"src/couch_btree.erl"},{line,778}
]
},
{
couch_btree,
fold,
4,
[
{file,"src/couch_btree.erl"},{line,224}
]
}
]
}
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] tkrapp commented on issue #3004: HTTP-Error - CouchDB View does not return all data
Posted by GitBox <gi...@apache.org>.
tkrapp commented on issue #3004:
URL: https://github.com/apache/couchdb/issues/3004#issuecomment-658241580
We also encountered this error #2941 while digging deeper into the log files and we did delete these .compact files. For now it seems to work. We will observe the issue the next few days and give you an update here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] janl commented on issue #3004: HTTP-Error - CouchDB View does not return all data
Posted by GitBox <gi...@apache.org>.
janl commented on issue #3004:
URL: https://github.com/apache/couchdb/issues/3004#issuecomment-658242422
cool, reopen when new things come in
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] tkrapp commented on issue #3004: HTTP-Error - CouchDB View does not return all data
Posted by GitBox <gi...@apache.org>.
tkrapp commented on issue #3004:
URL: https://github.com/apache/couchdb/issues/3004#issuecomment-658185729
> `pread:iolist()` errors usually point to file corruption. Can you delete the index files for that view and rebuild them?
Thanks for the fast reply. We've rebuilt the views by changing them a little bit (e.g. adding space characters) which should do the trick but the error occurred again after one or two days :-(
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] janl commented on issue #3004: HTTP-Error - CouchDB View does not return all data
Posted by GitBox <gi...@apache.org>.
janl commented on issue #3004:
URL: https://github.com/apache/couchdb/issues/3004#issuecomment-658165113
`pread:iolist()` errors usually point to file corruption. Can you delete the index files for that view and rebuild them?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] janl closed issue #3004: HTTP-Error - CouchDB View does not return all data
Posted by GitBox <gi...@apache.org>.
janl closed issue #3004:
URL: https://github.com/apache/couchdb/issues/3004
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] janl commented on issue #3004: HTTP-Error - CouchDB View does not return all data
Posted by GitBox <gi...@apache.org>.
janl commented on issue #3004:
URL: https://github.com/apache/couchdb/issues/3004#issuecomment-658238750
can you do the delete route I mentioned. make sure to also delete any lingering .compact files.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org