You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@couchdb.apache.org by Kenneth Tyler <ke...@8thfold.com> on 2010/09/19 21:17:01 UTC
bad views
after importing a lot of data from sql server into databases i get a lot of
databases that give a utf-8 error when i try to access their design
documents
now i have one with a different error.
if i look at the design docs in futon i get a timeout error
even looking at a temporary view gives the error
it looks like this:
Error: timeout
{gen_server,call,
[couch_view,
{get_group_server,<<"homepage">>,
{group,
<<245,195,83,255,25,184,62,149,85,203,60,66,54,94,118,249>>,
{db,<0.9127.0>,<0.9128.0>,nil,<<"1284923457367923">>,<0.9125.0>,
<0.9130.0>,
{db_header,5,873,0,
{6555866,{872,0}},
{6559523,872},
nil,0,nil,nil,1000},
873,
{btree,<0.9125.0>,
{6555866,{872,0}},
#Fun<couch_db_updater.7.69395062>,
#Fun<couch_db_updater.8.86519079>,
#Fun<couch_btree.5.124754102>,
#Fun<couch_db_updater.9.24674233>},
{btree,<0.9125.0>,
{6559523,872},
#Fun<couch_db_updater.10.90337910>,
#Fun<couch_db_updater.11.13595824>,
#Fun<couch_btree.5.124754102>,
#Fun<couch_db_updater.12.34906778>},
{btree,<0.9125.0>,nil,#Fun<couch_btree.0.83553141>,
#Fun<couch_btree.1.30790806>,
#Fun<couch_btree.2.124754102>,nil},
873,<<"homepage">>,
"/home/administrator/build-couchdb/build/var/lib/couchdb/homepage.couch",
[],[],nil,
{user_ctx,null,[],undefined},
nil,1000,
[before_header,after_header,on_file_open],
false},
nil,<<"_temp">>,<<"javascript">>,[],
[{view,0,
[<<"_temp">>],
<<"function(doc) {\n emit(null, doc);\n}">>,nil,[],[]}],
nil,0,0,nil,nil}}]}
any body have a clue what's happening a lot of these databases work fine
(about 2,000 total) and a lot don't... i don't know how to figure out what's
wrong
thanks
ken tyler
Re: bad views
Posted by Randall Leeds <ra...@gmail.com>.
If you have problems with views it may also be cause spidermonkey is
not linked correctly. If you sort out permissions issues, check your
log files and stdout/stderr for errors about libmozjs.so.
Most likely something is not quite right with your setup and
everything should be much easier once this is sorted.
-Randall
On Mon, Sep 20, 2010 at 17:14, Kenneth Tyler <ke...@8thfold.com> wrote:
> Chris,
> We now suspect that because we tried to set up a "couchdb" user  couchdb has
> trouble
> writing the couchdb.stderr and couchdb.stdout files... which we think might
> cause the timeout errors
> we're investigating
>
> ken
>
> On Mon, Sep 20, 2010 at 7:59 AM, Chris Anderson <jc...@apache.org> wrote:
>
>> I'm glad you were able to confirm it is a timeout bug.
>>
>> What happens when you try your problematic data on a known good
>> installation like CouchOne? If it works there then we'll know to
>> concentrate on your server's peculiarities. If it doesn't work there,
>> then we'll have a good shared location to debug from.
>>
>>
>
Re: bad views
Posted by Kenneth Tyler <ke...@8thfold.com>.
Chris,
We now suspect that because we tried to set up a "couchdb" user couchdb has
trouble
writing the couchdb.stderr and couchdb.stdout files... which we think might
cause the timeout errors
we're investigating
ken
On Mon, Sep 20, 2010 at 7:59 AM, Chris Anderson <jc...@apache.org> wrote:
> I'm glad you were able to confirm it is a timeout bug.
>
> What happens when you try your problematic data on a known good
> installation like CouchOne? If it works there then we'll know to
> concentrate on your server's peculiarities. If it doesn't work there,
> then we'll have a good shared location to debug from.
>
>
Re: bad views
Posted by Chris Anderson <jc...@apache.org>.
I'm glad you were able to confirm it is a timeout bug.
What happens when you try your problematic data on a known good
installation like CouchOne? If it works there then we'll know to
concentrate on your server's peculiarities. If it doesn't work there,
then we'll have a good shared location to debug from.
Chris
On Sun, Sep 19, 2010 at 7:36 PM, Kenneth Tyler <ke...@8thfold.com> wrote:
> i've tried again and confirmed, the same test will fail with a timeout
> error, then a couple of minutes later succeed, but take a longer time than
> the first one... go figure
>
> ken tyler
>
--
Chris Anderson
http://jchrisa.net
http://couch.io
Re: bad views
Posted by Kenneth Tyler <ke...@8thfold.com>.
i've tried again and confirmed, the same test will fail with a timeout
error, then a couple of minutes later succeed, but take a longer time than
the first one... go figure
ken tyler
Re: bad views
Posted by Kenneth Tyler <ke...@8thfold.com>.
there must be something besides a timeout going on
disign_doces test gives a timeout error and 9000 ms
and
3 mintues later
succeeds at 13100ms
seems like very erratic behavior
server says *Real memory* 1.84 GB total, 882.30 MB used
ken tyler
ken tyler
On Sun, Sep 19, 2010 at 6:38 PM, Kenneth Tyler <ke...@8thfold.com> wrote:
> so if i change the couchdb timeout from 5000 to 10000
>
> i get
> design_docs success12850ms
>
> i assume that there is still some sort of problem if the test views won't
> run in the 5 seconds
>
> ken tyler
>
Re: bad views
Posted by Kenneth Tyler <ke...@8thfold.com>.
so if i change the couchdb timeout from 5000 to 10000
i get
design_docssuccess12850ms
i assume that there is still some sort of problem if the test views won't
run in the 5 seconds
ken tyler
Re: bad views
Posted by Kenneth Tyler <ke...@8thfold.com>.
i'm working thru this
i ran the test suite and got a lot of failures... mostly all timeouts...
which i don't understand as there is lots of disk space and lots of memory
and very little running on this server
could some sort of permissions issue be causing it ?
ken tyler
jsonp failure 15947ms
1. Run with debuggerAssertion failed: xhr.status == 200
2. Assertion failed: false
3. Assertion failed: xhr.status == 400
large_docs error 5783ms
1. Run with debuggerException raised:
{"error":"timeout","reason":"{gen_server,call,\u000a [couch_view,\u000a
{get_group_server,<<\"test_suite_db\">>,\u000a {group,\u000a
<<121,159,222,28,222,160,8,29,210,86,91,25,37,34,244,241>>,\u000a
{db,<0.7503.0>,<0.7504.0>,nil,<<\"1284945064192822\">>,<0.7501.0>,\u000a
<0.7505.0>,\u000a {db_header,5,0,0,nil,nil,nil,0,nil,nil,1000},\u000a
0,\u000a {btree,<0.7501.0>,\u000a {46518,{4,0}},\u000a
#Fun<couch_db_updater.7.69395062>,\u000a
#Fun<couch_db_updater.8.86519079>,\u000a
#Fun<couch_btree.5.124754102>,\u000a
#Fun<couch_db_updater.9.24674233>},\u000a {btree,<0.7501.0>,\u000a
{46898,4},\u000a #Fun<couch_db_updater.10.90337910>,\u000a
#Fun<couch_db_updater.11.13595824>,\u000a
#Fun<couch_btree.5.124754102>,\u000a
#Fun<couch_db_updater.12.34906778>},\u000a
{btree,<0.7501.0>,nil,#Fun<couch_btree.0.83553141>,\u000a
#Fun<couch_btree.1.30790806>,\u000a
#Fun<couch_btree.2.124754102>,nil},\u000a 4,<<\"test_suite_db\">>,\u000a
\"/home/administrator/build-couchdb/build/var/lib/couchdb/test_suite_db.couch\",\u000a
[],[],nil,\u000a {user_ctx,null,[],undefined},\u000a
#Ref<0.0.0.144820>,1000,\u000a
[before_header,after_header,on_file_open],\u000a false},\u000a
nil,<<\"_temp\">>,<<\"javascript\">>,[],\u000a [{view,0,\u000a
[<<\"_temp\">>],\u000a <<\"(function (doc) {emit(null,
doc.longtest);})\">>,nil,[],\u000a []}],\u000a nil,0,0,nil,nil}}]}"}
list_views error 5411ms
1. Run with debuggerException raised:
{"error":"timeout","reason":"{gen_server,call,\u000a [couch_view,\u000a
{get_group_server,<<\"test_suite_db\">>,\u000a {group,\u000a
<<174,132,201,105,205,96,32,18,232,81,67,84,250,194,42,103>>,\u000a
nil,nil,<<\"_design/lists\">>,<<\"javascript\">>,[],\u000a [{view,0,\u000a
[<<\"basicView\">>],\u000a <<\"(function (doc) {emit(doc.integer,
doc.string);})\">>,nil,\u000a [{<<\"withReduce\">>,\u000a <<\"(function
(keys, values, rereduce) {if (rereduce) {return sum(values);} else {return
values.length;}})\">>}],\u000a []}],\u000a nil,0,0,nil,nil}}]}"}
lots_of_docs error 6082ms
1. Run with debuggerException raised:
{"error":"timeout","reason":"{gen_server,call,\u000a [couch_view,\u000a
{get_group_server,<<\"test_suite_db\">>,\u000a {group,\u000a
<<109,104,168,45,155,182,131,196,16,53,228,9,106,54,135,21>>,\u000a
{db,<0.7561.0>,<0.7562.0>,nil,<<\"1284945075858591\">>,<0.7559.0>,\u000a
<0.7563.0>,\u000a {db_header,5,0,0,nil,nil,nil,0,nil,nil,1000},\u000a
0,\u000a {btree,<0.7559.0>,\u000a {103437,{500,0}},\u000a
#Fun<couch_db_updater.7.69395062>,\u000a
#Fun<couch_db_updater.8.86519079>,\u000a
#Fun<couch_btree.5.124754102>,\u000a
#Fun<couch_db_updater.9.24674233>},\u000a {btree,<0.7559.0>,\u000a
{111433,500},\u000a #Fun<couch_db_updater.10.90337910>,\u000a
#Fun<couch_db_updater.11.13595824>,\u000a
#Fun<couch_btree.5.124754102>,\u000a
#Fun<couch_db_updater.12.34906778>},\u000a
{btree,<0.7559.0>,nil,#Fun<couch_btree.0.83553141>,\u000a
#Fun<couch_btree.1.30790806>,\u000a
#Fun<couch_btree.2.124754102>,nil},\u000a 500,<<\"test_suite_db\">>,\u000a
\"/home/administrator/build-couchdb/build/var/lib/couchdb/test_suite_db.couch\",\u000a
[],[],nil,\u000a {user_ctx,null,[],undefined},\u000a
#Ref<0.0.0.146043>,1000,\u000a
[before_header,after_header,on_file_open],\u000a false},\u000a
nil,<<\"_temp\">>,<<\"javascript\">>,[],\u000a [{view,0,\u000a
[<<\"_temp\">>],\u000a <<\"(function (doc) {emit(doc.integer,
null);})\">>,nil,[],\u000a []}],\u000a nil,0,0,nil,nil}}]}"}
method_override success 561ms
multiple_rows error 5846ms
1. Run with debuggerException raised:
{"error":"timeout","reason":"{gen_server,call,\u000a [couch_view,\u000a
{get_group_server,<<\"test_suite_db\">>,\u000a {group,\u000a
<<181,93,8,11,74,211,222,198,237,18,79,113,69,91,40,201>>,\u000a
{db,<0.7586.0>,<0.7587.0>,nil,<<\"1284945082897473\">>,<0.7584.0>,\u000a
<0.7588.0>,\u000a {db_header,5,0,0,nil,nil,nil,0,nil,nil,1000},\u000a
0,\u000a {btree,<0.7584.0>,\u000a {794,{3,0}},\u000a
#Fun<couch_db_updater.7.69395062>,\u000a
#Fun<couch_db_updater.8.86519079>,\u000a
#Fun<couch_btree.5.124754102>,\u000a
#Fun<couch_db_updater.9.24674233>},\u000a {btree,<0.7584.0>,\u000a
{994,3},\u000a #Fun<couch_db_updater.10.90337910>,\u000a
#Fun<couch_db_updater.11.13595824>,\u000a
#Fun<couch_btree.5.124754102>,\u000a
#Fun<couch_db_updater.12.34906778>},\u000a
{btree,<0.7584.0>,nil,#Fun<couch_btree.0.83553141>,\u000a
#Fun<couch_btree.1.30790806>,\u000a
#Fun<couch_btree.2.124754102>,nil},\u000a 3,<<\"test_suite_db\">>,\u000a
\"/home/administrator/build-couchdb/build/var/lib/couchdb/test_suite_db.couch\",\u000a
[],[],nil,\u000a {user_ctx,null,[],undefined},\u000a
#Ref<0.0.0.147225>,1000,\u000a
[before_header,after_header,on_file_open],\u000a false},\u000a
nil,<<\"_temp\">>,<<\"javascript\">>,[],\u000a [{view,0,\u000a
[<<\"_temp\">>],\u000a <<\"function(doc) { for (var i = 0; i <
doc.cities.length; i++) emit(doc.cities[i] + \\\", \\\" + doc._id,
null);}\">>,\u000a nil,[],[]}],\u000a nil,0,0,nil,nil}}]}"}
oauth success 6990ms
proxyauth success 2139ms
purge error 5386ms
1. Run with debuggerException raised:
{"error":"timeout","reason":"{gen_server,call,\u000a [couch_view,\u000a
{get_group_server,<<\"test_suite_db\">>,\u000a {group,\u000a
<<125,114,33,144,241,204,248,60,65,165,24,129,87,8,129,236>>,\u000a
nil,nil,<<\"_design/test\">>,<<\"javascript\">>,[],\u000a [{view,0,\u000a
[<<\"all_docs_twice\">>],\u000a <<\"function(doc) { emit(doc.integer, null);
emit(doc.integer, null) }\">>,\u000a nil,[],[]},\u000a {view,1,\u000a
[<<\"single_doc\">>],\u000a <<\"function(doc) { if (doc._id == \\\"1\\\") {
emit(1, null) }}\">>,\u000a nil,[],[]}],\u000a nil,0,0,nil,nil}}]}"}
reader_acl
Re: bad views
Posted by Kenneth Tyler <ke...@8thfold.com>.
actually,
looks like this is not about my imported data at all
i created a brand new database
a brand new document
with one field
when i went to temporary views and clicked on run, before even creating a
view
i get an error
this is the most difficult data environment to use i've ever tried to
learn... despite its surface look of complete simplicity... actually trying
to run it becomes and endless series of complex, un-understandable errors
ken tyler
Error: timeout
{gen_server,call,
[couch_view,
{get_group_server,<<"a_view_test">>,
{group,
<<245,195,83,255,25,184,62,149,85,203,60,66,54,94,118,249>>,
{db,<0.1137.0>,<0.1138.0>,nil,<<"1284943555629866">>,<0.1135.0>,
<0.1140.0>,
{db_header,5,1,0,{125,{1,0}},{235,1},nil,0,nil,nil,1000},
1,
{btree,<0.1135.0>,
{125,{1,0}},
#Fun<couch_db_updater.7.69395062>,
#Fun<couch_db_updater.8.86519079>,
#Fun<couch_btree.5.124754102>,
#Fun<couch_db_updater.9.24674233>},
{btree,<0.1135.0>,
{235,1},
#Fun<couch_db_updater.10.90337910>,
#Fun<couch_db_updater.11.13595824>,
#Fun<couch_btree.5.124754102>,
#Fun<couch_db_updater.12.34906778>},
{btree,<0.1135.0>,nil,#Fun<couch_btree.0.83553141>,
#Fun<couch_btree.1.30790806>,
#Fun<couch_btree.2.124754102>,nil},
1,<<"a_view_test">>,
"/home/administrator/build-couchdb/build/var/lib/couchdb/a_view_test.couch",
[],[],nil,
{user_ctx,null,[],undefined},
nil,1000,
[before_header,after_header,on_file_open],
false},
nil,<<"_temp">>,<<"javascript">>,[],
[{view,0,
[<<"_temp">>],
<<"function(doc) {\n emit(null, doc);\n}">>,nil,[],[]}],
nil,0,0,nil,nil}}]}
Re: bad views
Posted by Kenneth Tyler <ke...@8thfold.com>.
another symptom:
if i try and compact views in one of the "bad" databases, i get:
The view could not be compacted: {gen_server,call,
[couch_view,
{get_group_server,<<"g_wyght_47611">>,
{group,
<<143,227,38,213,39,16,222,38,43,128,238,78,41,80,127,81>>,
nil,nil,<<"_design/prototype">>,<<"javascript">>,[],
[{view,0,
[<<"files">>],
<<"function(doc) { if(doc.type=='file'){emit(doc.title,
doc);}}">>,
nil,[],[]},
{view,1,
[<<"wikis">>],
<<"function(doc) { if(doc.type=='wiki'){emit(doc.title,
doc);}}">>,
nil,[],[]},
{view,2,
[<<"breadcrumbs">>],
<<"function(doc) {if(doc.key){ emit(doc.key,
doc);}}">>,nil,
[],[]},
{view,3,
[<<"prototypes">>],
<<"function(doc) {if(doc.type=='prototype'){
emit(doc.title, doc);}}">>,
nil,[],[]}],
nil,0,0,nil,nil}}]}
i get a similar message if i try to "clean-up"
again, it really makes me wonder that importing data into couch has such
erratic effects... isn't there any kind of way to check text before
importing it to avoid these kinds of problems ????
ken tyler