You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@couchdb.apache.org by "Francesco (JIRA)" <ji...@apache.org> on 2012/06/04 22:18:23 UTC
[jira] [Created] (COUCHDB-1490) Problems with views on large
documents JSONs
Francesco created COUCHDB-1490:
----------------------------------
Summary: Problems with views on large documents JSONs
Key: COUCHDB-1490
URL: https://issues.apache.org/jira/browse/COUCHDB-1490
Project: CouchDB
Issue Type: Bug
Affects Versions: 1.2
Environment: Mac Os x 10.6.8, intel Architecture (x86), 8Gb of Ram
Reporter: Francesco
Hi,
i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
os x version 10.6.8) installed with brew.
The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
A typical map is:
function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
doc);}
but even a
function(doc){emit(doc.ID, doc.ID)}
cease to work.
while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418316#comment-13418316 ]
Francesco commented on COUCHDB-1490:
------------------------------------
Hi, tried on Ubuntu 12.04 x64 (i7 16gb ram) compiled latest stable with https://github.com/iriscouch/build-couchdb/ libmoz1.8.5 and erlang V5.9 the result is the same as the one on macOSx (in attachment)
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292732#comment-13292732 ]
Francesco commented on COUCHDB-1490:
------------------------------------
We tried on an old linux (x86, 1 GB of RAM) machine with CouchDB 1.0.1 (Erlang R14B02/5.8.3) and the views are working with more than 3 JSON (we're trying to import more, to see what's the limit). Seems like a CouchDB 1.2.0 issue.
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Francesco updated COUCHDB-1490:
-------------------------------
Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1) (was: Mac Os x 10.6.8, intel Architecture (x86), 8Gb of Ram)
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292762#comment-13292762 ]
Francesco commented on COUCHDB-1490:
------------------------------------
On the linux machine (CouchDB 1.0.1) ldd reports limozjs185-1.0, mac os x (CouchDB 1.2.0) otool -L reports libmoxjs185.1.0.0 (i can assume it's the same as the linux one).
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291826#comment-13291826 ]
Francesco commented on COUCHDB-1490:
------------------------------------
Ryan,
well ATM is true we don't bacause we stopped expanding the project due this prblem, but querying some parts of the model might be done in the future if this problem is resolved.
Thank you anyway for the suggestion.
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292818#comment-13292818 ]
Francesco commented on COUCHDB-1490:
------------------------------------
Doing the same here, installing everything through homebrew.
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Francesco updated COUCHDB-1490:
-------------------------------
Attachment: error.log
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
> Attachments: error.log
>
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Robert Newson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292810#comment-13292810 ]
Robert Newson commented on COUCHDB-1490:
----------------------------------------
Yup. I am using homebrew for these tests.
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Francesco (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292805#comment-13292805 ]
Francesco commented on COUCHDB-1490:
------------------------------------
This is the version of couchdb that brew downloads and compile http://ftp.mozilla.org/pub/mozilla.org/js/js185-1.0.0.tar.gz
Nonetheless with 1.2.0 with the above configuration i get timeouts.
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Robert Newson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292800#comment-13292800 ]
Robert Newson commented on COUCHDB-1490:
----------------------------------------
I get the timeout (OS X 10.7.4) with couchdb 1.2.0 using spidermonkey 1.7.0 but not when using spidermonkey 1.8.5. I've done this test several times and it's consistent. Works 100% with 1.8.5 (I used 20 copies of the 2LG document) and 0% with 1.7.0.
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Ryan Richt (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291782#comment-13291782 ]
Ryan Richt commented on COUCHDB-1490:
-------------------------------------
Francesco,
I'm guessing you dont need to do any M/R indexing over the protein structure description (the model / atoms) that make up most of the document.
If this is true, move all of that su-tree of the JSON to a binary attachment. You can't M/R over it, and the doc will be about the same size, but the amount of data the view indexer has to pack/unpack will be greatly reduced and your problem should go away. I know that's not a real solution, but it is more in-line with the intended use cases of CouchDB.
we've seen documents work best when the JSON is a few kB to a few MB, but attachments can be GB range without issues.
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COUCHDB-1490) Problems with views on large
documents JSONs
Posted by "Paul Joseph Davis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/COUCHDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13292747#comment-13292747 ]
Paul Joseph Davis commented on COUCHDB-1490:
--------------------------------------------
What version(s) of SpiderMonkey are you using?
> Problems with views on large documents JSONs
> --------------------------------------------
>
> Key: COUCHDB-1490
> URL: https://issues.apache.org/jira/browse/COUCHDB-1490
> Project: CouchDB
> Issue Type: Bug
> Affects Versions: 1.2
> Environment: Mac Os x 10.6.8, intel Architecture (x86_64), 8Gb of Ram, Erlang R15B01 (erts-5.9.1)
> Reporter: Francesco
>
> Hi,
> i run a couchdb server (v1.2.0) over a mac (intel architecture, 8gb of ram,
> os x version 10.6.8) installed with brew.
> The server itself is used as a storage of big jsons (example: https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2LGB-pretty-print.json and https://raw.github.com/cvdlab-bio/webpdb/develop/docs/jsons/2CRK-pretty-print.json ) for a tiny uni project.
> When we load more than 3 of these jsons, all the map functions (we created to retrieve documents besides a simple get by id) does not work.
> A typical map is:
> function(doc){if(doc.TITLE.title.match('.*INSULIN.*') !== null) emit(doc.ID,
> doc);}
> but even a
> function(doc){emit(doc.ID, doc.ID)}
> cease to work.
> while when there are just 3 or 2 jsons in the database they work just fine. I tried increasing the stack for couchjs (1gb now, going over 1gb doesn't work it seems), increasing limits for files (4096), increasing timeout for processes but in the end i don't get any results and only a (Error:
> os_process_error {exit_status,0}) from the db.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira