You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@couchdb.apache.org by GitBox <gi...@apache.org> on 2020/06/03 11:07:46 UTC
[GitHub] [couchdb] raoyitao opened a new issue #2923: Memory limitation for couchjs when querying
raoyitao opened a new issue #2923:
URL: https://github.com/apache/couchdb/issues/2923
Got JSON.Parse error (out of memory) when querying by view, but cannot enlarge the memory limit for CouchJS
## Description
I have uploaded a big json document, ~8Mib, and I have a view in design doc, before I upload that big json to database, the view can work, but after that json uploaded, I get the error log:
================================================================out of memory
SyntaxError: JSON.parse
Stacktrace:
()@./share/server/main.js:1576
()@./share/server/main.js:1603
@./share/server/main.js:1
Failed to execute script.
[error] 2020-06-03T06:23:55.622680Z couchdb@127.0.0.1 <0.7929.545> -------- OS Process Error <0.9916.545> :: {os_process_error,{exit_status,1}}
[info] 2020-06-03T06:23:55.622835Z couchdb@127.0.0.1 <0.226.0> -------- couch_proc_manager <0.9916.545> died normal
[error] 2020-06-03T06:23:55.623181Z couchdb@127.0.0.1 emulator -------- Error in process <0.7929.545> on node 'couchdb@127.0.0.1' with exit value:
{{nocatch,{os_process_error,{exit_status,1}}},[{couch_os_process,prompt,2,[{file,"src/couch_os_process.erl"},{line,59}]},{couch_query_servers,map_doc_raw,2,[{file,"src/couch_query_servers.erl"},{line,68}]},{couch_mrview_updater,'-map_docs/2-fun-0-',3,[{file,"src/couch_mrview_updater.erl"},{line,199}]},{lists,foldl,3,[{file,"lists.erl"},{line,1263}]},{couch_mrview_updater,map_docs,2,[{file,"src/couch_mrview_updater.erl"},{line,206}]}]}
[error] 2020-06-03T06:23:55.623753Z couchdb@127.0.0.1 <0.9440.545> bfcf299af8 rexi_server: from: couchdb@127.0.0.1(<0.9427.545>) mfa: fabric_rpc:map_view/5 throw:{os_process_error,{exit_status,1}} [{couch_mrview_util,get_view_index_state,5,[{file,"src/couch_mrview_util.erl"},{line,137}]},{couch_mrview_util,get_view,4,[{file,"src/couch_mrview_util.erl"},{line,81}]},{couch_mrview,query_view,6,[{file,"src/couch_mrview.erl"},{line,247}]},{rexi_server,init_p,3,[{file,"src/rexi_server.erl"},{line,140}]}]
[error] 2020-06-03T06:23:55.624153Z couchdb@127.0.0.1 <0.9427.545> bfcf299af8 req_err(4089041121) os_process_error : {exit_status,1}
[<<"couch_mrview_util:get_view_index_state/5 L137">>,<<"couch_mrview_util:get_view/4 L81">>,<<"couch_mrview:query_view/6 L247">>,<<"rexi_server:init_p/3 L140">>]
[notice] 2020-06-03T06:23:55.624458Z couchdb@127.0.0.1 <0.9427.545> bfcf299af8 127.0.0.1:8430 161.144.139.30 undefined GET /testplan/_design/testdb/_view/by_upload_time?skip=0&limit=21&reduce=false 500 ok 13431
================================================================
Seems that the CouchJS reaches its memory limit, as I split that big json into 2 parts, and upload them respectively, then the issue went away. So I think I need to enlarge the memory limit. I found it in document: [https://docs.couchdb.org/en/2.3.1/config/query-servers.html](url)
**By default, couchjs limits the max runtime allocation to 64MiB. If you run into out of memory issue in your ddoc functions, you can adjust the memory limitation (here, increasing to 512 MiB):
COUCHDB_QUERY_SERVER_JAVASCRIPT="/usr/bin/couchjs -S 536870912 /usr/share/server/main.js"**
I tried that, change the value in "local.ini", even I make the limitation up to 2GiB, but it didn't work, still got "out of memory" error. As I observe the memory used by couch process, at most it takes up to ~300MiB
## Your Environment
* CouchDB version used: 2.3.1
* Browser name and version: Chrome V81
* Operating system and version: redhat enterprise 7.4
## Additional Context
[TIP]: # ( Add any other context about the problem here. )
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] janl closed issue #2923: Memory limitation for Couchjs does not work
Posted by GitBox <gi...@apache.org>.
janl closed issue #2923:
URL: https://github.com/apache/couchdb/issues/2923
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org