You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@couchdb.apache.org by Vishesh Mittal <vi...@platomedical.com> on 2017/01/01 13:36:04 UTC
Error in Syncing from CouchDB1.6 to CouchDB2.0
I am syncing all my databases from CouchDB 1.6 server to a CouchDB 2.0
server.
Most of the databases sync correctly. However, some of them are not
syncing. The log file shows the following error. Any clue?
Thank you so much
[error] 2017-01-01T13:27:46.123435Z couchdb@localhost emulator --------
Error in process <0.24284.71> on node couchdb@localhost with exit value:
{{nocatch,{mp_parser_died,noproc}},[{couch_att,'-foldl/4-fun-0-',3,[{file,"src/couch_att.erl"},{line,591}]},{couch_att,fold_streamed_data,4,[{file,"src/couch_att.erl"},{line,642}]},{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},{couch_httpd_multipart,atts_to_mp,4,[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]}
[error] 2017-01-01T13:27:46.126624Z couchdb@localhost <0.22292.71> --------
Replicator, request PUT to "https://dbuser:*****@
domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false"
failed due to error {error,
{'EXIT',
{{{nocatch,{mp_parser_died,noproc}},
[{couch_att,'-foldl/4-fun-0-',3,
[{file,"src/couch_att.erl"},{line,591}]},
{couch_att,fold_streamed_data,4,
[{file,"src/couch_att.erl"},{line,642}]},
{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
{couch_httpd_multipart,atts_to_mp,4,
[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
{gen_server,call,
[<0.21293.71>,
{send_req,
{{url,
"
https://dbuser:dbpassword@domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false
",
"domainname.com",443,"dbuser",
"dbpassword",
"/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false",
https,hostname},
[{"Accept","application/json"},
{"Content-Length",4189603},
{"Content-Type",
"multipart/related;
boundary=\"53ca4a19006ae47a8ae90ca4c20b53c3\""},
{"User-Agent","CouchDB-Replicator/2.0.0"}],
put,
{#Fun<couch_replicator_api_wrap.11.73678657>,
{<<"{\"_id\":\"332743f619a73eac3aa6b0137e131a42\",\"_rev\":\"3-4a83572c4e5010c254b8e14ed0647b7e\",\"type\":\"file\",\"folder_id\":\"b2f789dd56c44f22604e1fd3a7e6832f\",\"last_edited\":1433264101,\"priority\":2,\"original_filename\":\"00117/5.jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"4a83572c4e5010c254b8e14ed0647b7e\",\"dd0d5b019730b478ced047b875b76d61\",\"4cdf532cd8ad2101e4dd65b68b552ae8\"]},\"_attachments\":{\"pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"digest\":\"md5-skV4l0YZjqxi9E+8zfwOKw==\",\"length\":4188814,\"follows\":true}}}">>,
[{att,<<"pic.jpg">>,<<"image/jpeg">>,4188814,4188814,
<<178,69,120,151,70,25,142,172,98,244,79,188,205,252,
14,43>>,
2,
{follows,<0.21235.71>,#Ref<0.0.7340036.89524>},
identity}],
<<"53ca4a19006ae47a8ae90ca4c20b53c3">>,4189603}},
[{response_format,binary},
{inactivity_timeout,30000},
{is_ssl,true},
{socket_options,[{keepalive,true},{nodelay,false}]},
{ssl_options,[{depth,3},{verify,0}]}],
infinity}},
infinity]}}}}
[error] 2017-01-01T13:27:46.127162Z couchdb@localhost <0.19216.71> --------
Replicator, request PUT to "https://dbuser:*****@
domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false"
failed due to error {error,
{'EXIT',
{{{nocatch,{mp_parser_died,noproc}},
[{couch_att,'-foldl/4-fun-0-',3,
[{file,"src/couch_att.erl"},{line,591}]},
{couch_att,fold_streamed_data,4,
[{file,"src/couch_att.erl"},{line,642}]},
{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
{couch_httpd_multipart,atts_to_mp,4,
[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
{gen_server,call,
[<0.22144.71>,
{send_req,
{{url,
"
https://dbuser:dbpassword@domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false
",
"domainname.com",443,"dbuser",
"dbpassword",
"/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false",
https,hostname},
[{"Accept","application/json"},
{"Content-Length",4190105},
{"Content-Type",
"multipart/related;
boundary=\"c43b2dad07b5138dc9b30ada15e9ca5e\""},
{"User-Agent","CouchDB-Replicator/2.0.0"}],
put,
{#Fun<couch_replicator_api_wrap.11.73678657>,
{<<"{\"_id\":\"17a11816fa87774384e690a6c1cc70ff\",\"_rev\":\"3-16c5227fc08878733b41d80a0080afba\",\"type\":\"file\",\"folder_id\":\"c00e9ba24734ea5b9298e7eb59de6d53\",\"last_edited\":1433264101,\"priority\":1,\"original_filename\":\"00150/2.jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"16c5227fc08878733b41d80a0080afba\",\"bc6ba1602ea0e6118fc565a384acd4f7\",\"ff1e6b23f9cd9072ad9e2f6bbe9b7bf5\"]},\"_attachments\":{\"pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"digest\":\"md5-sPkZwLKmcTgYI5e0Ap01VQ==\",\"length\":4189312,\"follows\":true}}}">>,
[{att,<<"pic.jpg">>,<<"image/jpeg">>,4189312,4189312,
<<176,249,25,192,178,166,113,56,24,35,151,180,2,157,
53,85>>,
2,
{follows,<0.21439.71>,#Ref<0.0.7602179.21775>},
identity}],
<<"c43b2dad07b5138dc9b30ada15e9ca5e">>,4190105}},
[{response_format,binary},
{inactivity_timeout,30000},
{is_ssl,true},
{socket_options,[{keepalive,true},{nodelay,false}]},
{ssl_options,[{depth,3},{verify,0}]}],
infinity}},
infinity]}}}}
Re: Error in Syncing from CouchDB1.6 to CouchDB2.0
Posted by Vishesh Mittal <vi...@platomedical.com>.
Hi Jan
Thank you for replying. Unfortunately, the database is highly sensitive in
nature. And I am unable to reproduce this error with any other test
database.
I tried replicating this database with various different installations of
CouchDB. It syncs fine with version 1.6, and but it doesn't sync with any
version 2.0 installation. I also tried replicating it with Cloudant, and I
can't sync it with that either.
It does have something to with the attachments. I created a copy of this
database and deleted all the docs with attachments - and that seemed to
have resolved the issue. I just can't seem sync this database with the
current attachments it has (all JPG files).
Unfortunately, all the attachments are sensitive in nature - so I cannot
share them for testing.
For our purpose, we have found a workaround. But I wonder if there is ever
any way to reproduce this issue. Looking forward to your thoughts. Thanks.
I will open it as an issue on JIRA
warm regards
Vish
On Sun, Jan 8, 2017 at 2:28 AM, Jan Lehnardt <ja...@apache.org> wrote:
> Oh and can you open an issue at http://issues.apache.org/jira/
> browse/COUCHDB <http://issues.apache.org/jira/browse/COUCHDB> so we don’t
> lose track of this? Thank you!
>
> Best
> Jan
> --
>
> > On 1 Jan 2017, at 14:36, Vishesh Mittal <vi...@platomedical.com> wrote:
> >
> > I am syncing all my databases from CouchDB 1.6 server to a CouchDB 2.0
> server.
> >
> > Most of the databases sync correctly. However, some of them are not
> syncing. The log file shows the following error. Any clue?
> >
> > Thank you so much
> >
> >
> >
> > [error] 2017-01-01T13:27:46.123435Z couchdb@localhost emulator --------
> Error in process <0.24284.71> on node couchdb@localhost with exit value:
> > {{nocatch,{mp_parser_died,noproc}},[{couch_att,'-foldl/
> 4-fun-0-',3,[{file,"src/couch_att.erl"},{line,591}]},{couch_
> att,fold_streamed_data,4,[{file,"src/couch_att.erl"},{
> line,642}]},{couch_att,foldl,4,[{file,"src/couch_att.erl"},
> {line,595}]},{couch_httpd_multipart,atts_to_mp,4,[{file,
> "src/couch_httpd_multipart.erl"},{line,208}]}]}
> >
> > [error] 2017-01-01T13:27:46.126624Z couchdb@localhost <0.22292.71>
> -------- Replicator, request PUT to "https://dbuser:*****@domainna
> me.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false <
> http://domainname.com/sampledb/332743f619a73eac3aa6b0137e131a
> 42?new_edits=false>" failed due to error {error,
> > {'EXIT',
> > {{{nocatch,{mp_parser_died,noproc}},
> > [{couch_att,'-foldl/4-fun-0-',3,
> > [{file,"src/couch_att.erl"},{line,591}]},
> > {couch_att,fold_streamed_data,4,
> > [{file,"src/couch_att.erl"},{line,642}]},
> > {couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
> > {couch_httpd_multipart,atts_to_mp,4,
> > [{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
> > {gen_server,call,
> > [<0.21293.71>,
> > {send_req,
> > {{url,
> > "https://dbuser:dbpassword@
> domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false <
> https://dbuser:dbpassword@domainname.com/sampledb/
> 332743f619a73eac3aa6b0137e131a42?new_edits=false>",
> > "domainname.com <http://domainname.com/>",443,
> "dbuser",
> > "dbpassword",
> > "/sampledb/332743f619a73eac3aa6b0137e131a
> 42?new_edits=false",
> > https,hostname},
> > [{"Accept","application/json"},
> > {"Content-Length",4189603},
> > {"Content-Type",
> > "multipart/related; boundary=\"
> 53ca4a19006ae47a8ae90ca4c20b53c3\""},
> > {"User-Agent","CouchDB-Replicator/2.0.0"}],
> > put,
> > {#Fun<couch_replicator_api_wrap.11.73678657>,
> > {<<"{\"_id\":\"332743f619a73eac3aa6b0137e131a
> 42\",\"_rev\":\"3-4a83572c4e5010c254b8e14ed0647b7e\",\"type\":\"file\",\"
> folder_id\":\"b2f789dd56c44f22604e1fd3a7e6832f\",\"last_edited\":
> 1433264101,\"priority\":2,\"original_filename\":\"00117/5.
> jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"
> 4a83572c4e5010c254b8e14ed0647b7e\",\"dd0d5b019730b478ced047b875b76d61\",\"
> 4cdf532cd8ad2101e4dd65b68b552ae8\"]},\"_attachments\":{\"
> pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"
> digest\":\"md5-skV4l0YZjqxi9E+8zfwOKw==\",\"length\":
> 4188814,\"follows\":true}}}">>,
> > [{att,<<"pic.jpg">>,<<"image/
> jpeg">>,4188814,4188814,
> > <<178,69,120,151,70,25,142,
> 172,98,244,79,188,205,252,
> > 14,43>>,
> > 2,
> > {follows,<0.21235.71>,#Ref<0.
> 0.7340036.89524>},
> > identity}],
> > <<"53ca4a19006ae47a8ae90ca4c20b53c3">>,4189603}},
> > [{response_format,binary},
> > {inactivity_timeout,30000},
> > {is_ssl,true},
> > {socket_options,[{keepalive,true},{nodelay,false}]},
> > {ssl_options,[{depth,3},{verify,0}]}],
> > infinity}},
> > infinity]}}}}
> > [error] 2017-01-01T13:27:46.127162Z couchdb@localhost <0.19216.71>
> -------- Replicator, request PUT to "https://dbuser:*****@domainna
> me.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false <
> http://domainname.com/sampledb/17a11816fa87774384e690a6c1cc70
> ff?new_edits=false>" failed due to error {error,
> > {'EXIT',
> > {{{nocatch,{mp_parser_died,noproc}},
> > [{couch_att,'-foldl/4-fun-0-',3,
> > [{file,"src/couch_att.erl"},{line,591}]},
> > {couch_att,fold_streamed_data,4,
> > [{file,"src/couch_att.erl"},{line,642}]},
> > {couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
> > {couch_httpd_multipart,atts_to_mp,4,
> > [{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
> > {gen_server,call,
> > [<0.22144.71>,
> > {send_req,
> > {{url,
> > "https://dbuser:dbpassword@
> domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false <
> https://dbuser:dbpassword@domainname.com/sampledb/
> 17a11816fa87774384e690a6c1cc70ff?new_edits=false>",
> > "domainname.com <http://domainname.com/>",443,
> "dbuser",
> > "dbpassword",
> > "/sampledb/17a11816fa87774384e690a6c1cc70
> ff?new_edits=false",
> > https,hostname},
> > [{"Accept","application/json"},
> > {"Content-Length",4190105},
> > {"Content-Type",
> > "multipart/related; boundary=\"
> c43b2dad07b5138dc9b30ada15e9ca5e\""},
> > {"User-Agent","CouchDB-Replicator/2.0.0"}],
> > put,
> > {#Fun<couch_replicator_api_wrap.11.73678657>,
> > {<<"{\"_id\":\"17a11816fa87774384e690a6c1cc70
> ff\",\"_rev\":\"3-16c5227fc08878733b41d80a0080afba\",\"type\":\"file\",\"
> folder_id\":\"c00e9ba24734ea5b9298e7eb59de6d53\",\"last_edited\":
> 1433264101,\"priority\":1,\"original_filename\":\"00150/2.
> jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"
> 16c5227fc08878733b41d80a0080afba\",\"bc6ba1602ea0e6118fc565a384acd4f7\",\"
> ff1e6b23f9cd9072ad9e2f6bbe9b7bf5\"]},\"_attachments\":{\"
> pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"digest\":\"md5-
> sPkZwLKmcTgYI5e0Ap01VQ==\",\"length\":4189312,\"follows\":true}}}">>,
> > [{att,<<"pic.jpg">>,<<"image/
> jpeg">>,4189312,4189312,
> > <<176,249,25,192,178,166,113,
> 56,24,35,151,180,2,157,
> > 53,85>>,
> > 2,
> > {follows,<0.21439.71>,#Ref<0.
> 0.7602179.21775>},
> > identity}],
> > <<"c43b2dad07b5138dc9b30ada15e9ca5e">>,4190105}},
> > [{response_format,binary},
> > {inactivity_timeout,30000},
> > {is_ssl,true},
> > {socket_options,[{keepalive,true},{nodelay,false}]},
> > {ssl_options,[{depth,3},{verify,0}]}],
> > infinity}},
> > infinity]}}}}
> >
>
> --
> Professional Support for Apache CouchDB:
> https://neighbourhood.ie/couchdb-support/
>
>
--
*Vishesh Mittal*
Co-founder, Plato Medical
platomedical.com
+65 9068 5643
Re: Error in Syncing from CouchDB1.6 to CouchDB2.0
Posted by Jan Lehnardt <ja...@apache.org>.
Oh and can you open an issue at http://issues.apache.org/jira/browse/COUCHDB <http://issues.apache.org/jira/browse/COUCHDB> so we don’t lose track of this? Thank you!
Best
Jan
--
> On 1 Jan 2017, at 14:36, Vishesh Mittal <vi...@platomedical.com> wrote:
>
> I am syncing all my databases from CouchDB 1.6 server to a CouchDB 2.0 server.
>
> Most of the databases sync correctly. However, some of them are not syncing. The log file shows the following error. Any clue?
>
> Thank you so much
>
>
>
> [error] 2017-01-01T13:27:46.123435Z couchdb@localhost emulator -------- Error in process <0.24284.71> on node couchdb@localhost with exit value:
> {{nocatch,{mp_parser_died,noproc}},[{couch_att,'-foldl/4-fun-0-',3,[{file,"src/couch_att.erl"},{line,591}]},{couch_att,fold_streamed_data,4,[{file,"src/couch_att.erl"},{line,642}]},{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},{couch_httpd_multipart,atts_to_mp,4,[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]}
>
> [error] 2017-01-01T13:27:46.126624Z couchdb@localhost <0.22292.71> -------- Replicator, request PUT to "https://dbuser:*****@domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false <http://domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false>" failed due to error {error,
> {'EXIT',
> {{{nocatch,{mp_parser_died,noproc}},
> [{couch_att,'-foldl/4-fun-0-',3,
> [{file,"src/couch_att.erl"},{line,591}]},
> {couch_att,fold_streamed_data,4,
> [{file,"src/couch_att.erl"},{line,642}]},
> {couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
> {couch_httpd_multipart,atts_to_mp,4,
> [{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
> {gen_server,call,
> [<0.21293.71>,
> {send_req,
> {{url,
> "https://dbuser:dbpassword@domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false <https://dbuser:dbpassword@domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false>",
> "domainname.com <http://domainname.com/>",443,"dbuser",
> "dbpassword",
> "/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false",
> https,hostname},
> [{"Accept","application/json"},
> {"Content-Length",4189603},
> {"Content-Type",
> "multipart/related; boundary=\"53ca4a19006ae47a8ae90ca4c20b53c3\""},
> {"User-Agent","CouchDB-Replicator/2.0.0"}],
> put,
> {#Fun<couch_replicator_api_wrap.11.73678657>,
> {<<"{\"_id\":\"332743f619a73eac3aa6b0137e131a42\",\"_rev\":\"3-4a83572c4e5010c254b8e14ed0647b7e\",\"type\":\"file\",\"folder_id\":\"b2f789dd56c44f22604e1fd3a7e6832f\",\"last_edited\":1433264101,\"priority\":2,\"original_filename\":\"00117/5.jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"4a83572c4e5010c254b8e14ed0647b7e\",\"dd0d5b019730b478ced047b875b76d61\",\"4cdf532cd8ad2101e4dd65b68b552ae8\"]},\"_attachments\":{\"pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"digest\":\"md5-skV4l0YZjqxi9E+8zfwOKw==\",\"length\":4188814,\"follows\":true}}}">>,
> [{att,<<"pic.jpg">>,<<"image/jpeg">>,4188814,4188814,
> <<178,69,120,151,70,25,142,172,98,244,79,188,205,252,
> 14,43>>,
> 2,
> {follows,<0.21235.71>,#Ref<0.0.7340036.89524>},
> identity}],
> <<"53ca4a19006ae47a8ae90ca4c20b53c3">>,4189603}},
> [{response_format,binary},
> {inactivity_timeout,30000},
> {is_ssl,true},
> {socket_options,[{keepalive,true},{nodelay,false}]},
> {ssl_options,[{depth,3},{verify,0}]}],
> infinity}},
> infinity]}}}}
> [error] 2017-01-01T13:27:46.127162Z couchdb@localhost <0.19216.71> -------- Replicator, request PUT to "https://dbuser:*****@domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false <http://domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false>" failed due to error {error,
> {'EXIT',
> {{{nocatch,{mp_parser_died,noproc}},
> [{couch_att,'-foldl/4-fun-0-',3,
> [{file,"src/couch_att.erl"},{line,591}]},
> {couch_att,fold_streamed_data,4,
> [{file,"src/couch_att.erl"},{line,642}]},
> {couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
> {couch_httpd_multipart,atts_to_mp,4,
> [{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
> {gen_server,call,
> [<0.22144.71>,
> {send_req,
> {{url,
> "https://dbuser:dbpassword@domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false <https://dbuser:dbpassword@domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false>",
> "domainname.com <http://domainname.com/>",443,"dbuser",
> "dbpassword",
> "/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false",
> https,hostname},
> [{"Accept","application/json"},
> {"Content-Length",4190105},
> {"Content-Type",
> "multipart/related; boundary=\"c43b2dad07b5138dc9b30ada15e9ca5e\""},
> {"User-Agent","CouchDB-Replicator/2.0.0"}],
> put,
> {#Fun<couch_replicator_api_wrap.11.73678657>,
> {<<"{\"_id\":\"17a11816fa87774384e690a6c1cc70ff\",\"_rev\":\"3-16c5227fc08878733b41d80a0080afba\",\"type\":\"file\",\"folder_id\":\"c00e9ba24734ea5b9298e7eb59de6d53\",\"last_edited\":1433264101,\"priority\":1,\"original_filename\":\"00150/2.jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"16c5227fc08878733b41d80a0080afba\",\"bc6ba1602ea0e6118fc565a384acd4f7\",\"ff1e6b23f9cd9072ad9e2f6bbe9b7bf5\"]},\"_attachments\":{\"pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"digest\":\"md5-sPkZwLKmcTgYI5e0Ap01VQ==\",\"length\":4189312,\"follows\":true}}}">>,
> [{att,<<"pic.jpg">>,<<"image/jpeg">>,4189312,4189312,
> <<176,249,25,192,178,166,113,56,24,35,151,180,2,157,
> 53,85>>,
> 2,
> {follows,<0.21439.71>,#Ref<0.0.7602179.21775>},
> identity}],
> <<"c43b2dad07b5138dc9b30ada15e9ca5e">>,4190105}},
> [{response_format,binary},
> {inactivity_timeout,30000},
> {is_ssl,true},
> {socket_options,[{keepalive,true},{nodelay,false}]},
> {ssl_options,[{depth,3},{verify,0}]}],
> infinity}},
> infinity]}}}}
>
--
Professional Support for Apache CouchDB:
https://neighbourhood.ie/couchdb-support/
Re: Error in Syncing from CouchDB1.6 to CouchDB2.0
Posted by Jan Lehnardt <ja...@apache.org>.
Hi Vishesh,
this looks not right. Can you by chance share the affected database? It looks like it has to do with attachments. Can you share some informations about the type of docs and attachments you have?
Best
Jan
--
> On 1 Jan 2017, at 14:36, Vishesh Mittal <vi...@platomedical.com> wrote:
>
> I am syncing all my databases from CouchDB 1.6 server to a CouchDB 2.0 server.
>
> Most of the databases sync correctly. However, some of them are not syncing. The log file shows the following error. Any clue?
>
> Thank you so much
>
>
>
> [error] 2017-01-01T13:27:46.123435Z couchdb@localhost emulator -------- Error in process <0.24284.71> on node couchdb@localhost with exit value:
> {{nocatch,{mp_parser_died,noproc}},[{couch_att,'-foldl/4-fun-0-',3,[{file,"src/couch_att.erl"},{line,591}]},{couch_att,fold_streamed_data,4,[{file,"src/couch_att.erl"},{line,642}]},{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},{couch_httpd_multipart,atts_to_mp,4,[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]}
>
> [error] 2017-01-01T13:27:46.126624Z couchdb@localhost <0.22292.71> -------- Replicator, request PUT to "https://dbuser:*****@domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false <http://domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false>" failed due to error {error,
> {'EXIT',
> {{{nocatch,{mp_parser_died,noproc}},
> [{couch_att,'-foldl/4-fun-0-',3,
> [{file,"src/couch_att.erl"},{line,591}]},
> {couch_att,fold_streamed_data,4,
> [{file,"src/couch_att.erl"},{line,642}]},
> {couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
> {couch_httpd_multipart,atts_to_mp,4,
> [{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
> {gen_server,call,
> [<0.21293.71>,
> {send_req,
> {{url,
> "https://dbuser:dbpassword@domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false <https://dbuser:dbpassword@domainname.com/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false>",
> "domainname.com <http://domainname.com/>",443,"dbuser",
> "dbpassword",
> "/sampledb/332743f619a73eac3aa6b0137e131a42?new_edits=false",
> https,hostname},
> [{"Accept","application/json"},
> {"Content-Length",4189603},
> {"Content-Type",
> "multipart/related; boundary=\"53ca4a19006ae47a8ae90ca4c20b53c3\""},
> {"User-Agent","CouchDB-Replicator/2.0.0"}],
> put,
> {#Fun<couch_replicator_api_wrap.11.73678657>,
> {<<"{\"_id\":\"332743f619a73eac3aa6b0137e131a42\",\"_rev\":\"3-4a83572c4e5010c254b8e14ed0647b7e\",\"type\":\"file\",\"folder_id\":\"b2f789dd56c44f22604e1fd3a7e6832f\",\"last_edited\":1433264101,\"priority\":2,\"original_filename\":\"00117/5.jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"4a83572c4e5010c254b8e14ed0647b7e\",\"dd0d5b019730b478ced047b875b76d61\",\"4cdf532cd8ad2101e4dd65b68b552ae8\"]},\"_attachments\":{\"pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"digest\":\"md5-skV4l0YZjqxi9E+8zfwOKw==\",\"length\":4188814,\"follows\":true}}}">>,
> [{att,<<"pic.jpg">>,<<"image/jpeg">>,4188814,4188814,
> <<178,69,120,151,70,25,142,172,98,244,79,188,205,252,
> 14,43>>,
> 2,
> {follows,<0.21235.71>,#Ref<0.0.7340036.89524>},
> identity}],
> <<"53ca4a19006ae47a8ae90ca4c20b53c3">>,4189603}},
> [{response_format,binary},
> {inactivity_timeout,30000},
> {is_ssl,true},
> {socket_options,[{keepalive,true},{nodelay,false}]},
> {ssl_options,[{depth,3},{verify,0}]}],
> infinity}},
> infinity]}}}}
> [error] 2017-01-01T13:27:46.127162Z couchdb@localhost <0.19216.71> -------- Replicator, request PUT to "https://dbuser:*****@domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false <http://domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false>" failed due to error {error,
> {'EXIT',
> {{{nocatch,{mp_parser_died,noproc}},
> [{couch_att,'-foldl/4-fun-0-',3,
> [{file,"src/couch_att.erl"},{line,591}]},
> {couch_att,fold_streamed_data,4,
> [{file,"src/couch_att.erl"},{line,642}]},
> {couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},
> {couch_httpd_multipart,atts_to_mp,4,
> [{file,"src/couch_httpd_multipart.erl"},{line,208}]}]},
> {gen_server,call,
> [<0.22144.71>,
> {send_req,
> {{url,
> "https://dbuser:dbpassword@domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false <https://dbuser:dbpassword@domainname.com/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false>",
> "domainname.com <http://domainname.com/>",443,"dbuser",
> "dbpassword",
> "/sampledb/17a11816fa87774384e690a6c1cc70ff?new_edits=false",
> https,hostname},
> [{"Accept","application/json"},
> {"Content-Length",4190105},
> {"Content-Type",
> "multipart/related; boundary=\"c43b2dad07b5138dc9b30ada15e9ca5e\""},
> {"User-Agent","CouchDB-Replicator/2.0.0"}],
> put,
> {#Fun<couch_replicator_api_wrap.11.73678657>,
> {<<"{\"_id\":\"17a11816fa87774384e690a6c1cc70ff\",\"_rev\":\"3-16c5227fc08878733b41d80a0080afba\",\"type\":\"file\",\"folder_id\":\"c00e9ba24734ea5b9298e7eb59de6d53\",\"last_edited\":1433264101,\"priority\":1,\"original_filename\":\"00150/2.jpg\",\"_deleted\":true,\"_revisions\":{\"start\":3,\"ids\":[\"16c5227fc08878733b41d80a0080afba\",\"bc6ba1602ea0e6118fc565a384acd4f7\",\"ff1e6b23f9cd9072ad9e2f6bbe9b7bf5\"]},\"_attachments\":{\"pic.jpg\":{\"content_type\":\"image/jpeg\",\"revpos\":2,\"digest\":\"md5-sPkZwLKmcTgYI5e0Ap01VQ==\",\"length\":4189312,\"follows\":true}}}">>,
> [{att,<<"pic.jpg">>,<<"image/jpeg">>,4189312,4189312,
> <<176,249,25,192,178,166,113,56,24,35,151,180,2,157,
> 53,85>>,
> 2,
> {follows,<0.21439.71>,#Ref<0.0.7602179.21775>},
> identity}],
> <<"c43b2dad07b5138dc9b30ada15e9ca5e">>,4190105}},
> [{response_format,binary},
> {inactivity_timeout,30000},
> {is_ssl,true},
> {socket_options,[{keepalive,true},{nodelay,false}]},
> {ssl_options,[{depth,3},{verify,0}]}],
> infinity}},
> infinity]}}}}
>
--
Professional Support for Apache CouchDB:
https://neighbourhood.ie/couchdb-support/
Re: Error in Syncing from CouchDB1.6 to CouchDB2.0
Posted by Nick North <no...@gmail.com>.
The issue I found turns out to have been an inefficiency in multipart
parsing rather than an actual error (though it could cause crashes with
very large attachments). But the fix went in to CouchDB 1.6, so the problem
here is not obviously related.
The error comes from the code for sychronising document attachments: is
there anything relating to attachments that distinguishes the failed
databases from the successful ones? That might give a clue as to what's
going on.
Nick
On Fri, 13 Jan 2017 at 09:15 Nick North <no...@gmail.com> wrote:
> I'm trying to dredge the details from the depths of my memory. There were
> some replication problems with mime attachments, but I thought the patches
> went in before CouchDB 1.6, in which case there should not be any problems
> syncing with 2.0. I will check this evening and report back.
>
> Nick
>
> On Fri, 13 Jan 2017 at 08:35 Dave Cottlehuber <dc...@skunkwerks.at> wrote:
>
> On Sun, 1 Jan 2017, at 14:36, Vishesh Mittal wrote:
> > I am syncing all my databases from CouchDB 1.6 server to a CouchDB 2.0
> > server.
> >
> > Most of the databases sync correctly. However, some of them are not
> > syncing. The log file shows the following error. Any clue?
> >
> > Thank you so much
> >
> >
> >
> > [error] 2017-01-01T13:27:46.123435Z couchdb@localhost emulator --------
> > Error in process <0.24284.71> on node couchdb@localhost with exit value:
> >
> {{nocatch,{mp_parser_died,noproc}},[{couch_att,'-foldl/4-fun-0-',3,[{file,"src/couch_att.erl"},{line,591}]},{couch_att,fold_streamed_data,4,[{file,"src/couch_att.erl"},{line,642}]},{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},{couch_httpd_multipart,atts_to_mp,4,[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]}
>
> IIRC Nick came across something like this a few years ago, maybe he can
> shed some light on it.
>
> A+
> Dave
>
>
Re: Error in Syncing from CouchDB1.6 to CouchDB2.0
Posted by Nick North <no...@gmail.com>.
I'm trying to dredge the details from the depths of my memory. There were
some replication problems with mime attachments, but I thought the patches
went in before CouchDB 1.6, in which case there should not be any problems
syncing with 2.0. I will check this evening and report back.
Nick
On Fri, 13 Jan 2017 at 08:35 Dave Cottlehuber <dc...@skunkwerks.at> wrote:
> On Sun, 1 Jan 2017, at 14:36, Vishesh Mittal wrote:
> > I am syncing all my databases from CouchDB 1.6 server to a CouchDB 2.0
> > server.
> >
> > Most of the databases sync correctly. However, some of them are not
> > syncing. The log file shows the following error. Any clue?
> >
> > Thank you so much
> >
> >
> >
> > [error] 2017-01-01T13:27:46.123435Z couchdb@localhost emulator --------
> > Error in process <0.24284.71> on node couchdb@localhost with exit value:
> >
> {{nocatch,{mp_parser_died,noproc}},[{couch_att,'-foldl/4-fun-0-',3,[{file,"src/couch_att.erl"},{line,591}]},{couch_att,fold_streamed_data,4,[{file,"src/couch_att.erl"},{line,642}]},{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},{couch_httpd_multipart,atts_to_mp,4,[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]}
>
> IIRC Nick came across something like this a few years ago, maybe he can
> shed some light on it.
>
> A+
> Dave
>
Re: Error in Syncing from CouchDB1.6 to CouchDB2.0
Posted by Dave Cottlehuber <dc...@skunkwerks.at>.
On Sun, 1 Jan 2017, at 14:36, Vishesh Mittal wrote:
> I am syncing all my databases from CouchDB 1.6 server to a CouchDB 2.0
> server.
>
> Most of the databases sync correctly. However, some of them are not
> syncing. The log file shows the following error. Any clue?
>
> Thank you so much
>
>
>
> [error] 2017-01-01T13:27:46.123435Z couchdb@localhost emulator --------
> Error in process <0.24284.71> on node couchdb@localhost with exit value:
> {{nocatch,{mp_parser_died,noproc}},[{couch_att,'-foldl/4-fun-0-',3,[{file,"src/couch_att.erl"},{line,591}]},{couch_att,fold_streamed_data,4,[{file,"src/couch_att.erl"},{line,642}]},{couch_att,foldl,4,[{file,"src/couch_att.erl"},{line,595}]},{couch_httpd_multipart,atts_to_mp,4,[{file,"src/couch_httpd_multipart.erl"},{line,208}]}]}
IIRC Nick came across something like this a few years ago, maybe he can
shed some light on it.
A+
Dave