You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@couchdb.apache.org by Stefan Kögl <ko...@gmail.com> on 2012/02/23 07:46:03 UTC
View indexing slow on 1.2 branch
Hi,
For testing purposes I've been replicating a database
(doc_count:24712508, doc_del_count: 769920, update_seq: 135828514) to
another Couch instance built from the current 1.2.x branch (pull
replication using replicator db, if that's relevant). Both databases
are running on virtual machines with similar setups.
However the indexing of the views on the 1.2 couch are considerably
slower (maybe 1/10 of the speed) than on the other server. As far as I
can tell, its not the hardware that's causing the low performance,
because the VM's CPU is hardly active (~20% CPU by beam.smp, maybe ~1%
for couchjs, nothing else active) and disk performance seems OK based
on some tests.
I've already applied some of the performance tips from
http://wiki.apache.org/couchdb/Performance
but that didn't bring any improvement.
Do you have any tips how to analyze performance bottlenecks, or any
suggestions on how to improve performance?
Thanks!
-- Stefan
Re: View indexing slow on 1.2 branch
Posted by Jason Smith <jh...@iriscouch.com>.
I think several of the developers have seen your issue, a view
indexing performance hit of about 25%.
Git bisect indicates this began at commit f0230527
https://github.com/apache/couchdb/commit/f0230527
I was thinking of reverting it (with some gnarly conflicts), and
perhaps break it into logical sub-commits to identify the source.
Filipe, what do you think?
Script to test: http://friendpaste.com/1Z1pBlZ8x4GemalOxBvYQq
On Fri, Feb 24, 2012 at 7:32 AM, Stefan Kögl <ko...@gmail.com> wrote:
> Hi,
>
> On Thu, Feb 23, 2012 at 1:26 PM, Bob Dionne
> <di...@dionne-associates.com> wrote:
>> could you possibly try using this release candidate?
>>
>> http://people.apache.org/~nslater/dist/1.2.0/
>
> I've now installed the release candidate of the 2nd round and beam.smp
> and couchjs are currently maxing out the CPU. The view is not fully
> built, but I'll keep monitoring it and report back if the performance
> decreases at a later stage.
>
> The design document is available at
>
> https://github.com/gpodder/mygpo/tree/master/mygpo/users/_design
>
> but the data is not public.
>
>
> -- Stefan
--
Iris Couch
Re: View indexing slow on 1.2 branch
Posted by Jason Smith <jh...@iriscouch.com>.
I think several of the developers have seen your issue, a view
indexing performance hit of about 25%.
Git bisect indicates this began at commit f0230527
https://github.com/apache/couchdb/commit/f0230527
I was thinking of reverting it (with some gnarly conflicts), and
perhaps break it into logical sub-commits to identify the source.
Filipe, what do you think?
Script to test: http://friendpaste.com/1Z1pBlZ8x4GemalOxBvYQq
On Fri, Feb 24, 2012 at 7:32 AM, Stefan Kögl <ko...@gmail.com> wrote:
> Hi,
>
> On Thu, Feb 23, 2012 at 1:26 PM, Bob Dionne
> <di...@dionne-associates.com> wrote:
>> could you possibly try using this release candidate?
>>
>> http://people.apache.org/~nslater/dist/1.2.0/
>
> I've now installed the release candidate of the 2nd round and beam.smp
> and couchjs are currently maxing out the CPU. The view is not fully
> built, but I'll keep monitoring it and report back if the performance
> decreases at a later stage.
>
> The design document is available at
>
> https://github.com/gpodder/mygpo/tree/master/mygpo/users/_design
>
> but the data is not public.
>
>
> -- Stefan
--
Iris Couch
Re: View indexing slow on 1.2 branch
Posted by Stefan Kögl <ko...@gmail.com>.
Hi,
On Thu, Feb 23, 2012 at 1:26 PM, Bob Dionne
<di...@dionne-associates.com> wrote:
> could you possibly try using this release candidate?
>
> http://people.apache.org/~nslater/dist/1.2.0/
I've now installed the release candidate of the 2nd round and beam.smp
and couchjs are currently maxing out the CPU. The view is not fully
built, but I'll keep monitoring it and report back if the performance
decreases at a later stage.
The design document is available at
https://github.com/gpodder/mygpo/tree/master/mygpo/users/_design
but the data is not public.
-- Stefan
Re: View indexing slow on 1.2 branch
Posted by Bob Dionne <di...@dionne-associates.com>.
Stefan,
could you possibly try using this release candidate?
http://people.apache.org/~nslater/dist/1.2.0/
Bob
On Feb 23, 2012, at 1:46 AM, Stefan Kögl wrote:
> Hi,
>
> For testing purposes I've been replicating a database
> (doc_count:24712508, doc_del_count: 769920, update_seq: 135828514) to
> another Couch instance built from the current 1.2.x branch (pull
> replication using replicator db, if that's relevant). Both databases
> are running on virtual machines with similar setups.
>
> However the indexing of the views on the 1.2 couch are considerably
> slower (maybe 1/10 of the speed) than on the other server. As far as I
> can tell, its not the hardware that's causing the low performance,
> because the VM's CPU is hardly active (~20% CPU by beam.smp, maybe ~1%
> for couchjs, nothing else active) and disk performance seems OK based
> on some tests.
>
> I've already applied some of the performance tips from
>
> http://wiki.apache.org/couchdb/Performance
>
> but that didn't bring any improvement.
>
> Do you have any tips how to analyze performance bottlenecks, or any
> suggestions on how to improve performance?
>
> Thanks!
>
>
> -- Stefan
Re: View indexing slow on 1.2 branch
Posted by Jason Smith <jh...@iriscouch.com>.
Hi, Stefan. Is your data set and design document public? Would it be
possible to share them with the community so that people can run the
same tests you are and get to the bottom of this issue?
On Thu, Feb 23, 2012 at 6:46 AM, Stefan Kögl <ko...@gmail.com> wrote:
> Hi,
>
> For testing purposes I've been replicating a database
> (doc_count:24712508, doc_del_count: 769920, update_seq: 135828514) to
> another Couch instance built from the current 1.2.x branch (pull
> replication using replicator db, if that's relevant). Both databases
> are running on virtual machines with similar setups.
>
> However the indexing of the views on the 1.2 couch are considerably
> slower (maybe 1/10 of the speed) than on the other server. As far as I
> can tell, its not the hardware that's causing the low performance,
> because the VM's CPU is hardly active (~20% CPU by beam.smp, maybe ~1%
> for couchjs, nothing else active) and disk performance seems OK based
> on some tests.
>
> I've already applied some of the performance tips from
>
> http://wiki.apache.org/couchdb/Performance
>
> but that didn't bring any improvement.
>
> Do you have any tips how to analyze performance bottlenecks, or any
> suggestions on how to improve performance?
>
> Thanks!
>
>
> -- Stefan
--
Iris Couch