Bad performance when storing documents

[Sebastjan Trepca <tr...@gmail.com>]

Hi,

downloaded latest version (0.8.1) and did some tests on it. GET's are
fast, but POST's are pretty disappointing. I am using the default
configuration on my Macbook Pro and it can process only 7
POSTs/second. Am I missing something?

Thanks,
Sebastjan

Re: Bad performance when storing documents

[Sebastjan Trepca <tr...@gmail.com>]

Daamn, trunk version is 30 times faster! You need to release a new
version ASAP! :) Erlang was the latest.

Sebastjan



On Tue, Feb 10, 2009 at 12:48 AM, Sebastjan Trepca <tr...@gmail.com> wrote:
> Wow, thanks guys for quick response! I'll try it out.
>
> Sebastjan
>
>
>
> On Tue, Feb 10, 2009 at 12:37 AM, Paul Davis
> <pa...@gmail.com> wrote:
>> On Mon, Feb 9, 2009 at 6:30 PM, Sebastjan Trepca <tr...@gmail.com> wrote:
>>> Hi,
>>>
>>> downloaded latest version (0.8.1) and did some tests on it. GET's are
>>> fast, but POST's are pretty disappointing. I am using the default
>>> configuration on my Macbook Pro and it can process only 7
>>> POSTs/second. Am I missing something?
>>>
>>> Thanks,
>>> Sebastjan
>>>
>>
>> 1. Use _bulk_docs. The more docs you can load in a single request the
>> more improvement you'll get. This is a direct RAM/speed tradeoff.
>> 2. Use trunk. There have been numerous speed improvements since 0.8.
>> You could also try the couchdb-devel port, but I'm not sure where it
>> exactly in terms of SVN revision. I'm 95% certain there have been a
>> few more patches that should improve speed since then.
>> 3. Less importantly, but jchris would be upset if I didn't mention, if
>> you can use sorted docids when inserting you can squeeze out more
>> performance.
>>
>> HTH,
>> Paul Davis
>>
>> Also, what Chris says. If your erlang VM is 5.5.5 or there abouts
>> (check with `erl`) you're hitting a bug in erlang itself that's fixed
>> with the newer RC's that are recommended for use.
>>
>

Re: Bad performance when storing documents

[Sebastjan Trepca <tr...@gmail.com>]

Wow, thanks guys for quick response! I'll try it out.

Sebastjan



On Tue, Feb 10, 2009 at 12:37 AM, Paul Davis
<pa...@gmail.com> wrote:
> On Mon, Feb 9, 2009 at 6:30 PM, Sebastjan Trepca <tr...@gmail.com> wrote:
>> Hi,
>>
>> downloaded latest version (0.8.1) and did some tests on it. GET's are
>> fast, but POST's are pretty disappointing. I am using the default
>> configuration on my Macbook Pro and it can process only 7
>> POSTs/second. Am I missing something?
>>
>> Thanks,
>> Sebastjan
>>
>
> 1. Use _bulk_docs. The more docs you can load in a single request the
> more improvement you'll get. This is a direct RAM/speed tradeoff.
> 2. Use trunk. There have been numerous speed improvements since 0.8.
> You could also try the couchdb-devel port, but I'm not sure where it
> exactly in terms of SVN revision. I'm 95% certain there have been a
> few more patches that should improve speed since then.
> 3. Less importantly, but jchris would be upset if I didn't mention, if
> you can use sorted docids when inserting you can squeeze out more
> performance.
>
> HTH,
> Paul Davis
>
> Also, what Chris says. If your erlang VM is 5.5.5 or there abouts
> (check with `erl`) you're hitting a bug in erlang itself that's fixed
> with the newer RC's that are recommended for use.
>

Re: Bad performance when storing documents

[Paul Davis <pa...@gmail.com>]

On Mon, Feb 9, 2009 at 6:30 PM, Sebastjan Trepca <tr...@gmail.com> wrote:
> Hi,
>
> downloaded latest version (0.8.1) and did some tests on it. GET's are
> fast, but POST's are pretty disappointing. I am using the default
> configuration on my Macbook Pro and it can process only 7
> POSTs/second. Am I missing something?
>
> Thanks,
> Sebastjan
>

1. Use _bulk_docs. The more docs you can load in a single request the
more improvement you'll get. This is a direct RAM/speed tradeoff.
2. Use trunk. There have been numerous speed improvements since 0.8.
You could also try the couchdb-devel port, but I'm not sure where it
exactly in terms of SVN revision. I'm 95% certain there have been a
few more patches that should improve speed since then.
3. Less importantly, but jchris would be upset if I didn't mention, if
you can use sorted docids when inserting you can squeeze out more
performance.

HTH,
Paul Davis

Also, what Chris says. If your erlang VM is 5.5.5 or there abouts
(check with `erl`) you're hitting a bug in erlang itself that's fixed
with the newer RC's that are recommended for use.

Re: Bad performance when storing documents

[Chris Anderson <jc...@apache.org>]

On Mon, Feb 9, 2009 at 3:30 PM, Sebastjan Trepca <tr...@gmail.com> wrote:
> Hi,
>
> downloaded latest version (0.8.1) and did some tests on it. GET's are
> fast, but POST's are pretty disappointing. I am using the default
> configuration on my Macbook Pro and it can process only 7
> POSTs/second. Am I missing something?
>

Yes. You are likely running an old version of Erlang (usually 0.8.1 is
much faster than that). It is also recommended that you try svn trunk,
which is faster than 0.8.1 and has a lot of the features people are
talking about these days.

For link to svn repository: http://couchdb.apache.org/community/code.html

See the Readme for Erlang version information.

Chris

-- 
Chris Anderson
http://jchris.mfdz.com