solr-cloud performance decrease day by day

[qibaoyuan <qi...@gmail.com>]

Hello,
   i am using sold 4.1.0 and ihave used sold cloud in my product.I have found at first everything seems good,the search time is fast and delay is slow,but it becomes very slow after days.does any one knows if there maybe some params or optimization to use sold cloud?

Re: solr-cloud performance decrease day by day

[Jack Krupansky <ja...@basetechnology.com>]

How are you committing data? With 4.0, CommitWithin is now a soft commit, 
which means that the transaction log will grow until you do a hard commit. 
You need to periodically do a hard commit if you are continually updating 
the index. How much updating are you doing?

Also, check how much heap is available about you first start the server and 
have done a few queries and then monitor heap available over time. Maybe you 
are hitting garbage collections. Maybe you have too much heap allocated so 
that even a normal Java GC just takes a very long time because so much 
garbage accumulates - which is why you want only a modest amount of heap 
available above what the data needs after a few queries have loaded caches.

-- Jack Krupansky

-----Original Message----- 
From: qibaoyuan
Sent: Friday, April 19, 2013 3:15 AM
To: solr-user@lucene.apache.org
Subject: solr-cloud performance decrease day by day

Hello,
   i am using sold 4.1.0 and ihave used sold cloud in my product.I have 
found at first everything seems good,the search time is fast and delay is 
slow,but it becomes very slow after days.does any one knows if there maybe 
some params or optimization to use sold cloud?= 

Re: solr-cloud performance decrease day by day

[al...@aim.com]

How many segments each shard has and what is the reason of running multiple shards in one machine?

Alex.

 

 

 

-----Original Message-----
From: qibaoyuan <qi...@gmail.com>
To: solr-user <so...@lucene.apache.org>
Sent: Fri, Apr 19, 2013 12:26 am
Subject: Re: solr-cloud performance decrease day by day


there are 6 shards and they are in one machine,and the jvm param is very big,the 
physical memory is 16GB,the total #docs is about 150k,the index size of each 
shard is about 1GB.AND there is indexing while searching,I USE auto commit  each 
10min.and the data comes about 100 per minutes. 


在 2013-4-19，下午3:17，Furkan KAMACI <fu...@gmail.com> 写道：

> Could you give more info about your index size and technical details of
> your machine? Maybe you are indexing more data day by day and your RAM
> capability is not enough anymore?
> 
> 2013/4/19 qibaoyuan <qi...@gmail.com>
> 
>> Hello,
>>   i am using sold 4.1.0 and ihave used sold cloud in my product.I have
>> found at first everything seems good,the search time is fast and delay is
>> slow,but it becomes very slow after days.does any one knows if there maybe
>> some params or optimization to use sold cloud?


 

Re: solr-cloud performance decrease day by day

[qibaoyuan <qi...@gmail.com>]

there are 6 shards and they are in one machine,and the jvm param is very big,the physical memory is 16GB,the total #docs is about 150k,the index size of each shard is about 1GB.AND there is indexing while searching,I USE auto commit  each 10min.and the data comes about 100 per minutes. 


在 2013-4-19，下午3:17，Furkan KAMACI <fu...@gmail.com> 写道：

> Could you give more info about your index size and technical details of
> your machine? Maybe you are indexing more data day by day and your RAM
> capability is not enough anymore?
> 
> 2013/4/19 qibaoyuan <qi...@gmail.com>
> 
>> Hello,
>>   i am using sold 4.1.0 and ihave used sold cloud in my product.I have
>> found at first everything seems good,the search time is fast and delay is
>> slow,but it becomes very slow after days.does any one knows if there maybe
>> some params or optimization to use sold cloud?

Re: solr-cloud performance decrease day by day

[Furkan KAMACI <fu...@gmail.com>]

Could you give more info about your index size and technical details of
your machine? Maybe you are indexing more data day by day and your RAM
capability is not enough anymore?

2013/4/19 qibaoyuan <qi...@gmail.com>

> Hello,
>    i am using sold 4.1.0 and ihave used sold cloud in my product.I have
> found at first everything seems good,the search time is fast and delay is
> slow,but it becomes very slow after days.does any one knows if there maybe
> some params or optimization to use sold cloud?