Re: Invalid version (expected 2, but 60) or the data in not in 'javabin' format exception while deleting 30k records

[Yago Riveiro <ya...@gmail.com>]

You have your GC tuned? 

In the pass I had a lot of problems with zookeeper as a result of GC pauses because my heap was too big.

Increase your heap to 20G or more, and use some of the configurations exposed in this thread http://wiki.apache.org/solr/ShawnHeisey

The first works fine for me with a heap with 24G. 

-- 
Yago Riveiro
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)


On Tuesday, January 7, 2014 at 3:54 PM, gpssolr2020 wrote:

> Thanks all for the reply.
> 
> we are working on that to reduce the delete query size.
> 
> But after that we faced one more issue.The issue is our batch process is
> able to delete 16k records but we got an OOM exception in one server.(out of
> 4 server in solrcloud).We are using solr 4.2 and zookeeper 3.4.5. and we are
> using sunjdk. we increased the heap size from 12 to 16 GB but no luck.we
> have 250GB ram dedicated only for solr and we have 100 million records.
> 
> we have We are getting the following error during the deletion process.
> 
> 
> org.apache.solr.common.SolrException; Error opening realtime searcher for
> deleteByQuery:java.lang.OutOfMemoryError: Java heap space
> 
> 
> org.apache.solr.common.SolrException; Error while trying to recover.
> core=pe_shard1_replica1:java.lang.IllegalStateException: this writ
> er hit an OutOfMemoryError; cannot commit
> 
> org.apache.solr.common.SolrException; auto commit
> error...:java.lang.IllegalStateException: this writer hit an
> OutOfMemoryError; cannot
> commit
> 
> 
> ERROR - org.apache.solr.common.SolrException;
> org.apache.solr.common.SolrException: Cannot talk to ZooKeeper - Updates are
> disabled.
> 
> 
> Note:Initially we got the same error when we index more than one million
> record at a time.So to fix that we divided data into two chunks and it is
> working fine now.
> 
> Please advise ..
> 
> 
> Thanks...
> 
> 
> 
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Invalid-version-expected-2-but-60-or-the-data-in-not-in-javabin-format-exception-while-deleting-30k-s-tp4109259p4109993.html
> Sent from the Solr - User mailing list archive at Nabble.com (http://Nabble.com).
> 
> 

Re: Invalid version (expected 2, but 60) or the data in not in 'javabin' format exception while deleting 30k records

[gpssolr2020 <ps...@gmail.com>]

Thanks. We will try with more heap.

And we noticed that zookeeper(open jdk) and Solr(sun jdk) is using different
jvm. Will this really cause this OOM issue ?.



--
View this message in context: http://lucene.472066.n3.nabble.com/Invalid-version-expected-2-but-60-or-the-data-in-not-in-javabin-format-exception-while-deleting-30k-s-tp4109259p4110538.html
Sent from the Solr - User mailing list archive at Nabble.com.