You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Yonik Seeley (JIRA)" <ji...@apache.org> on 2010/08/11 13:30:17 UTC
[jira] Created: (SOLR-2036) remove automatic fieldCache ram size
estimation
remove automatic fieldCache ram size estimation
-----------------------------------------------
Key: SOLR-2036
URL: https://issues.apache.org/jira/browse/SOLR-2036
Project: Solr
Issue Type: Bug
Reporter: Yonik Seeley
Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Resolved: (SOLR-2036) remove automatic fieldCache ram size
estimation
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley resolved SOLR-2036.
--------------------------------
Fix Version/s: 1.4.2
3.1
4.0
Resolution: Fixed
committed to trunk and the 3.1 and 1.4 branches.
> remove automatic fieldCache ram size estimation
> -----------------------------------------------
>
> Key: SOLR-2036
> URL: https://issues.apache.org/jira/browse/SOLR-2036
> Project: Solr
> Issue Type: Bug
> Reporter: Yonik Seeley
> Fix For: 1.4.2, 3.1, 4.0
>
> Attachments: SOLR-2036.patch
>
>
> Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
> http://search.lucidimagination.com/search/document/afdb2f0002fb8866/solr_1_4_stats_page_slow
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Updated: (SOLR-2036) remove automatic fieldCache ram size
estimation
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley updated SOLR-2036:
-------------------------------
Description:
Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
http://search.lucidimagination.com/search/document/afdb2f0002fb8866/solr_1_4_stats_page_slow
was:Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
> remove automatic fieldCache ram size estimation
> -----------------------------------------------
>
> Key: SOLR-2036
> URL: https://issues.apache.org/jira/browse/SOLR-2036
> Project: Solr
> Issue Type: Bug
> Reporter: Yonik Seeley
>
> Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
> http://search.lucidimagination.com/search/document/afdb2f0002fb8866/solr_1_4_stats_page_slow
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (SOLR-2036) remove automatic fieldCache ram size
estimation
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897227#action_12897227 ]
Yonik Seeley commented on SOLR-2036:
------------------------------------
>From the referenced email thread:
bq. we just deployed Solr 1.4.1 and the stats page takes over a minute to load for us as well and began causing OutOfMemory errors
It looks like the ram estimator puts every object into a map to keep track if it's been visited before - so this is definitely the source of the memory issues.
> remove automatic fieldCache ram size estimation
> -----------------------------------------------
>
> Key: SOLR-2036
> URL: https://issues.apache.org/jira/browse/SOLR-2036
> Project: Solr
> Issue Type: Bug
> Reporter: Yonik Seeley
>
> Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
> http://search.lucidimagination.com/search/document/afdb2f0002fb8866/solr_1_4_stats_page_slow
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Updated: (SOLR-2036) remove automatic fieldCache ram size
estimation
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley updated SOLR-2036:
-------------------------------
Attachment: SOLR-2036.patch
This patch should fix the bug and also remove ram estimation when insanity is detected.
> remove automatic fieldCache ram size estimation
> -----------------------------------------------
>
> Key: SOLR-2036
> URL: https://issues.apache.org/jira/browse/SOLR-2036
> Project: Solr
> Issue Type: Bug
> Reporter: Yonik Seeley
> Attachments: SOLR-2036.patch
>
>
> Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
> http://search.lucidimagination.com/search/document/afdb2f0002fb8866/solr_1_4_stats_page_slow
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (SOLR-2036) remove automatic fieldCache ram size
estimation
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897231#action_12897231 ]
Yonik Seeley commented on SOLR-2036:
------------------------------------
I think I just spotted a bug: the sanity checker itself does the ram-size estimation... so the slowdown and OOM issues would happen even if there was not "insanity". I'll work up a patch.
> remove automatic fieldCache ram size estimation
> -----------------------------------------------
>
> Key: SOLR-2036
> URL: https://issues.apache.org/jira/browse/SOLR-2036
> Project: Solr
> Issue Type: Bug
> Reporter: Yonik Seeley
>
> Don't estimate the size of the fieldCache entries, even on "insanity" (which can happen from perfectly sane Solr uses)
> http://search.lucidimagination.com/search/document/afdb2f0002fb8866/solr_1_4_stats_page_slow
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org