You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Cao Manh Dat (JIRA)" <ji...@apache.org> on 2018/04/27 00:23:00 UTC
[jira] [Comment Edited] (SOLR-12278) Ignore very large document on
indexing
[ https://issues.apache.org/jira/browse/SOLR-12278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16455579#comment-16455579 ]
Cao Manh Dat edited comment on SOLR-12278 at 4/27/18 12:22 AM:
---------------------------------------------------------------
Thank [~dsmiley] for reviewing the patch, this is a quick patch help me demonstrate the idea of the solution so many things will be tuned before it can get committed.
[~dsmiley] [~wunder] I think that estimated size of an Object may be time-consuming to find out (so it will affect indexing). Because of using reflection (in RamUsageEstimator) or if the SolrInputDocument has million of fields. My plan for this new processor is to make it fast enough to be in default processor chain.
was (Author: caomanhdat):
Thank [~dsmiley] for reviewing the patch, this is a quick patch help me demonstrate the idea of the solution so many things will be tuned before it can get committed.
[~dsmiley] [~wunder] I think that estimated size of an Object may be time-consuming to find out. Because of using reflection (in RamUsageEstimator ) or if the SolrInputDocument has million of fields. My plan for this new processor is to make it fast enough to be in default processor chain.
> Ignore very large document on indexing
> --------------------------------------
>
> Key: SOLR-12278
> URL: https://issues.apache.org/jira/browse/SOLR-12278
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Cao Manh Dat
> Assignee: Cao Manh Dat
> Priority: Major
> Attachments: SOLR-12278.patch
>
>
> Solr should be able to ignore very large document, so it won't affect the index as well as the tlog.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org