You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Jaime <j....@estructure.es> on 2016/07/11 11:45:56 UTC
Reduce index size without reopening IndexWriter
I use Lucene 6.1.0 (no solr) with NRT search. At runtime, my index seems
to grow a lot.
I think that for each commit, a new copy of the index is made. This
makes sense as an old searcher could be using the previous version.
However, the old copies don't seem to be erased until I close and reopen
the Index Writer.
I've tried calling IndexWriter.deleteUnusedFiles after each commit, but
didn't help.
Is there any way to free space without closing the IndexWriter?
--
Jaime Pardos
ESTRUCTURE MEDIA SYSTEMS, S.L.
Avda. de Madrid nº 120 nave 10, 28500, Arganda del Rey, MADRID,
j.pardos@estructure.es
910088429
AVISO LEGAL: Este mensaje y sus archivos adjuntos van dirigidos exclusivamente a su destinatario, pudiendo contener información confidencial sometida a secreto confidencial. No está permitida su reproducción o distribución sin la autorización expresa de ESTRUCTURE MEDIA SYSTEMS, S.L.. Si usted no es el destinatario final por favor elimínelo e infórmenos por esta vía. De acuerdo con lo establecido en la Ley Orgánica 15/1999, de 13 de diciembre, de Protección de Datos de Carácter Personal (LOPD), le informamos que sus datos están incorporados en un fichero del que es titular ESTRUCTURE MEDIA SYSTEMS, S.L. con la finalidad de realizar la gestión administrativa, contable, y fiscal, así como enviarle comunicaciones comerciales sobre nuestros productos y/o servicios. Asimismo, le informamos de la posibilidad de ejercer los derechos de acceso, rectificación, cancelación y oposición de sus datos en el domicilio de ESTRUCTURE MEDIA SYSTEMS, S.L., sito en Avda. de Madrid nº 120 nave 10, 28500, Arganda del Rey, MADRID, o a la dirección de correo electrónico info@estructure.es.
This message and its attachments are intended solely for the addressee and may contain confidential information submitted to confidential secret. It is not allowed its reproduction or distribution without the express permission of ESTRUCTURE MEDIA SYSTEMS, S.L. .. If you are not the intended recipient please delete it and inform us in this way. According to the provisions of Law 15/1999, of December 13, Protection of Personal Data (LOPD), we inform you that your data is incorporated into a file which is owned by ESTRUCTURE MEDIA SYSTEMS, S.L. in order to perform administrative, accounting and fiscal management, as well as send you communications about our products and / or services. Also we advised of the possibility of exercising rights of access, rectification, cancellation and opposition of their data at the home of ESTRUCTURE MEDIA SYSTEMS, SL, located in Avda. De Madrid # 120 ship 10 28500, Arganda del Rey, Madrid , or email address info@estructure.es.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Reduce index size without reopening IndexWriter
Posted by Jaime <j....@estructure.es>.
Fixed, thank you very much!
El 12/07/2016 a las 17:02, Adrien Grand escribi�:
> A likely cause to this problem is that you are leaking index readers. You
> should review your application code in order to make sure that every
> near-realtime reader that is acquired is eventually closed.
>
> Le lun. 11 juil. 2016 � 13:46, Jaime <j....@estructure.es> a �crit :
>
>> I use Lucene 6.1.0 (no solr) with NRT search. At runtime, my index seems
>> to grow a lot.
>>
>> I think that for each commit, a new copy of the index is made. This
>> makes sense as an old searcher could be using the previous version.
>> However, the old copies don't seem to be erased until I close and reopen
>> the Index Writer.
>>
>> I've tried calling IndexWriter.deleteUnusedFiles after each commit, but
>> didn't help.
>>
>> Is there any way to free space without closing the IndexWriter?
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Reduce index size without reopening IndexWriter
Posted by Adrien Grand <jp...@gmail.com>.
A likely cause to this problem is that you are leaking index readers. You
should review your application code in order to make sure that every
near-realtime reader that is acquired is eventually closed.
Le lun. 11 juil. 2016 à 13:46, Jaime <j....@estructure.es> a écrit :
> I use Lucene 6.1.0 (no solr) with NRT search. At runtime, my index seems
> to grow a lot.
>
> I think that for each commit, a new copy of the index is made. This
> makes sense as an old searcher could be using the previous version.
> However, the old copies don't seem to be erased until I close and reopen
> the Index Writer.
>
> I've tried calling IndexWriter.deleteUnusedFiles after each commit, but
> didn't help.
>
> Is there any way to free space without closing the IndexWriter?
>
>
>
> --
> Jaime Pardos
> ESTRUCTURE MEDIA SYSTEMS, S.L.
> Avda. de Madrid nº 120 nave 10, 28500, Arganda del Rey, MADRID,
> j.pardos@estructure.es
> 910088429
>
> AVISO LEGAL: Este mensaje y sus archivos adjuntos van dirigidos
> exclusivamente a su destinatario, pudiendo contener información
> confidencial sometida a secreto confidencial. No está permitida su
> reproducción o distribución sin la autorización expresa de ESTRUCTURE MEDIA
> SYSTEMS, S.L.. Si usted no es el destinatario final por favor elimínelo e
> infórmenos por esta vía. De acuerdo con lo establecido en la Ley Orgánica
> 15/1999, de 13 de diciembre, de Protección de Datos de Carácter Personal
> (LOPD), le informamos que sus datos están incorporados en un fichero del
> que es titular ESTRUCTURE MEDIA SYSTEMS, S.L. con la finalidad de realizar
> la gestión administrativa, contable, y fiscal, así como enviarle
> comunicaciones comerciales sobre nuestros productos y/o servicios.
> Asimismo, le informamos de la posibilidad de ejercer los derechos de
> acceso, rectificación, cancelación y oposición de sus datos en el domicilio
> de ESTRUCTURE MEDIA SYSTEMS, S.L., sito en Avda. de Madrid nº 120 nave 10,
> 28500, Arganda del Rey, MADRID, o a la dirección de correo electrónico
> info@estructure.es.
>
> This message and its attachments are intended solely for the addressee and
> may contain confidential information submitted to confidential secret. It
> is not allowed its reproduction or distribution without the express
> permission of ESTRUCTURE MEDIA SYSTEMS, S.L. .. If you are not the intended
> recipient please delete it and inform us in this way. According to the
> provisions of Law 15/1999, of December 13, Protection of Personal Data
> (LOPD), we inform you that your data is incorporated into a file which is
> owned by ESTRUCTURE MEDIA SYSTEMS, S.L. in order to perform administrative,
> accounting and fiscal management, as well as send you communications about
> our products and / or services. Also we advised of the possibility of
> exercising rights of access, rectification, cancellation and opposition of
> their data at the home of ESTRUCTURE MEDIA SYSTEMS, SL, located in Avda. De
> Madrid # 120 ship 10 28500, Arganda del Rey, Madrid , or email address
> info@estructure.es.
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>