You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by aravinth thangasami <ar...@gmail.com> on 2016/09/27 14:03:12 UTC

Clarification Regarding TieredMergePolicy

Hi All,

In TieredMergePolicy, After the sum of segments size reached the
*MaxMergedSegmentSize*
the merge will be called.
My case is,
The first merge is triggered by *MaxMergedSegmentSize.*
After that,On addition of one more segment to the index,
the sum of sizes of segments may be greater than the MaxMergedSegmentSize.
will it cause Merge to happen ??

I guess the tier level merging will make the merge happen.

If merge will happen, Is there any way to delay it ?

please clarify it.

Thanks
Aravinth

Re: Clarification Regarding TieredMergePolicy

Posted by Michael McCandless <lu...@mikemccandless.com>.
See TMP.setMaxMergedSegmentMB, which is the (target) maximum sized
segment produced as a result by a merge.

Mike McCandless

http://blog.mikemccandless.com


On Tue, Sep 27, 2016 at 5:39 PM, aravinth thangasami
<ar...@gmail.com> wrote:
> what decides that the segment is too big ???
> I hope you don't mean the MAX_CFS_SEGMENT_SIZE
>
>
> Thanks & Regards
> Aravinth
>
> On Tue, Sep 27, 2016 at 7:36 PM, Michael McCandless <
> lucene@mikemccandless.com> wrote:
>
>> One a merged segment is too big, then it will never be merged again,
>> unless it accumulates > 50% deleted documents.
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>>
>> On Tue, Sep 27, 2016 at 4:03 PM, aravinth thangasami
>> <ar...@gmail.com> wrote:
>> > Hi All,
>> >
>> > In TieredMergePolicy, After the sum of segments size reached the
>> > *MaxMergedSegmentSize*
>> > the merge will be called.
>> > My case is,
>> > The first merge is triggered by *MaxMergedSegmentSize.*
>> > After that,On addition of one more segment to the index,
>> > the sum of sizes of segments may be greater than the
>> MaxMergedSegmentSize.
>> > will it cause Merge to happen ??
>> >
>> > I guess the tier level merging will make the merge happen.
>> >
>> > If merge will happen, Is there any way to delay it ?
>> >
>> > please clarify it.
>> >
>> > Thanks
>> > Aravinth
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: Clarification Regarding TieredMergePolicy

Posted by aravinth thangasami <ar...@gmail.com>.
what decides that the segment is too big ???
I hope you don't mean the MAX_CFS_SEGMENT_SIZE


Thanks & Regards
Aravinth

On Tue, Sep 27, 2016 at 7:36 PM, Michael McCandless <
lucene@mikemccandless.com> wrote:

> One a merged segment is too big, then it will never be merged again,
> unless it accumulates > 50% deleted documents.
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Tue, Sep 27, 2016 at 4:03 PM, aravinth thangasami
> <ar...@gmail.com> wrote:
> > Hi All,
> >
> > In TieredMergePolicy, After the sum of segments size reached the
> > *MaxMergedSegmentSize*
> > the merge will be called.
> > My case is,
> > The first merge is triggered by *MaxMergedSegmentSize.*
> > After that,On addition of one more segment to the index,
> > the sum of sizes of segments may be greater than the
> MaxMergedSegmentSize.
> > will it cause Merge to happen ??
> >
> > I guess the tier level merging will make the merge happen.
> >
> > If merge will happen, Is there any way to delay it ?
> >
> > please clarify it.
> >
> > Thanks
> > Aravinth
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Re: Clarification Regarding TieredMergePolicy

Posted by Michael McCandless <lu...@mikemccandless.com>.
One a merged segment is too big, then it will never be merged again,
unless it accumulates > 50% deleted documents.

Mike McCandless

http://blog.mikemccandless.com


On Tue, Sep 27, 2016 at 4:03 PM, aravinth thangasami
<ar...@gmail.com> wrote:
> Hi All,
>
> In TieredMergePolicy, After the sum of segments size reached the
> *MaxMergedSegmentSize*
> the merge will be called.
> My case is,
> The first merge is triggered by *MaxMergedSegmentSize.*
> After that,On addition of one more segment to the index,
> the sum of sizes of segments may be greater than the MaxMergedSegmentSize.
> will it cause Merge to happen ??
>
> I guess the tier level merging will make the merge happen.
>
> If merge will happen, Is there any way to delay it ?
>
> please clarify it.
>
> Thanks
> Aravinth

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org