You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by "Devon H. O'Dell" <de...@gmail.com> on 2011/03/17 18:05:41 UTC
Re: ParallelMultisearcher
2011/3/17 Ganesh <em...@yahoo.co.in>:
> Is this bug https://issues.apache.org/jira/browse/LUCENE-2249 got fixed in 3.0.3?
The linked ticket shows that it was fixed in 3.0.3.
--dho
> Regards
> Ganesh
>
> ----- Original Message -----
> From: "Ganesh" <em...@yahoo.co.in>
> To: <ja...@lucene.apache.org>
> Sent: Thursday, March 17, 2011 7:03 PM
> Subject: Re: ParallelMultisearcher
>
>
> I tested the same with Lucene 2.9.1 and found very less thread count but with 3.0.2 it is very high. Do i need to revert back to Lucene 2.9.1.
>
> Regards
> Ganesh
>
> ----- Original Message -----
> From: "Ganesh" <em...@yahoo.co.in>
> To: <ja...@lucene.apache.org>
> Sent: Thursday, March 17, 2011 5:17 PM
> Subject: ParallelMultisearcher
>
>
> Hello all,
>
> Is there any issue with ParallelMultiSearcher in Lucene 3.0.2? If we search more frequently then OutOfMemoryError is triggered or It is throwing "Not able to create native thread".. It is working with 2.9.1.
>
> I generated Heap Dump and found lot of entries for ParallelMultiSearcher.
>
> ParallelMultiSearcher-949-thread-3 java.lang.Thread @ 0x95e6220 104 192
> ParallelMultiSearcher-949-thread-1 java.lang.Thread @ 0x95e60f8 104 192
> ParallelMultiSearcher-957-thread-2 java.lang.Thread @ 0x95d30c8 104 192
> ParallelMultiSearcher-957-thread-3 java.lang.Thread @ 0x95d26e8 104 192
> ParallelMultiSearcher-954-thread-2 java.lang.Thread @ 0x95c3fe0 104 192
> ParallelMultiSearcher-954-thread-3 java.lang.Thread @ 0x95c15f0 104 192
> ParallelMultiSearcher-954-thread-1 java.lang.Thread @ 0x95c14c8 104 192
> ParallelMultiSearcher-956-thread-2 java.lang.Thread @ 0x95b8648 104 192
>
> Regards
> Ganesh
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
RE: ParallelMultisearcher
Posted by Uwe Schindler <uw...@thetaphi.de>.
Yes, it's fixed in SVN since June. Lucene 3.0.3 should contain the fix. When
you call ParallelMultiSearcher#close, the Executor is shutdown.
-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de
> -----Original Message-----
> From: Devon H. O'Dell [mailto:devon.odell@gmail.com]
> Sent: Thursday, March 17, 2011 6:06 PM
> To: java-user@lucene.apache.org
> Subject: Re: ParallelMultisearcher
>
> 2011/3/17 Ganesh <em...@yahoo.co.in>:
> > Is this bug https://issues.apache.org/jira/browse/LUCENE-2249 got fixed
in
> 3.0.3?
>
> The linked ticket shows that it was fixed in 3.0.3.
>
> --dho
>
> > Regards
> > Ganesh
> >
> > ----- Original Message -----
> > From: "Ganesh" <em...@yahoo.co.in>
> > To: <ja...@lucene.apache.org>
> > Sent: Thursday, March 17, 2011 7:03 PM
> > Subject: Re: ParallelMultisearcher
> >
> >
> > I tested the same with Lucene 2.9.1 and found very less thread count but
> with 3.0.2 it is very high. Do i need to revert back to Lucene 2.9.1.
> >
> > Regards
> > Ganesh
> >
> > ----- Original Message -----
> > From: "Ganesh" <em...@yahoo.co.in>
> > To: <ja...@lucene.apache.org>
> > Sent: Thursday, March 17, 2011 5:17 PM
> > Subject: ParallelMultisearcher
> >
> >
> > Hello all,
> >
> > Is there any issue with ParallelMultiSearcher in Lucene 3.0.2? If we
search
> more frequently then OutOfMemoryError is triggered or It is throwing "Not
> able to create native thread".. It is working with 2.9.1.
> >
> > I generated Heap Dump and found lot of entries for
ParallelMultiSearcher.
> >
> > ParallelMultiSearcher-949-thread-3 java.lang.Thread @ 0x95e6220 104 192
> > ParallelMultiSearcher-949-thread-1 java.lang.Thread @ 0x95e60f8 104 192
> > ParallelMultiSearcher-957-thread-2 java.lang.Thread @ 0x95d30c8 104 192
> > ParallelMultiSearcher-957-thread-3 java.lang.Thread @ 0x95d26e8 104 192
> > ParallelMultiSearcher-954-thread-2 java.lang.Thread @ 0x95c3fe0 104 192
> > ParallelMultiSearcher-954-thread-3 java.lang.Thread @ 0x95c15f0 104 192
> > ParallelMultiSearcher-954-thread-1 java.lang.Thread @ 0x95c14c8 104 192
> > ParallelMultiSearcher-956-thread-2 java.lang.Thread @ 0x95b8648 104 192
> >
> > Regards
> > Ganesh
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: RE: ParallelMultisearcher
Posted by Lance Norskog <go...@gmail.com>.
You should not use the ParallelMultiSearcher. It will not be in the 4.0 release.
On Thu, Mar 17, 2011 at 11:38 AM, Uwe Schindler <uw...@thetaphi.de> wrote:
> Hi Ganesh,
>
> this method is also in 2.9.1, it is just inherited from the superclass! You
> have to also look at the complete javadocs. Not every method that needs to
> be called must be already implemented in the used class. For PMS in 2.9 it's
> just not fatal to not close it, but you should call it:
> http://lucene.apache.org/java/2_9_1/api/core/org/apache/lucene/search/MultiS
> earcher.html#close()
>
> Uwe
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
>> -----Original Message-----
>> From: Ganesh [mailto:emailgane@yahoo.co.in]
>> Sent: Thursday, March 17, 2011 7:09 PM
>> To: java-user@lucene.apache.org
>> Subject: Re: RE: ParallelMultisearcher
>>
>> There is no ParallelMultiSearcher.close() in 2.9.1 and its been added in
> 3.0.
>> Thanks for pointing out. I am not aware of.
>>
>> Regards
>> Ganesh
>>
>> ----- Original Message -----
>> From: "Uwe Schindler" <uw...@thetaphi.de>
>> To: <ja...@lucene.apache.org>
>> Sent: Thursday, March 17, 2011 11:27 PM
>> Subject: [Bulk] RE: ParallelMultisearcher
>>
>>
>> > Hi Ganesh, It's definitely in 3.0.3:
>> >
>> > @Override
>> > public void close() throws IOException {
>> > executor.shutdown();
>> > super.close();
>> > }
>> >
>> > This code is in the downloaded .src.zip file of Apache Lucene 3.0.3. Are
> you
>> > sure that you call close() on the ParallelMultiSearcher (e.g. when you
> are
>> > done with it or reopen your indexes)? In contrast to Lucene 2.9, PMS
> uses
>> > Java 5's Executors to manage thread pools of workers. The threads are
> only
>> > shutdown on ParallelMultiSearcher.close().
>> >
>> > The entry is missing in Changes.txt, it somehow was merged with the
> other
>> > PMS issue there, that was my fault, sorry (I am the release manager of
> 2.9
>> > and 3.0).
>> >
>> > -----
>> > Uwe Schindler
>> > H.-H.-Meier-Allee 63, D-28213 Bremen
>> > http://www.thetaphi.de
>> > eMail: uwe@thetaphi.de
>> >
>> >
>> >> -----Original Message-----
>> >> From: Ganesh [mailto:emailgane@yahoo.co.in]
>> >> Sent: Thursday, March 17, 2011 6:24 PM
>> >> To: java-user@lucene.apache.org
>> >> Subject: Re: ParallelMultisearcher
>> >>
>> >> I agree but the chang logs of 3.0.3 didn't mention about that. I tested
>> > and
>> >> found that the same problem exists with 3.0.3. I am bit confused.
>> >> http://lucene.apache.org/java/3_0_3/changes/Changes.html
>> >>
>> >> This is show stopper for us as few customers facing big problems. The
>> >> application is crashing frequently.
>> >>
>> >> Regards
>> >> Ganesh
>> >>
>> >> ----- Original Message -----
>> >> From: "Devon H. O'Dell" <de...@gmail.com>
>> >> To: <ja...@lucene.apache.org>
>> >> Sent: Thursday, March 17, 2011 10:35 PM
>> >> Subject: Re: ParallelMultisearcher
>> >>
>> >>
>> >> > 2011/3/17 Ganesh <em...@yahoo.co.in>:
>> >> >> Is this bug https://issues.apache.org/jira/browse/LUCENE-2249 got
>> fixed
>> >> in 3.0.3?
>> >> >
>> >> > The linked ticket shows that it was fixed in 3.0.3.
>> >> >
>> >> > --dho
>> >> >
>> >> >> Regards
>> >> >> Ganesh
>> >> >>
>> >> >> ----- Original Message -----
>> >> >> From: "Ganesh" <em...@yahoo.co.in>
>> >> >> To: <ja...@lucene.apache.org>
>> >> >> Sent: Thursday, March 17, 2011 7:03 PM
>> >> >> Subject: Re: ParallelMultisearcher
>> >> >>
>> >> >>
>> >> >> I tested the same with Lucene 2.9.1 and found very less thread count
>> > but
>> >> with 3.0.2 it is very high. Do i need to revert back to Lucene 2.9.1.
>> >> >>
>> >> >> Regards
>> >> >> Ganesh
>> >> >>
>> >> >> ----- Original Message -----
>> >> >> From: "Ganesh" <em...@yahoo.co.in>
>> >> >> To: <ja...@lucene.apache.org>
>> >> >> Sent: Thursday, March 17, 2011 5:17 PM
>> >> >> Subject: ParallelMultisearcher
>> >> >>
>> >> >>
>> >> >> Hello all,
>> >> >>
>> >> >> Is there any issue with ParallelMultiSearcher in Lucene 3.0.2? If we
>> > search
>> >> more frequently then OutOfMemoryError is triggered or It is throwing
>> "Not
>> >> able to create native thread".. It is working with 2.9.1.
>> >> >>
>> >> >> I generated Heap Dump and found lot of entries for
>> > ParallelMultiSearcher.
>> >> >>
>> >> >> ParallelMultiSearcher-949-thread-3 java.lang.Thread @ 0x95e6220 104
>> 192
>> >> >> ParallelMultiSearcher-949-thread-1 java.lang.Thread @ 0x95e60f8 104
>> 192
>> >> >> ParallelMultiSearcher-957-thread-2 java.lang.Thread @ 0x95d30c8 104
>> 192
>> >> >> ParallelMultiSearcher-957-thread-3 java.lang.Thread @ 0x95d26e8 104
>> 192
>> >> >> ParallelMultiSearcher-954-thread-2 java.lang.Thread @ 0x95c3fe0 104
>> 192
>> >> >> ParallelMultiSearcher-954-thread-3 java.lang.Thread @ 0x95c15f0 104
>> 192
>> >> >> ParallelMultiSearcher-954-thread-1 java.lang.Thread @ 0x95c14c8 104
>> 192
>> >> >> ParallelMultiSearcher-956-thread-2 java.lang.Thread @ 0x95b8648 104
>> 192
>> >> >>
>> >> >> Regards
>> >> >> Ganesh
>> >> >>
>> >> >>
> ---------------------------------------------------------------------
>> >> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >> >>
>> >> >>
>> >> >>
> ---------------------------------------------------------------------
>> >> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >> >>
>> >> >>
>> >> >>
> ---------------------------------------------------------------------
>> >> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >> >>
>> >> >>
>> >> >
>> >> > ---------------------------------------------------------------------
>> >> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> > For additional commands, e-mail: java-user-help@lucene.apache.org
>> >> >
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >
>> >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> > For additional commands, e-mail: java-user-help@lucene.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
--
Lance Norskog
goksron@gmail.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
RE: RE: ParallelMultisearcher
Posted by Uwe Schindler <uw...@thetaphi.de>.
Hi Ganesh,
this method is also in 2.9.1, it is just inherited from the superclass! You
have to also look at the complete javadocs. Not every method that needs to
be called must be already implemented in the used class. For PMS in 2.9 it's
just not fatal to not close it, but you should call it:
http://lucene.apache.org/java/2_9_1/api/core/org/apache/lucene/search/MultiS
earcher.html#close()
Uwe
-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de
> -----Original Message-----
> From: Ganesh [mailto:emailgane@yahoo.co.in]
> Sent: Thursday, March 17, 2011 7:09 PM
> To: java-user@lucene.apache.org
> Subject: Re: RE: ParallelMultisearcher
>
> There is no ParallelMultiSearcher.close() in 2.9.1 and its been added in
3.0.
> Thanks for pointing out. I am not aware of.
>
> Regards
> Ganesh
>
> ----- Original Message -----
> From: "Uwe Schindler" <uw...@thetaphi.de>
> To: <ja...@lucene.apache.org>
> Sent: Thursday, March 17, 2011 11:27 PM
> Subject: [Bulk] RE: ParallelMultisearcher
>
>
> > Hi Ganesh, It's definitely in 3.0.3:
> >
> > @Override
> > public void close() throws IOException {
> > executor.shutdown();
> > super.close();
> > }
> >
> > This code is in the downloaded .src.zip file of Apache Lucene 3.0.3. Are
you
> > sure that you call close() on the ParallelMultiSearcher (e.g. when you
are
> > done with it or reopen your indexes)? In contrast to Lucene 2.9, PMS
uses
> > Java 5's Executors to manage thread pools of workers. The threads are
only
> > shutdown on ParallelMultiSearcher.close().
> >
> > The entry is missing in Changes.txt, it somehow was merged with the
other
> > PMS issue there, that was my fault, sorry (I am the release manager of
2.9
> > and 3.0).
> >
> > -----
> > Uwe Schindler
> > H.-H.-Meier-Allee 63, D-28213 Bremen
> > http://www.thetaphi.de
> > eMail: uwe@thetaphi.de
> >
> >
> >> -----Original Message-----
> >> From: Ganesh [mailto:emailgane@yahoo.co.in]
> >> Sent: Thursday, March 17, 2011 6:24 PM
> >> To: java-user@lucene.apache.org
> >> Subject: Re: ParallelMultisearcher
> >>
> >> I agree but the chang logs of 3.0.3 didn't mention about that. I tested
> > and
> >> found that the same problem exists with 3.0.3. I am bit confused.
> >> http://lucene.apache.org/java/3_0_3/changes/Changes.html
> >>
> >> This is show stopper for us as few customers facing big problems. The
> >> application is crashing frequently.
> >>
> >> Regards
> >> Ganesh
> >>
> >> ----- Original Message -----
> >> From: "Devon H. O'Dell" <de...@gmail.com>
> >> To: <ja...@lucene.apache.org>
> >> Sent: Thursday, March 17, 2011 10:35 PM
> >> Subject: Re: ParallelMultisearcher
> >>
> >>
> >> > 2011/3/17 Ganesh <em...@yahoo.co.in>:
> >> >> Is this bug https://issues.apache.org/jira/browse/LUCENE-2249 got
> fixed
> >> in 3.0.3?
> >> >
> >> > The linked ticket shows that it was fixed in 3.0.3.
> >> >
> >> > --dho
> >> >
> >> >> Regards
> >> >> Ganesh
> >> >>
> >> >> ----- Original Message -----
> >> >> From: "Ganesh" <em...@yahoo.co.in>
> >> >> To: <ja...@lucene.apache.org>
> >> >> Sent: Thursday, March 17, 2011 7:03 PM
> >> >> Subject: Re: ParallelMultisearcher
> >> >>
> >> >>
> >> >> I tested the same with Lucene 2.9.1 and found very less thread count
> > but
> >> with 3.0.2 it is very high. Do i need to revert back to Lucene 2.9.1.
> >> >>
> >> >> Regards
> >> >> Ganesh
> >> >>
> >> >> ----- Original Message -----
> >> >> From: "Ganesh" <em...@yahoo.co.in>
> >> >> To: <ja...@lucene.apache.org>
> >> >> Sent: Thursday, March 17, 2011 5:17 PM
> >> >> Subject: ParallelMultisearcher
> >> >>
> >> >>
> >> >> Hello all,
> >> >>
> >> >> Is there any issue with ParallelMultiSearcher in Lucene 3.0.2? If we
> > search
> >> more frequently then OutOfMemoryError is triggered or It is throwing
> "Not
> >> able to create native thread".. It is working with 2.9.1.
> >> >>
> >> >> I generated Heap Dump and found lot of entries for
> > ParallelMultiSearcher.
> >> >>
> >> >> ParallelMultiSearcher-949-thread-3 java.lang.Thread @ 0x95e6220 104
> 192
> >> >> ParallelMultiSearcher-949-thread-1 java.lang.Thread @ 0x95e60f8 104
> 192
> >> >> ParallelMultiSearcher-957-thread-2 java.lang.Thread @ 0x95d30c8 104
> 192
> >> >> ParallelMultiSearcher-957-thread-3 java.lang.Thread @ 0x95d26e8 104
> 192
> >> >> ParallelMultiSearcher-954-thread-2 java.lang.Thread @ 0x95c3fe0 104
> 192
> >> >> ParallelMultiSearcher-954-thread-3 java.lang.Thread @ 0x95c15f0 104
> 192
> >> >> ParallelMultiSearcher-954-thread-1 java.lang.Thread @ 0x95c14c8 104
> 192
> >> >> ParallelMultiSearcher-956-thread-2 java.lang.Thread @ 0x95b8648 104
> 192
> >> >>
> >> >> Regards
> >> >> Ganesh
> >> >>
> >> >>
---------------------------------------------------------------------
> >> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >> >>
> >> >>
> >> >>
---------------------------------------------------------------------
> >> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >> >>
> >> >>
> >> >>
---------------------------------------------------------------------
> >> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >> >>
> >> >>
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >> >
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: RE: ParallelMultisearcher
Posted by Ganesh <em...@yahoo.co.in>.
There is no ParallelMultiSearcher.close() in 2.9.1 and its been added in 3.0. Thanks for pointing out. I am not aware of.
Regards
Ganesh
----- Original Message -----
From: "Uwe Schindler" <uw...@thetaphi.de>
To: <ja...@lucene.apache.org>
Sent: Thursday, March 17, 2011 11:27 PM
Subject: [Bulk] RE: ParallelMultisearcher
> Hi Ganesh, It's definitely in 3.0.3:
>
> @Override
> public void close() throws IOException {
> executor.shutdown();
> super.close();
> }
>
> This code is in the downloaded .src.zip file of Apache Lucene 3.0.3. Are you
> sure that you call close() on the ParallelMultiSearcher (e.g. when you are
> done with it or reopen your indexes)? In contrast to Lucene 2.9, PMS uses
> Java 5's Executors to manage thread pools of workers. The threads are only
> shutdown on ParallelMultiSearcher.close().
>
> The entry is missing in Changes.txt, it somehow was merged with the other
> PMS issue there, that was my fault, sorry (I am the release manager of 2.9
> and 3.0).
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
>> -----Original Message-----
>> From: Ganesh [mailto:emailgane@yahoo.co.in]
>> Sent: Thursday, March 17, 2011 6:24 PM
>> To: java-user@lucene.apache.org
>> Subject: Re: ParallelMultisearcher
>>
>> I agree but the chang logs of 3.0.3 didn't mention about that. I tested
> and
>> found that the same problem exists with 3.0.3. I am bit confused.
>> http://lucene.apache.org/java/3_0_3/changes/Changes.html
>>
>> This is show stopper for us as few customers facing big problems. The
>> application is crashing frequently.
>>
>> Regards
>> Ganesh
>>
>> ----- Original Message -----
>> From: "Devon H. O'Dell" <de...@gmail.com>
>> To: <ja...@lucene.apache.org>
>> Sent: Thursday, March 17, 2011 10:35 PM
>> Subject: Re: ParallelMultisearcher
>>
>>
>> > 2011/3/17 Ganesh <em...@yahoo.co.in>:
>> >> Is this bug https://issues.apache.org/jira/browse/LUCENE-2249 got fixed
>> in 3.0.3?
>> >
>> > The linked ticket shows that it was fixed in 3.0.3.
>> >
>> > --dho
>> >
>> >> Regards
>> >> Ganesh
>> >>
>> >> ----- Original Message -----
>> >> From: "Ganesh" <em...@yahoo.co.in>
>> >> To: <ja...@lucene.apache.org>
>> >> Sent: Thursday, March 17, 2011 7:03 PM
>> >> Subject: Re: ParallelMultisearcher
>> >>
>> >>
>> >> I tested the same with Lucene 2.9.1 and found very less thread count
> but
>> with 3.0.2 it is very high. Do i need to revert back to Lucene 2.9.1.
>> >>
>> >> Regards
>> >> Ganesh
>> >>
>> >> ----- Original Message -----
>> >> From: "Ganesh" <em...@yahoo.co.in>
>> >> To: <ja...@lucene.apache.org>
>> >> Sent: Thursday, March 17, 2011 5:17 PM
>> >> Subject: ParallelMultisearcher
>> >>
>> >>
>> >> Hello all,
>> >>
>> >> Is there any issue with ParallelMultiSearcher in Lucene 3.0.2? If we
> search
>> more frequently then OutOfMemoryError is triggered or It is throwing "Not
>> able to create native thread".. It is working with 2.9.1.
>> >>
>> >> I generated Heap Dump and found lot of entries for
> ParallelMultiSearcher.
>> >>
>> >> ParallelMultiSearcher-949-thread-3 java.lang.Thread @ 0x95e6220 104 192
>> >> ParallelMultiSearcher-949-thread-1 java.lang.Thread @ 0x95e60f8 104 192
>> >> ParallelMultiSearcher-957-thread-2 java.lang.Thread @ 0x95d30c8 104 192
>> >> ParallelMultiSearcher-957-thread-3 java.lang.Thread @ 0x95d26e8 104 192
>> >> ParallelMultiSearcher-954-thread-2 java.lang.Thread @ 0x95c3fe0 104 192
>> >> ParallelMultiSearcher-954-thread-3 java.lang.Thread @ 0x95c15f0 104 192
>> >> ParallelMultiSearcher-954-thread-1 java.lang.Thread @ 0x95c14c8 104 192
>> >> ParallelMultiSearcher-956-thread-2 java.lang.Thread @ 0x95b8648 104 192
>> >>
>> >> Regards
>> >> Ganesh
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >>
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >>
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >>
>> >>
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> > For additional commands, e-mail: java-user-help@lucene.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
RE: ParallelMultisearcher
Posted by Uwe Schindler <uw...@thetaphi.de>.
Hi Ganesh, It's definitely in 3.0.3:
@Override
public void close() throws IOException {
executor.shutdown();
super.close();
}
This code is in the downloaded .src.zip file of Apache Lucene 3.0.3. Are you
sure that you call close() on the ParallelMultiSearcher (e.g. when you are
done with it or reopen your indexes)? In contrast to Lucene 2.9, PMS uses
Java 5's Executors to manage thread pools of workers. The threads are only
shutdown on ParallelMultiSearcher.close().
The entry is missing in Changes.txt, it somehow was merged with the other
PMS issue there, that was my fault, sorry (I am the release manager of 2.9
and 3.0).
-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de
> -----Original Message-----
> From: Ganesh [mailto:emailgane@yahoo.co.in]
> Sent: Thursday, March 17, 2011 6:24 PM
> To: java-user@lucene.apache.org
> Subject: Re: ParallelMultisearcher
>
> I agree but the chang logs of 3.0.3 didn't mention about that. I tested
and
> found that the same problem exists with 3.0.3. I am bit confused.
> http://lucene.apache.org/java/3_0_3/changes/Changes.html
>
> This is show stopper for us as few customers facing big problems. The
> application is crashing frequently.
>
> Regards
> Ganesh
>
> ----- Original Message -----
> From: "Devon H. O'Dell" <de...@gmail.com>
> To: <ja...@lucene.apache.org>
> Sent: Thursday, March 17, 2011 10:35 PM
> Subject: Re: ParallelMultisearcher
>
>
> > 2011/3/17 Ganesh <em...@yahoo.co.in>:
> >> Is this bug https://issues.apache.org/jira/browse/LUCENE-2249 got fixed
> in 3.0.3?
> >
> > The linked ticket shows that it was fixed in 3.0.3.
> >
> > --dho
> >
> >> Regards
> >> Ganesh
> >>
> >> ----- Original Message -----
> >> From: "Ganesh" <em...@yahoo.co.in>
> >> To: <ja...@lucene.apache.org>
> >> Sent: Thursday, March 17, 2011 7:03 PM
> >> Subject: Re: ParallelMultisearcher
> >>
> >>
> >> I tested the same with Lucene 2.9.1 and found very less thread count
but
> with 3.0.2 it is very high. Do i need to revert back to Lucene 2.9.1.
> >>
> >> Regards
> >> Ganesh
> >>
> >> ----- Original Message -----
> >> From: "Ganesh" <em...@yahoo.co.in>
> >> To: <ja...@lucene.apache.org>
> >> Sent: Thursday, March 17, 2011 5:17 PM
> >> Subject: ParallelMultisearcher
> >>
> >>
> >> Hello all,
> >>
> >> Is there any issue with ParallelMultiSearcher in Lucene 3.0.2? If we
search
> more frequently then OutOfMemoryError is triggered or It is throwing "Not
> able to create native thread".. It is working with 2.9.1.
> >>
> >> I generated Heap Dump and found lot of entries for
ParallelMultiSearcher.
> >>
> >> ParallelMultiSearcher-949-thread-3 java.lang.Thread @ 0x95e6220 104 192
> >> ParallelMultiSearcher-949-thread-1 java.lang.Thread @ 0x95e60f8 104 192
> >> ParallelMultiSearcher-957-thread-2 java.lang.Thread @ 0x95d30c8 104 192
> >> ParallelMultiSearcher-957-thread-3 java.lang.Thread @ 0x95d26e8 104 192
> >> ParallelMultiSearcher-954-thread-2 java.lang.Thread @ 0x95c3fe0 104 192
> >> ParallelMultiSearcher-954-thread-3 java.lang.Thread @ 0x95c15f0 104 192
> >> ParallelMultiSearcher-954-thread-1 java.lang.Thread @ 0x95c14c8 104 192
> >> ParallelMultiSearcher-956-thread-2 java.lang.Thread @ 0x95b8648 104 192
> >>
> >> Regards
> >> Ganesh
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >>
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: ParallelMultisearcher
Posted by Ganesh <em...@yahoo.co.in>.
I agree but the chang logs of 3.0.3 didn't mention about that. I tested and found that the same problem exists with 3.0.3. I am bit confused.
http://lucene.apache.org/java/3_0_3/changes/Changes.html
This is show stopper for us as few customers facing big problems. The application is crashing frequently.
Regards
Ganesh
----- Original Message -----
From: "Devon H. O'Dell" <de...@gmail.com>
To: <ja...@lucene.apache.org>
Sent: Thursday, March 17, 2011 10:35 PM
Subject: Re: ParallelMultisearcher
> 2011/3/17 Ganesh <em...@yahoo.co.in>:
>> Is this bug https://issues.apache.org/jira/browse/LUCENE-2249 got fixed in 3.0.3?
>
> The linked ticket shows that it was fixed in 3.0.3.
>
> --dho
>
>> Regards
>> Ganesh
>>
>> ----- Original Message -----
>> From: "Ganesh" <em...@yahoo.co.in>
>> To: <ja...@lucene.apache.org>
>> Sent: Thursday, March 17, 2011 7:03 PM
>> Subject: Re: ParallelMultisearcher
>>
>>
>> I tested the same with Lucene 2.9.1 and found very less thread count but with 3.0.2 it is very high. Do i need to revert back to Lucene 2.9.1.
>>
>> Regards
>> Ganesh
>>
>> ----- Original Message -----
>> From: "Ganesh" <em...@yahoo.co.in>
>> To: <ja...@lucene.apache.org>
>> Sent: Thursday, March 17, 2011 5:17 PM
>> Subject: ParallelMultisearcher
>>
>>
>> Hello all,
>>
>> Is there any issue with ParallelMultiSearcher in Lucene 3.0.2? If we search more frequently then OutOfMemoryError is triggered or It is throwing "Not able to create native thread".. It is working with 2.9.1.
>>
>> I generated Heap Dump and found lot of entries for ParallelMultiSearcher.
>>
>> ParallelMultiSearcher-949-thread-3 java.lang.Thread @ 0x95e6220 104 192
>> ParallelMultiSearcher-949-thread-1 java.lang.Thread @ 0x95e60f8 104 192
>> ParallelMultiSearcher-957-thread-2 java.lang.Thread @ 0x95d30c8 104 192
>> ParallelMultiSearcher-957-thread-3 java.lang.Thread @ 0x95d26e8 104 192
>> ParallelMultiSearcher-954-thread-2 java.lang.Thread @ 0x95c3fe0 104 192
>> ParallelMultiSearcher-954-thread-3 java.lang.Thread @ 0x95c15f0 104 192
>> ParallelMultiSearcher-954-thread-1 java.lang.Thread @ 0x95c14c8 104 192
>> ParallelMultiSearcher-956-thread-2 java.lang.Thread @ 0x95b8648 104 192
>>
>> Regards
>> Ganesh
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org