You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cocoon.apache.org by "Nader S. Henein" <ns...@bayt.net> on 2002/04/04 09:41:25 UTC
Sorry to be a nag
People sorry to be a nag and I have asked this one before and
got nothing, but just to make sure .. has anyone out there developed
an App as opposed to a webapp to create a search index using the lucene
library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
OS : Solaris 8
Webserver : Orion 1.4.5
Cocoon : 2.0.2
Nader S. Henein
Bayt.com , Dubai Internet City
Tel. +9714 3911900
Fax. +9714 3911915
GSM. +9715 05659557
www.bayt.com
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
Solution to : "too many files open" LuceneCocoonIndexing Error
Posted by "Nader S. Henein" <ns...@bayt.net>.
This should help:
if you get the too many files open error after indexing a crap load
of files from LuceneCocoonIndexer, what is happening is you're exhausting
all the file handles allocated to the system user, the attached URL
depicts how to solve this problem in Redhat, the same process should work
in other distributions of UNIX and there is a way to set it on windows as
well, but you'll have to hunt it down on google
cheers and I hope this helps
http://www.redhat.com/mailing-lists/redhat-devel-list/msg03917.html
-----Original Message-----
From: leo leonid [mailto:tek@leonid.de]
Sent: Saturday, April 06, 2002 7:44 PM
To: cocoon-users@xml.apache.org
Subject: Re: Sorry to be a nag
uups. wrong URL. forget the old .com, the lucene try is on
http://www.helnwein.de
sorry
/Leo
On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
> yes! I tried it. And the result was the same error as you got.
> I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
> many open files)" on Fri Mar 15, but it faded out quickly.
> Indexing works now, but I had to limit indexing to a small part of my
> site :-(
> Another problem I have: non-ascii characters in query strings (e.g.
> german Umlauts) you can test my try at http://www.helnwein.com )
> /Leo
>
>
> On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
>
>> People sorry to be a nag and I have asked this one before and
>> got nothing, but just to make sure .. has anyone out there developed
>> an App as opposed to a webapp to create a search index using the lucene
>> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
>>
>> OS : Solaris 8
>> Webserver : Orion 1.4.5
>> Cocoon : 2.0.2
>>
>>
>> Nader S. Henein
>> Bayt.com , Dubai Internet City
>> Tel. +9714 3911900
>> Fax. +9714 3911915
>> GSM. +9715 05659557
>> www.bayt.com
>>
>> ---------------------------------------------------------------------
>> Please check that your question has not already been answered in the
>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>
>> To unsubscribe, e-mail: <co...@xml.apache.org>
>> For additional commands, e-mail: <co...@xml.apache.org>
>>
>>
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
RE: [SOLUTION] Sorry to be a nag
Posted by Vadim Gritsenko <va...@verizon.net>.
> From: Andrew C. Oliver [mailto:acoliver@apache.org]
>
> Cool.. Glad I could help.
>
> Humm this should be configurable.
>
> On Sun, 2002-04-14 at 09:57, leo leonid wrote:
> > thanks for this hint, Andrew!
> > It is the merge-factor. A comprehensive description can be found at
> >
http://www.mail-archive.com/lucene-user@jakarta.apache.org/msg00373.html
.
> >
> > The quick hack:
> > Look in SimpleLuceneCocoonIndexerImpl.java for the constant
> > MERGE_FACTOR_DEFAULT = 20.
> > Lower the value. I set it to 10. Indexing about 2000 files now works
> > fine.
Alternatively, you could just edit config of
SimpleLuceneCocoonIndexerImpl:
<merge-factor>10</merge-factor>
(this suppose to work also)
Vadim
> >
> > /Leo
> >
> > On Monday, April 8, 2002, at 02:01 Uhr, Andrew C. Oliver wrote:
> >
> > > This sounds like your index merge factor.
> > >
> > > On Mon, 2002-04-08 at 03:26, Nader S. Henein wrote:
> > >> Cocoon Lucene Indesing: "Too Many files open Error"
> > >>
> > >> I can't opt for that solution, what I'm trying to do
> > >> is get out of Oracle Internmedia and ultimately out of oracle
> > >> and if you've ever had oracle bill you for licensing fees
> > >> you'll know why ... but as far as the indexing is concerned
> > >> I'm going to need to index about 200 000 XML files did you try
> > >> discussing the problem on the lucene dev forums ? I mean it is
> > >> open source we should be able to fix it.
> > >> The "Too Many files open Error" sounds like there is a file
handle
> > >> close() method missing somewhere I'm going to start going through
the
> > >> code today, and I'll post the problem on the Lucene Dev board ..
it
> > >> would be
> > >> nice to know who wrote the damn thing .. they could probably fix
this
> > >> one
> > >> in no time.
> > >>
> > >> cheers
> > >>
> > >> OPEN SOURCE ROCKS
> > >>
...
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
Re: [SOLUTION] Sorry to be a nag
Posted by "Andrew C. Oliver" <ac...@apache.org>.
Cool.. Glad I could help.
Humm this should be configurable.
On Sun, 2002-04-14 at 09:57, leo leonid wrote:
> thanks for this hint, Andrew!
> It is the merge-factor. A comprehensive description can be found at
> http://www.mail-archive.com/lucene-user@jakarta.apache.org/msg00373.html.
>
> The quick hack:
> Look in SimpleLuceneCocoonIndexerImpl.java for the constant
> MERGE_FACTOR_DEFAULT = 20.
> Lower the value. I set it to 10. Indexing about 2000 files now works
> fine.
>
> /Leo
>
> On Monday, April 8, 2002, at 02:01 Uhr, Andrew C. Oliver wrote:
>
> > This sounds like your index merge factor.
> >
> > On Mon, 2002-04-08 at 03:26, Nader S. Henein wrote:
> >> Cocoon Lucene Indesing: "Too Many files open Error"
> >>
> >> I can't opt for that solution, what I'm trying to do
> >> is get out of Oracle Internmedia and ultimately out of oracle
> >> and if you've ever had oracle bill you for licensing fees
> >> you'll know why ... but as far as the indexing is concerned
> >> I'm going to need to index about 200 000 XML files did you try
> >> discussing the problem on the lucene dev forums ? I mean it is
> >> open source we should be able to fix it.
> >> The "Too Many files open Error" sounds like there is a file handle
> >> close() method missing somewhere I'm going to start going through the
> >> code today, and I'll post the problem on the Lucene Dev board .. it
> >> would be
> >> nice to know who wrote the damn thing .. they could probably fix this
> >> one
> >> in no time.
> >>
> >> cheers
> >>
> >> OPEN SOURCE ROCKS
> >>
> >>
> >> -----Original Message-----
> >> From: leo leonid [mailto:tek@leonid.de]
> >> Sent: Saturday, April 06, 2002 7:44 PM
> >> To: cocoon-users@xml.apache.org
> >> Subject: Re: Sorry to be a nag
> >>
> >>
> >> uups. wrong URL. forget the old .com, the lucene try is on
> >> http://www.helnwein.de
> >> sorry
> >> /Leo
> >>
> >>
> >> On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
> >>
> >>> yes! I tried it. And the result was the same error as you got.
> >>> I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
> >>> many open files)" on Fri Mar 15, but it faded out quickly.
> >>> Indexing works now, but I had to limit indexing to a small part of my
> >>> site :-(
> >>> Another problem I have: non-ascii characters in query strings (e.g.
> >>> german Umlauts) you can test my try at http://www.helnwein.com )
> >>> /Leo
> >>>
> >>>
> >>> On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
> >>>
> >>>> People sorry to be a nag and I have asked this one before and
> >>>> got nothing, but just to make sure .. has anyone out there developed
> >>>> an App as opposed to a webapp to create a search index using the
> >>>> lucene
> >>>> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
> >>>>
> >>>> OS : Solaris 8
> >>>> Webserver : Orion 1.4.5
> >>>> Cocoon : 2.0.2
> >>>>
> >>>>
> >>>> Nader S. Henein
> >>>> Bayt.com , Dubai Internet City
> >>>> Tel. +9714 3911900
> >>>> Fax. +9714 3911915
> >>>> GSM. +9715 05659557
> >>>> www.bayt.com
> >>>>
> >>>> ---------------------------------------------------------------------
> >>>> Please check that your question has not already been answered in the
> >>>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >>>>
> >>>> To unsubscribe, e-mail: <co...@xml.apache.org>
> >>>> For additional commands, e-mail: <co...@xml.apache.org>
> >>>>
> >>>>
> >>>
> >>>
> >>> ---------------------------------------------------------------------
> >>> Please check that your question has not already been answered in the
> >>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >>>
> >>> To unsubscribe, e-mail: <co...@xml.apache.org>
> >>> For additional commands, e-mail: <co...@xml.apache.org>
> >>>
> >>>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> Please check that your question has not already been answered in the
> >> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >>
> >> To unsubscribe, e-mail: <co...@xml.apache.org>
> >> For additional commands, e-mail: <co...@xml.apache.org>
> >>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> Please check that your question has not already been answered in the
> >> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >>
> >> To unsubscribe, e-mail: <co...@xml.apache.org>
> >> For additional commands, e-mail: <co...@xml.apache.org>
> >>
> > --
> > http://www.superlinksoftware.com
> > http://jakarta.apache.org/poi - port of Excel/Word/OLE 2 Compound
> > Document
> > format to java
> > http://developer.java.sun.com/developer/bugParade/bugs/4487555.html
> > - fix java generics!
> > The avalanche has already started. It is too late for the pebbles to
> > vote.
> > -Ambassador Kosh
> >
> >
> > ---------------------------------------------------------------------
> > Please check that your question has not already been answered in the
> > FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >
> > To unsubscribe, e-mail: <co...@xml.apache.org>
> > For additional commands, e-mail: <co...@xml.apache.org>
> >
> >
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
--
http://www.superlinksoftware.com
http://jakarta.apache.org/poi - port of Excel/Word/OLE 2 Compound
Document
format to java
http://developer.java.sun.com/developer/bugParade/bugs/4487555.html
- fix java generics!
The avalanche has already started. It is too late for the pebbles to
vote.
-Ambassador Kosh
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
Re: [SOLUTION] Sorry to be a nag
Posted by leo leonid <te...@leonid.de>.
thanks for this hint, Andrew!
It is the merge-factor. A comprehensive description can be found at
http://www.mail-archive.com/lucene-user@jakarta.apache.org/msg00373.html.
The quick hack:
Look in SimpleLuceneCocoonIndexerImpl.java for the constant
MERGE_FACTOR_DEFAULT = 20.
Lower the value. I set it to 10. Indexing about 2000 files now works
fine.
/Leo
On Monday, April 8, 2002, at 02:01 Uhr, Andrew C. Oliver wrote:
> This sounds like your index merge factor.
>
> On Mon, 2002-04-08 at 03:26, Nader S. Henein wrote:
>> Cocoon Lucene Indesing: "Too Many files open Error"
>>
>> I can't opt for that solution, what I'm trying to do
>> is get out of Oracle Internmedia and ultimately out of oracle
>> and if you've ever had oracle bill you for licensing fees
>> you'll know why ... but as far as the indexing is concerned
>> I'm going to need to index about 200 000 XML files did you try
>> discussing the problem on the lucene dev forums ? I mean it is
>> open source we should be able to fix it.
>> The "Too Many files open Error" sounds like there is a file handle
>> close() method missing somewhere I'm going to start going through the
>> code today, and I'll post the problem on the Lucene Dev board .. it
>> would be
>> nice to know who wrote the damn thing .. they could probably fix this
>> one
>> in no time.
>>
>> cheers
>>
>> OPEN SOURCE ROCKS
>>
>>
>> -----Original Message-----
>> From: leo leonid [mailto:tek@leonid.de]
>> Sent: Saturday, April 06, 2002 7:44 PM
>> To: cocoon-users@xml.apache.org
>> Subject: Re: Sorry to be a nag
>>
>>
>> uups. wrong URL. forget the old .com, the lucene try is on
>> http://www.helnwein.de
>> sorry
>> /Leo
>>
>>
>> On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
>>
>>> yes! I tried it. And the result was the same error as you got.
>>> I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
>>> many open files)" on Fri Mar 15, but it faded out quickly.
>>> Indexing works now, but I had to limit indexing to a small part of my
>>> site :-(
>>> Another problem I have: non-ascii characters in query strings (e.g.
>>> german Umlauts) you can test my try at http://www.helnwein.com )
>>> /Leo
>>>
>>>
>>> On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
>>>
>>>> People sorry to be a nag and I have asked this one before and
>>>> got nothing, but just to make sure .. has anyone out there developed
>>>> an App as opposed to a webapp to create a search index using the
>>>> lucene
>>>> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
>>>>
>>>> OS : Solaris 8
>>>> Webserver : Orion 1.4.5
>>>> Cocoon : 2.0.2
>>>>
>>>>
>>>> Nader S. Henein
>>>> Bayt.com , Dubai Internet City
>>>> Tel. +9714 3911900
>>>> Fax. +9714 3911915
>>>> GSM. +9715 05659557
>>>> www.bayt.com
>>>>
>>>> ---------------------------------------------------------------------
>>>> Please check that your question has not already been answered in the
>>>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>>>
>>>> To unsubscribe, e-mail: <co...@xml.apache.org>
>>>> For additional commands, e-mail: <co...@xml.apache.org>
>>>>
>>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> Please check that your question has not already been answered in the
>>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>>
>>> To unsubscribe, e-mail: <co...@xml.apache.org>
>>> For additional commands, e-mail: <co...@xml.apache.org>
>>>
>>>
>>
>>
>> ---------------------------------------------------------------------
>> Please check that your question has not already been answered in the
>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>
>> To unsubscribe, e-mail: <co...@xml.apache.org>
>> For additional commands, e-mail: <co...@xml.apache.org>
>>
>>
>>
>> ---------------------------------------------------------------------
>> Please check that your question has not already been answered in the
>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>
>> To unsubscribe, e-mail: <co...@xml.apache.org>
>> For additional commands, e-mail: <co...@xml.apache.org>
>>
> --
> http://www.superlinksoftware.com
> http://jakarta.apache.org/poi - port of Excel/Word/OLE 2 Compound
> Document
> format to java
> http://developer.java.sun.com/developer/bugParade/bugs/4487555.html
> - fix java generics!
> The avalanche has already started. It is too late for the pebbles to
> vote.
> -Ambassador Kosh
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
Re: Sorry to be a nag
Posted by "Andrew C. Oliver" <ac...@apache.org>.
agreed
Nader S. Henein wrote:
>yes It occurs after you've indexed a couple thousand documents
>and you try to search .. I've increased the number of file handles in
>UNIX and I'm testing the results now .. but the other problem is creating
>an application as opposed to a webapp to do the indexing because indexing
>200000 XML documents from the webapp isn't realistic.
>
>thanks
>
>-----Original Message-----
>From: Andrew C. Oliver [mailto:acoliver@apache.org]
>Sent: Monday, April 08, 2002 4:01 PM
>To: cocoon-users@xml.apache.org
>Subject: RE: Sorry to be a nag
>
>
>This sounds like your index merge factor.
>
>On Mon, 2002-04-08 at 03:26, Nader S. Henein wrote:
>
>>Cocoon Lucene Indesing: "Too Many files open Error"
>>
>>I can't opt for that solution, what I'm trying to do
>>is get out of Oracle Internmedia and ultimately out of oracle
>>and if you've ever had oracle bill you for licensing fees
>>you'll know why ... but as far as the indexing is concerned
>>I'm going to need to index about 200 000 XML files did you try
>>discussing the problem on the lucene dev forums ? I mean it is
>>open source we should be able to fix it.
>>The "Too Many files open Error" sounds like there is a file handle
>>close() method missing somewhere I'm going to start going through the
>>code today, and I'll post the problem on the Lucene Dev board .. it would
>>
>be
>
>>nice to know who wrote the damn thing .. they could probably fix this one
>>in no time.
>>
>>cheers
>>
>>OPEN SOURCE ROCKS
>>
>>
>>-----Original Message-----
>>From: leo leonid [mailto:tek@leonid.de]
>>Sent: Saturday, April 06, 2002 7:44 PM
>>To: cocoon-users@xml.apache.org
>>Subject: Re: Sorry to be a nag
>>
>>
>>uups. wrong URL. forget the old .com, the lucene try is on
>>http://www.helnwein.de
>>sorry
>>/Leo
>>
>>
>>On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
>>
>>>yes! I tried it. And the result was the same error as you got.
>>>I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
>>>many open files)" on Fri Mar 15, but it faded out quickly.
>>>Indexing works now, but I had to limit indexing to a small part of my
>>>site :-(
>>>Another problem I have: non-ascii characters in query strings (e.g.
>>>german Umlauts) you can test my try at http://www.helnwein.com )
>>>/Leo
>>>
>>>
>>>On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
>>>
>>>>People sorry to be a nag and I have asked this one before and
>>>>got nothing, but just to make sure .. has anyone out there developed
>>>>an App as opposed to a webapp to create a search index using the lucene
>>>>library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
>>>>
>>>>OS : Solaris 8
>>>>Webserver : Orion 1.4.5
>>>>Cocoon : 2.0.2
>>>>
>>>>
>>>>Nader S. Henein
>>>>Bayt.com , Dubai Internet City
>>>>Tel. +9714 3911900
>>>>Fax. +9714 3911915
>>>>GSM. +9715 05659557
>>>>www.bayt.com
>>>>
>>>>---------------------------------------------------------------------
>>>>Please check that your question has not already been answered in the
>>>>FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>>>
>>>>To unsubscribe, e-mail: <co...@xml.apache.org>
>>>>For additional commands, e-mail: <co...@xml.apache.org>
>>>>
>>>>
>>>
>>>---------------------------------------------------------------------
>>>Please check that your question has not already been answered in the
>>>FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>>
>>>To unsubscribe, e-mail: <co...@xml.apache.org>
>>>For additional commands, e-mail: <co...@xml.apache.org>
>>>
>>>
>>
>>---------------------------------------------------------------------
>>Please check that your question has not already been answered in the
>>FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>
>>To unsubscribe, e-mail: <co...@xml.apache.org>
>>For additional commands, e-mail: <co...@xml.apache.org>
>>
>>
>>
>>---------------------------------------------------------------------
>>Please check that your question has not already been answered in the
>>FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>
>>To unsubscribe, e-mail: <co...@xml.apache.org>
>>For additional commands, e-mail: <co...@xml.apache.org>
>>
>--
>http://www.superlinksoftware.com
>http://jakarta.apache.org/poi - port of Excel/Word/OLE 2 Compound
>Document
> format to java
>http://developer.java.sun.com/developer/bugParade/bugs/4487555.html
> - fix java generics!
>The avalanche has already started. It is too late for the pebbles to
>vote.
>-Ambassador Kosh
>
>
>---------------------------------------------------------------------
>Please check that your question has not already been answered in the
>FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
>To unsubscribe, e-mail: <co...@xml.apache.org>
>For additional commands, e-mail: <co...@xml.apache.org>
>
>
>
>---------------------------------------------------------------------
>Please check that your question has not already been answered in the
>FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
>To unsubscribe, e-mail: <co...@xml.apache.org>
>For additional commands, e-mail: <co...@xml.apache.org>
>
>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
RE: Sorry to be a nag
Posted by "Nader S. Henein" <ns...@bayt.net>.
yes It occurs after you've indexed a couple thousand documents
and you try to search .. I've increased the number of file handles in
UNIX and I'm testing the results now .. but the other problem is creating
an application as opposed to a webapp to do the indexing because indexing
200000 XML documents from the webapp isn't realistic.
thanks
-----Original Message-----
From: Andrew C. Oliver [mailto:acoliver@apache.org]
Sent: Monday, April 08, 2002 4:01 PM
To: cocoon-users@xml.apache.org
Subject: RE: Sorry to be a nag
This sounds like your index merge factor.
On Mon, 2002-04-08 at 03:26, Nader S. Henein wrote:
> Cocoon Lucene Indesing: "Too Many files open Error"
>
> I can't opt for that solution, what I'm trying to do
> is get out of Oracle Internmedia and ultimately out of oracle
> and if you've ever had oracle bill you for licensing fees
> you'll know why ... but as far as the indexing is concerned
> I'm going to need to index about 200 000 XML files did you try
> discussing the problem on the lucene dev forums ? I mean it is
> open source we should be able to fix it.
> The "Too Many files open Error" sounds like there is a file handle
> close() method missing somewhere I'm going to start going through the
> code today, and I'll post the problem on the Lucene Dev board .. it would
be
> nice to know who wrote the damn thing .. they could probably fix this one
> in no time.
>
> cheers
>
> OPEN SOURCE ROCKS
>
>
> -----Original Message-----
> From: leo leonid [mailto:tek@leonid.de]
> Sent: Saturday, April 06, 2002 7:44 PM
> To: cocoon-users@xml.apache.org
> Subject: Re: Sorry to be a nag
>
>
> uups. wrong URL. forget the old .com, the lucene try is on
> http://www.helnwein.de
> sorry
> /Leo
>
>
> On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
>
> > yes! I tried it. And the result was the same error as you got.
> > I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
> > many open files)" on Fri Mar 15, but it faded out quickly.
> > Indexing works now, but I had to limit indexing to a small part of my
> > site :-(
> > Another problem I have: non-ascii characters in query strings (e.g.
> > german Umlauts) you can test my try at http://www.helnwein.com )
> > /Leo
> >
> >
> > On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
> >
> >> People sorry to be a nag and I have asked this one before and
> >> got nothing, but just to make sure .. has anyone out there developed
> >> an App as opposed to a webapp to create a search index using the lucene
> >> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
> >>
> >> OS : Solaris 8
> >> Webserver : Orion 1.4.5
> >> Cocoon : 2.0.2
> >>
> >>
> >> Nader S. Henein
> >> Bayt.com , Dubai Internet City
> >> Tel. +9714 3911900
> >> Fax. +9714 3911915
> >> GSM. +9715 05659557
> >> www.bayt.com
> >>
> >> ---------------------------------------------------------------------
> >> Please check that your question has not already been answered in the
> >> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >>
> >> To unsubscribe, e-mail: <co...@xml.apache.org>
> >> For additional commands, e-mail: <co...@xml.apache.org>
> >>
> >>
> >
> >
> > ---------------------------------------------------------------------
> > Please check that your question has not already been answered in the
> > FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >
> > To unsubscribe, e-mail: <co...@xml.apache.org>
> > For additional commands, e-mail: <co...@xml.apache.org>
> >
> >
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
--
http://www.superlinksoftware.com
http://jakarta.apache.org/poi - port of Excel/Word/OLE 2 Compound
Document
format to java
http://developer.java.sun.com/developer/bugParade/bugs/4487555.html
- fix java generics!
The avalanche has already started. It is too late for the pebbles to
vote.
-Ambassador Kosh
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
RE: Sorry to be a nag
Posted by "Andrew C. Oliver" <ac...@apache.org>.
This sounds like your index merge factor.
On Mon, 2002-04-08 at 03:26, Nader S. Henein wrote:
> Cocoon Lucene Indesing: "Too Many files open Error"
>
> I can't opt for that solution, what I'm trying to do
> is get out of Oracle Internmedia and ultimately out of oracle
> and if you've ever had oracle bill you for licensing fees
> you'll know why ... but as far as the indexing is concerned
> I'm going to need to index about 200 000 XML files did you try
> discussing the problem on the lucene dev forums ? I mean it is
> open source we should be able to fix it.
> The "Too Many files open Error" sounds like there is a file handle
> close() method missing somewhere I'm going to start going through the
> code today, and I'll post the problem on the Lucene Dev board .. it would be
> nice to know who wrote the damn thing .. they could probably fix this one
> in no time.
>
> cheers
>
> OPEN SOURCE ROCKS
>
>
> -----Original Message-----
> From: leo leonid [mailto:tek@leonid.de]
> Sent: Saturday, April 06, 2002 7:44 PM
> To: cocoon-users@xml.apache.org
> Subject: Re: Sorry to be a nag
>
>
> uups. wrong URL. forget the old .com, the lucene try is on
> http://www.helnwein.de
> sorry
> /Leo
>
>
> On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
>
> > yes! I tried it. And the result was the same error as you got.
> > I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
> > many open files)" on Fri Mar 15, but it faded out quickly.
> > Indexing works now, but I had to limit indexing to a small part of my
> > site :-(
> > Another problem I have: non-ascii characters in query strings (e.g.
> > german Umlauts) you can test my try at http://www.helnwein.com )
> > /Leo
> >
> >
> > On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
> >
> >> People sorry to be a nag and I have asked this one before and
> >> got nothing, but just to make sure .. has anyone out there developed
> >> an App as opposed to a webapp to create a search index using the lucene
> >> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
> >>
> >> OS : Solaris 8
> >> Webserver : Orion 1.4.5
> >> Cocoon : 2.0.2
> >>
> >>
> >> Nader S. Henein
> >> Bayt.com , Dubai Internet City
> >> Tel. +9714 3911900
> >> Fax. +9714 3911915
> >> GSM. +9715 05659557
> >> www.bayt.com
> >>
> >> ---------------------------------------------------------------------
> >> Please check that your question has not already been answered in the
> >> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >>
> >> To unsubscribe, e-mail: <co...@xml.apache.org>
> >> For additional commands, e-mail: <co...@xml.apache.org>
> >>
> >>
> >
> >
> > ---------------------------------------------------------------------
> > Please check that your question has not already been answered in the
> > FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
> >
> > To unsubscribe, e-mail: <co...@xml.apache.org>
> > For additional commands, e-mail: <co...@xml.apache.org>
> >
> >
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
--
http://www.superlinksoftware.com
http://jakarta.apache.org/poi - port of Excel/Word/OLE 2 Compound
Document
format to java
http://developer.java.sun.com/developer/bugParade/bugs/4487555.html
- fix java generics!
The avalanche has already started. It is too late for the pebbles to
vote.
-Ambassador Kosh
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
RE: Sorry to be a nag
Posted by "Nader S. Henein" <ns...@bayt.net>.
Cocoon Lucene Indesing: "Too Many files open Error"
I can't opt for that solution, what I'm trying to do
is get out of Oracle Internmedia and ultimately out of oracle
and if you've ever had oracle bill you for licensing fees
you'll know why ... but as far as the indexing is concerned
I'm going to need to index about 200 000 XML files did you try
discussing the problem on the lucene dev forums ? I mean it is
open source we should be able to fix it.
The "Too Many files open Error" sounds like there is a file handle
close() method missing somewhere I'm going to start going through the
code today, and I'll post the problem on the Lucene Dev board .. it would be
nice to know who wrote the damn thing .. they could probably fix this one
in no time.
cheers
OPEN SOURCE ROCKS
-----Original Message-----
From: leo leonid [mailto:tek@leonid.de]
Sent: Saturday, April 06, 2002 7:44 PM
To: cocoon-users@xml.apache.org
Subject: Re: Sorry to be a nag
uups. wrong URL. forget the old .com, the lucene try is on
http://www.helnwein.de
sorry
/Leo
On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
> yes! I tried it. And the result was the same error as you got.
> I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
> many open files)" on Fri Mar 15, but it faded out quickly.
> Indexing works now, but I had to limit indexing to a small part of my
> site :-(
> Another problem I have: non-ascii characters in query strings (e.g.
> german Umlauts) you can test my try at http://www.helnwein.com )
> /Leo
>
>
> On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
>
>> People sorry to be a nag and I have asked this one before and
>> got nothing, but just to make sure .. has anyone out there developed
>> an App as opposed to a webapp to create a search index using the lucene
>> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
>>
>> OS : Solaris 8
>> Webserver : Orion 1.4.5
>> Cocoon : 2.0.2
>>
>>
>> Nader S. Henein
>> Bayt.com , Dubai Internet City
>> Tel. +9714 3911900
>> Fax. +9714 3911915
>> GSM. +9715 05659557
>> www.bayt.com
>>
>> ---------------------------------------------------------------------
>> Please check that your question has not already been answered in the
>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>
>> To unsubscribe, e-mail: <co...@xml.apache.org>
>> For additional commands, e-mail: <co...@xml.apache.org>
>>
>>
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
Re: Sorry to be a nag
Posted by leo leonid <te...@leonid.de>.
uups. wrong URL. forget the old .com, the lucene try is on
http://www.helnwein.de
sorry
/Leo
On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote:
> yes! I tried it. And the result was the same error as you got.
> I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too
> many open files)" on Fri Mar 15, but it faded out quickly.
> Indexing works now, but I had to limit indexing to a small part of my
> site :-(
> Another problem I have: non-ascii characters in query strings (e.g.
> german Umlauts) you can test my try at http://www.helnwein.com )
> /Leo
>
>
> On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
>
>> People sorry to be a nag and I have asked this one before and
>> got nothing, but just to make sure .. has anyone out there developed
>> an App as opposed to a webapp to create a search index using the lucene
>> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
>>
>> OS : Solaris 8
>> Webserver : Orion 1.4.5
>> Cocoon : 2.0.2
>>
>>
>> Nader S. Henein
>> Bayt.com , Dubai Internet City
>> Tel. +9714 3911900
>> Fax. +9714 3911915
>> GSM. +9715 05659557
>> www.bayt.com
>>
>> ---------------------------------------------------------------------
>> Please check that your question has not already been answered in the
>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>>
>> To unsubscribe, e-mail: <co...@xml.apache.org>
>> For additional commands, e-mail: <co...@xml.apache.org>
>>
>>
>
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>
Re: Sorry to be a nag
Posted by leo leonid <te...@leonid.de>.
yes! I tried it. And the result was the same error as you got.
I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too many
open files)" on Fri Mar 15, but it faded out quickly.
Indexing works now, but I had to limit indexing to a small part of my
site :-(
Another problem I have: non-ascii characters in query strings (e.g.
german Umlauts) you can test my try at http://www.helnwein.com )
/Leo
On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote:
> People sorry to be a nag and I have asked this one before and
> got nothing, but just to make sure .. has anyone out there developed
> an App as opposed to a webapp to create a search index using the lucene
> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer.
>
> OS : Solaris 8
> Webserver : Orion 1.4.5
> Cocoon : 2.0.2
>
>
> Nader S. Henein
> Bayt.com , Dubai Internet City
> Tel. +9714 3911900
> Fax. +9714 3911915
> GSM. +9715 05659557
> www.bayt.com
>
> ---------------------------------------------------------------------
> Please check that your question has not already been answered in the
> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
>
> To unsubscribe, e-mail: <co...@xml.apache.org>
> For additional commands, e-mail: <co...@xml.apache.org>
>
>
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <co...@xml.apache.org>
For additional commands, e-mail: <co...@xml.apache.org>