You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Patrick TALBOT <pt...@nagora.com> on 2002/02/22 00:04:01 UTC
French Analyzer
Hi,
I have written a French Analyzer for Lucene, (which can be packaged in
org.apache.lucene.analysis.fr) based on the German Analyzer by Gerhard
Schwarz, and inspired by the "French stemming algorithm" - Porter's work on
his snowball project http://snowball.sourceforge.net/french/stemmer.html +
an extended "real life" stop words list.
I have been using it for multimedia developement for my company (in France,
for french projects) and it's working perfectly, so in the spirit of "making
it up to you", and if you are interested into adding it to the Lucene
distrib, let me know, and I will send you the sources.
PS : By the way, it's an amazing piece of software you created here,
congratulations !
Patrick TALBOT
------------------------------------
Nagora Communication
ptalbot@nagora.com
http://www.nagora.com
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: French Analyzer
Posted by Erik Hatcher <er...@ehatchersolutions.com>.
How timely.... right when I start looking at the analyzers in the
sandbox and doing some minor cleanup there. I've added this to the
sandbox.
p.s. If anyone wants to write some test cases for the analyzers in the
sandbox, feel free... they desperately need them!
On Jan 19, 2004, at 8:50 PM, Otis Gospodnetic wrote:
> Added to the patch queue:
> http://issues.apache.org/bugzilla/show_bug.cgi?id=26268
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org
RE: French Analyzer
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Added to the patch queue:
http://issues.apache.org/bugzilla/show_bug.cgi?id=26268
Only 2 years later!
Thank you for your contribution.
Otis
--- Patrick TALBOT <pt...@nagora.com> wrote:
> Hi,
>
> you will find attached the source files for the FrenchAnalyzer,
> packaged in
> org.apache.lucene.analysis.fr...
>
> I don't know if it's a good idea to post it to the list but, as
> someone else
> here said
> "I don't have CVS access and prefer the safety of not having it :)",
> so I
> apologize for the bad etiquette ;=)
>
> Should it be part of the core or not ? I honestly don't know, and
> even if I
> will made myself available for any correction/enhancement, I let you
> guys
> come to your own decision about it.
>
> I just thought that it could be convenient to have it bundled for
> people
> building french related project, but may be you could have a special
> "outside module" directory structure for other language-related
> stemmers and
> mark them as "non supported", "use it at your own risk", etc...
>
> As long as the source code is available, I think that people will
> always be
> glad to have these modules, if only as a base code for enhancement.
>
> In some remote place of the world, you never know, but someone may be
> using
> these "miscellaneous languages" :))
>
> Cheers,
>
> Patrick Talbot (from France)
>
> -----Message d'origine-----
> De : Otis Gospodnetic [mailto:otis_gospodnetic@yahoo.com]
> Envoy� : vendredi 22 f�vrier 2002 02:11
> � : Lucene Developers List
> Cc : talbot@nagora.com
> Objet : Re: French Analyzer
>
>
> Hello,
>
> Yes, I think this would be a nice addition to Lucene. Could you
> please
> send it?
>
> Also, a lady who worked on a Finish stemmer sent her code a while
> back.
> I doubt many people on the list speak Finish and can test the code,
> so
> I suggest that we add it to the distribution, let people try it, and
> report problems if there are any.
>
> Hm, now that I think about it, should language-components that are
> submitted by people be a part of the Lucene core?
> What happens if there is a bug in that code? The original submitter
> may not be interested in fixing it and/or sending patches, etc. and
> other Lucene developers may not know the code/language.
>
> Thanks,
> Otis
>
>
> ATTACHMENT part 2 application/octet-stream name=french.jar
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
<ma...@jakarta.apache.org>
__________________________________
Do you Yahoo!?
Yahoo! Hotjobs: Enter the "Signing Bonus" Sweepstakes
http://hotjobs.sweepstakes.yahoo.com/signingbonus
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org
RE: French Analyzer
Posted by Patrick TALBOT <pt...@nagora.com>.
Hi,
you will find attached the source files for the FrenchAnalyzer, packaged in
org.apache.lucene.analysis.fr...
I don't know if it's a good idea to post it to the list but, as someone else
here said
"I don't have CVS access and prefer the safety of not having it :)", so I
apologize for the bad etiquette ;=)
Should it be part of the core or not ? I honestly don't know, and even if I
will made myself available for any correction/enhancement, I let you guys
come to your own decision about it.
I just thought that it could be convenient to have it bundled for people
building french related project, but may be you could have a special
"outside module" directory structure for other language-related stemmers and
mark them as "non supported", "use it at your own risk", etc...
As long as the source code is available, I think that people will always be
glad to have these modules, if only as a base code for enhancement.
In some remote place of the world, you never know, but someone may be using
these "miscellaneous languages" :))
Cheers,
Patrick Talbot (from France)
-----Message d'origine-----
De : Otis Gospodnetic [mailto:otis_gospodnetic@yahoo.com]
Envoyé : vendredi 22 février 2002 02:11
À : Lucene Developers List
Cc : talbot@nagora.com
Objet : Re: French Analyzer
Hello,
Yes, I think this would be a nice addition to Lucene. Could you please
send it?
Also, a lady who worked on a Finish stemmer sent her code a while back.
I doubt many people on the list speak Finish and can test the code, so
I suggest that we add it to the distribution, let people try it, and
report problems if there are any.
Hm, now that I think about it, should language-components that are
submitted by people be a part of the Lucene core?
What happens if there is a bug in that code? The original submitter
may not be interested in fixing it and/or sending patches, etc. and
other Lucene developers may not know the code/language.
Thanks,
Otis
Re: French Analyzer
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Hello,
Yes, I think this would be a nice addition to Lucene. Could you please
send it?
Also, a lady who worked on a Finish stemmer sent her code a while back.
I doubt many people on the list speak Finish and can test the code, so
I suggest that we add it to the distribution, let people try it, and
report problems if there are any.
Hm, now that I think about it, should language-components that are
submitted by people be a part of the Lucene core?
What happens if there is a bug in that code? The original submitter
may not be interested in fixing it and/or sending patches, etc. and
other Lucene developers may not know the code/language.
Thanks,
Otis
--- Patrick TALBOT <pt...@nagora.com> wrote:
> Hi,
>
> I have written a French Analyzer for Lucene, (which can be packaged
> in
> org.apache.lucene.analysis.fr) based on the German Analyzer by
> Gerhard
> Schwarz, and inspired by the "French stemming algorithm" - Porter's
> work on
> his snowball project
> http://snowball.sourceforge.net/french/stemmer.html +
> an extended "real life" stop words list.
>
> I have been using it for multimedia developement for my company (in
> France,
> for french projects) and it's working perfectly, so in the spirit of
> "making
> it up to you", and if you are interested into adding it to the Lucene
> distrib, let me know, and I will send you the sources.
>
> PS : By the way, it's an amazing piece of software you created here,
> congratulations !
>
> Patrick TALBOT
> ------------------------------------
> Nagora Communication
> ptalbot@nagora.com
> http://www.nagora.com
>
>
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
>
__________________________________________________
Do You Yahoo!?
Yahoo! Sports - Coverage of the 2002 Olympic Games
http://sports.yahoo.com
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>