You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by petite_abeille <pe...@mac.com> on 2002/11/22 20:46:16 UTC
Readability score?
Hello,
This is slightly off topic but...
Does anyone have a handy library to compute "readability score"?
Something like Flesch Reading Ease score & Co:
http://thibs.menloschool.org/~djwong/docs/wordReadabilityformulas.html
Would you like to share?-)
Thanks.
R.
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
RE: Searches are not case insensitive
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Ah, field NAME, not field VALUE. Normally when people refer to field
they tend to refer to field value.
Yes, field name does not get touched in an Analyzer.
I have not tested that, but apparently so (case sensitivity). Don't
worry about finding out, just use lower case field names everywhere.
Otis
--- Rob Outar <ro...@ideorlando.org> wrote:
> From briefly looking at the code it looks like the "field" does not
> get
> touched it seems like the only part that gets converted to lower case
> is the
> value, so I am assuming that the field name is case sensitive but the
> value
> is not?
>
>
> Thanks,
>
> Rob
>
>
> -----Original Message-----
> From: Otis Gospodnetic [mailto:otis_gospodnetic@yahoo.com]
> Sent: Monday, November 25, 2002 8:25 AM
> To: Lucene Users List
> Subject: Re: Searches are not case insensitive
>
>
> Why not add print statements to your analyzer to ensure that what you
> think is happening really is happening? Token has an attribute
> called
> 'text' that you could print, I believe.
>
> Otis
>
> --- Rob Outar <ro...@ideorlando.org> wrote:
> > Hello all,
> >
> > I created the following analyzer so that clients could pose case
> > insensitive searches but queries are still case sensitive:
> >
> > // do not tokenize any field
> > TokenStream t = new CharTokenizer(reader) {
> > protected boolean isTokenChar(char c) {
> > return true;
> > }
> > };
> > //case insensitive search
> > t = new LowerCaseFilter(t);
> >
> > return t;
> > }
> >
> > I use that index when I create a new instance of IndexWriter and
> when
> > I use
> > QueryPaser, I am not sure why my searches are still case dependent.
> >
> > Any help would be appreciated.
> >
> > Thanks,
> >
> > Rob
> >
> >
> > --
> > To unsubscribe, e-mail:
> > <ma...@jakarta.apache.org>
> > For additional commands, e-mail:
> > <ma...@jakarta.apache.org>
> >
>
>
> __________________________________________________
> Do you Yahoo!?
> Yahoo! Mail Plus Powerful. Affordable. Sign up now.
> http://mailplus.yahoo.com
>
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
>
>
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
>
__________________________________________________
Do you Yahoo!?
Yahoo! Mail Plus � Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
RE: Searches are not case insensitive
Posted by Rob Outar <ro...@ideorlando.org>.
>From briefly looking at the code it looks like the "field" does not get
touched it seems like the only part that gets converted to lower case is the
value, so I am assuming that the field name is case sensitive but the value
is not?
Thanks,
Rob
-----Original Message-----
From: Otis Gospodnetic [mailto:otis_gospodnetic@yahoo.com]
Sent: Monday, November 25, 2002 8:25 AM
To: Lucene Users List
Subject: Re: Searches are not case insensitive
Why not add print statements to your analyzer to ensure that what you
think is happening really is happening? Token has an attribute called
'text' that you could print, I believe.
Otis
--- Rob Outar <ro...@ideorlando.org> wrote:
> Hello all,
>
> I created the following analyzer so that clients could pose case
> insensitive searches but queries are still case sensitive:
>
> // do not tokenize any field
> TokenStream t = new CharTokenizer(reader) {
> protected boolean isTokenChar(char c) {
> return true;
> }
> };
> //case insensitive search
> t = new LowerCaseFilter(t);
>
> return t;
> }
>
> I use that index when I create a new instance of IndexWriter and when
> I use
> QueryPaser, I am not sure why my searches are still case dependent.
>
> Any help would be appreciated.
>
> Thanks,
>
> Rob
>
>
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
>
__________________________________________________
Do you Yahoo!?
Yahoo! Mail Plus Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com
--
To unsubscribe, e-mail:
<ma...@jakarta.apache.org>
For additional commands, e-mail:
<ma...@jakarta.apache.org>
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: Searches are not case insensitive
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Why not add print statements to your analyzer to ensure that what you
think is happening really is happening? Token has an attribute called
'text' that you could print, I believe.
Otis
--- Rob Outar <ro...@ideorlando.org> wrote:
> Hello all,
>
> I created the following analyzer so that clients could pose case
> insensitive searches but queries are still case sensitive:
>
> // do not tokenize any field
> TokenStream t = new CharTokenizer(reader) {
> protected boolean isTokenChar(char c) {
> return true;
> }
> };
> //case insensitive search
> t = new LowerCaseFilter(t);
>
> return t;
> }
>
> I use that index when I create a new instance of IndexWriter and when
> I use
> QueryPaser, I am not sure why my searches are still case dependent.
>
> Any help would be appreciated.
>
> Thanks,
>
> Rob
>
>
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
>
__________________________________________________
Do you Yahoo!?
Yahoo! Mail Plus � Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Searches are not case insensitive
Posted by Rob Outar <ro...@ideorlando.org>.
Hello all,
I created the following analyzer so that clients could pose case
insensitive searches but queries are still case sensitive:
// do not tokenize any field
TokenStream t = new CharTokenizer(reader) {
protected boolean isTokenChar(char c) {
return true;
}
};
//case insensitive search
t = new LowerCaseFilter(t);
return t;
}
I use that index when I create a new instance of IndexWriter and when I use
QueryPaser, I am not sure why my searches are still case dependent.
Any help would be appreciated.
Thanks,
Rob
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: Readability score?
Posted by petite_abeille <pe...@mac.com>.
On Friday, Nov 22, 2002, at 20:46 Europe/Zurich, petite_abeille wrote:
> Does anyone have a handy library to compute "readability score"?
Here is an extract from a paper describing the Flesch index and an
algorithm to count syllables... Does that make any sense?
Thanks.
"The Flesch index: An easily programmable readability analysis
algorithm"
-- John Talburt
"... Each vowel (a, e, i, o, u, y) in a word counts as one syllable
subject to the following sub-rules: Ignore final -ES, -ED, -E (except
for -LE) Words of three letters or less count as one syllable
Consecutive vowels count as one syllable. Although there are many
exceptions to these rules, it works in a remarkable number of cases.
..."
http://portal.acm.org/
citation.cfm?id=10583&coll=portal&dl=ACM&CFID=5876721&CFTOKEN=58538732
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>