You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Otis Gospodnetic <ot...@yahoo.com> on 2005/05/12 09:59:18 UTC
Top most frequent words
Somebody asked about this today, and I just found this through Simpy:
http://www.unine.ch/info/clef/
Scroll half-way through the page, look on the right side: 1,000 most
frequent words for several languages.
Otis
____________________________________________________________________
Simpy -- simpy.com -- tags, social bookmarks, personal search engine
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Top most frequent words
Posted by René Hackl <re...@gmx.de>.
Hi John,
> >from a slightly skewed source -- newspapers in a fixed interval
> perhaps. (I don't think "Los Angeles" makes it into every day parlance
You're right there. Most possibly the frequencies in that list are based on
a volume of the Los Angeles Times, that's one of the standard
CLEF-Collections. The Glasgow Herald is the second standard collection, here
"Scotland" and "scottish" are among the most frequent terms :-)
Maybe the "officials" come from sports articles --> LA --> LA Lakers?!
Cheers,
René
--
+++ Neu: Echte DSL-Flatrates von GMX - Surfen ohne Limits +++
Always online ab 4,99 Euro/Monat: http://www.gmx.net/de/go/dsl
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Top most frequent words
Posted by Ahmet Aksoy <ah...@axtelsoft.com>.
Hi John,
I haven't investigated the sources yet, but you might be right.
However, as you stated, those type of lists directly depend on the
subject, and the source.
Anyway, it is not very important for my study, and I'm sure it will help
me very much.
I will prepare optimized lists if I can obtain some different sets.
Best regards.
Ahmet
John Haxby wrote:
> Otis Gospodnetic wrote:
>
>> Somebody asked about this today, and I just found this through Simpy:
>> http://www.unine.ch/info/clef/
>>
>> Scroll half-way through the page, look on the right side: 1,000 most
>> frequent words for several languages.
>>
>>
> Hmm. I'm not sure how valuable that is. For English "los" and
> "angeles" are ranked 99 and 101 respectively and "officials" comes in
> at 125. Obviously I'm guessing, but those middle ranking words have
> come from a slightly skewed source -- newspapers in a fixed interval
> perhaps. (I don't think "Los Angeles" makes it into every day
> parlance in the UK, and "officials" suggests that we're obsessed with
> beauracracy :-))
>
> jch
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
>
> .
>
--
Ahmet Aksoy
axtelsoft.com - armalink.com
ahmetax.blogspot.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Top most frequent words
Posted by John Haxby <jc...@scalix.com>.
Otis Gospodnetic wrote:
>Somebody asked about this today, and I just found this through Simpy:
> http://www.unine.ch/info/clef/
>
>Scroll half-way through the page, look on the right side: 1,000 most
>frequent words for several languages.
>
>
Hmm. I'm not sure how valuable that is. For English "los" and
"angeles" are ranked 99 and 101 respectively and "officials" comes in at
125. Obviously I'm guessing, but those middle ranking words have come
from a slightly skewed source -- newspapers in a fixed interval
perhaps. (I don't think "Los Angeles" makes it into every day parlance
in the UK, and "officials" suggests that we're obsessed with beauracracy
:-))
jch
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Top most frequent words
Posted by Sven Duzont <sv...@laposte.net>.
Hi,
yeah, i just added it into simpy when i read René post ;)
congrats for simpy
Sven
Le jeudi 12 mai 2005 à 09:59:18, vous écriviez :
OG> Somebody asked about this today, and I just found this through Simpy:
OG> http://www.unine.ch/info/clef/
OG> Scroll half-way through the page, look on the right side: 1,000 most
OG> frequent words for several languages.
OG> Otis
OG> ____________________________________________________________________
OG> Simpy -- simpy.com -- tags, social bookmarks, personal search engine
OG> ---------------------------------------------------------------------
OG> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
OG> For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Top most frequent words
Posted by Ahmet Aksoy <ah...@axtelsoft.com>.
Hi Otis,
Thank you for the source address.
Best regards,
Ahmet
Otis Gospodnetic wrote:
>Somebody asked about this today, and I just found this through Simpy:
> http://www.unine.ch/info/clef/
>
>Scroll half-way through the page, look on the right side: 1,000 most
>frequent words for several languages.
>
>Otis
>
>____________________________________________________________________
>Simpy -- simpy.com -- tags, social bookmarks, personal search engine
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
>
>.
>
>
>
--
Ahmet Aksoy
axtelsoft.com - armalink.com
ahmetax.blogspot.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org