You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Lars Aronsson <la...@aronsson.se> on 2005/09/12 19:51:39 UTC

Re: [Nutch-general] Re: Sequences of Terms

Andy Liu wrote:

> You can try indexing all 2-grams, 3-grams, and 4-grams in your corpus. Then 
> you can examine all the terms in your index and see which n-grams are used 
> the most.

Another idea can be to download a dump of the Wikipedia database 
(from http://download.wikimedia.org/) and use the list of article 
titles to see if the named concept has an article there, such as 
the 2-gram "Henry Ford" or the 4-gram "weapons of mass 
destruction".

That's just a loose idea.  I haven't tried it.  Are there any good 
introductory books on modern, post-Google information retrieval?

-- 
  Lars Aronsson (lars@aronsson.se)
  Aronsson Datateknik - http://aronsson.se