You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@opennlp.apache.org by Riccardo Tasso <ri...@gmail.com> on 2012/02/14 14:33:19 UTC

Re: [Name Finder] Wikipedia training set and parameters tuning

On 26/01/2012 20:39, Olivier Grisel wrote:
> In my experience the DBpedia type links for Person, Place and
> Organization are very good quality. No false positives, there might be
> some missing links though.

Probably you're rigth if you speak of english dataset. I'm using the 
italian one, found at:
http://downloads.dbpedia.org/3.7-i18n/it/instance_types_it.nt.bz2

It is good for Person and Place classes, but it doesn't contain any 
Company! For them I'll use my standard technique, just reading the 
wikipedia template dump.

Cheers,
     Riccardo



Re: [Name Finder] Wikipedia training set and parameters tuning

Posted by Olivier Grisel <ol...@ensta.org>.
2012/2/14 Riccardo Tasso <ri...@gmail.com>:
> On 26/01/2012 20:39, Olivier Grisel wrote:
>>
>> In my experience the DBpedia type links for Person, Place and
>> Organization are very good quality. No false positives, there might be
>> some missing links though.
>
>
> Probably you're rigth if you speak of english dataset. I'm using the italian
> one, found at:
> http://downloads.dbpedia.org/3.7-i18n/it/instance_types_it.nt.bz2
>
> It is good for Person and Place classes, but it doesn't contain any Company!
> For them I'll use my standard technique, just reading the wikipedia template
> dump.

Indeed even in http://downloads.dbpedia.org/3.7/it/instance_types_it.nt.bz2
there is no entity with type http://dbpedia.org/ontology/Organisation
while there are many both for English, German and French for instance.

This looks like a bug in the template mappings. This is probably
fixable here: http://mappings.dbpedia.org/index.php/Main_Page

However, for entities that have it <-> en linked wikipedia pages you
can combine:

http://downloads.dbpedia.org/3.7/it/wikipedia_links_it.nt.bz2

along with:

http://downloads.dbpedia.org/3.7/en/instance_types_en.nt.bz2

to find the type of italian wikilinks in the Italian wikipedia dumps.
This is how I do it with pignlproc to support the French language
corpus.

-- 
Olivier
http://twitter.com/ogrisel - http://github.com/ogrisel