You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@opennlp.apache.org by Riccardo Tasso <ri...@gmail.com> on 2012/02/14 14:33:19 UTC
Re: [Name Finder] Wikipedia training set and parameters tuning
On 26/01/2012 20:39, Olivier Grisel wrote:
> In my experience the DBpedia type links for Person, Place and
> Organization are very good quality. No false positives, there might be
> some missing links though.
Probably you're rigth if you speak of english dataset. I'm using the
italian one, found at:
http://downloads.dbpedia.org/3.7-i18n/it/instance_types_it.nt.bz2
It is good for Person and Place classes, but it doesn't contain any
Company! For them I'll use my standard technique, just reading the
wikipedia template dump.
Cheers,
Riccardo
Re: [Name Finder] Wikipedia training set and parameters tuning
Posted by Olivier Grisel <ol...@ensta.org>.
2012/2/14 Riccardo Tasso <ri...@gmail.com>:
> On 26/01/2012 20:39, Olivier Grisel wrote:
>>
>> In my experience the DBpedia type links for Person, Place and
>> Organization are very good quality. No false positives, there might be
>> some missing links though.
>
>
> Probably you're rigth if you speak of english dataset. I'm using the italian
> one, found at:
> http://downloads.dbpedia.org/3.7-i18n/it/instance_types_it.nt.bz2
>
> It is good for Person and Place classes, but it doesn't contain any Company!
> For them I'll use my standard technique, just reading the wikipedia template
> dump.
Indeed even in http://downloads.dbpedia.org/3.7/it/instance_types_it.nt.bz2
there is no entity with type http://dbpedia.org/ontology/Organisation
while there are many both for English, German and French for instance.
This looks like a bug in the template mappings. This is probably
fixable here: http://mappings.dbpedia.org/index.php/Main_Page
However, for entities that have it <-> en linked wikipedia pages you
can combine:
http://downloads.dbpedia.org/3.7/it/wikipedia_links_it.nt.bz2
along with:
http://downloads.dbpedia.org/3.7/en/instance_types_en.nt.bz2
to find the type of italian wikilinks in the Italian wikipedia dumps.
This is how I do it with pignlproc to support the French language
corpus.
--
Olivier
http://twitter.com/ogrisel - http://github.com/ogrisel