You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stanbol.apache.org by Manish Aggarwal <ma...@gmail.com> on 2013/06/12 15:11:19 UTC
indexing
Hi,
Is there any way to know, which all properties are indexed in an solrindex
dump?
Currently I am using freebase index, which after unzipping is of 49GB size.
But I am unable to look up the properties
like "fb:people.person.nationality", "fb:people.person.gender" and others.
I am using fiedQuery:
{
"selected": [
"rdf:type",
"fb:people.person.date_of_birth",
"fb:people.person.children",
"fb:common.topic",
"fb:people.person.nationality",
"fb:people.person.gender"
],
"offset": "0",
"limit": "5",
"constraints": [{
"type": "text",
"language": "en",
"text": "Roger",
"field": "http:\/\/www.w3.org\/2000\/01\/rdf-schema#label"
}]
}
Reagrds,
Manish
Re: indexing
Posted by Rupert Westenthaler <ru...@gmail.com>.
Hi Manish,
On Thu, Jun 13, 2013 at 1:39 PM, Manish Aggarwal <ma...@gmail.com> wrote:
> Hi Rupert,
>
> Does dbpedia also have some equivalent like
> http://localhost:8080/entityhub/site/freebase/entity?id=http://rdf.freebase.com/ns/m.03qccxj&header_Accept=
>
> I am trying
> http://localhost:8080/entityhub/site/dbpedia/query?id=http://dbpedia.org/resource/Category:Honda_Civic&header_Accept=which
> does not seems to be working.
>
You URL is wrong. Try
http://localhost:8080/entityhub/site/dbpedia/entity?id=http://dbpedia.org/resource/Category:Honda_Civic&header_Accept=
>
> Also, I created dbpedia index with mapping.txt which contains the entry
> like:
>
> dbp-ont:industry | d=entityhub:ref
> dbp-prop:shortDescription | d=entityhub:text
> rdf:type | d=entityhub:ref
>
> But I am unable to fetch these properties from the resulting index file.
> The fieldQuery that I am using is:
>
> {
> "selected": [
> "rdf:type",
> "rdfs:label",
> "dbp-ont:industry",
> "dbp-prop:shortDescription",
> ],
> "offset": "0",
> "limit": "5",
> "constraints": [{
> "type": "text",
> "language": "en",
> "text": "Honda Civic",
> "field": "http:\/\/www.w3.org\/2000\/01\/rdf-schema#label"
> }]
> }
>
> Index is created from the following dumps:
> article_categories_en.nt.bz2 dbpedia_3.8.owl.bz2
> infobox_properties_en.nt.bz2 instance_types_en.nt.bz2
> pnd_en.nt.bz2
> category_labels_en.nt.bz2 homepages_en.nt.bz2
> infobox_property_definitions_en.nt.bz2 mappingbased_properties_en.nt.bz2
>
>
I think the properties are present in the index. It is just that
http://dbpedia.org/resource/Honda_Civic
does not define them as they are also not present on the DBpedia webpage.
Maybe try
http://dbpedia.org/resource/Audi
best
Rupert
>
>
>
>
> On Thu, Jun 13, 2013 at 12:06 PM, Manish Aggarwal <ma...@gmail.com>wrote:
>
>> Thanks Rupert for your answer. It's very informative.
>>
>>
>> On Wed, Jun 12, 2013 at 8:21 PM, Rupert Westenthaler <
>> rupert.westenthaler@gmail.com> wrote:
>>
>>> Hi Manish,
>>>
>>> Currently ReferencedSite do not know what properties are present.
>>> Generally it is not easy to know what properties are present, as this
>>> depends on may things in the configuration of the Entityhub Indexing
>>> Tool. In the case of Freebase one needs to consider two
>>> configurations:
>>>
>>> * mappings.txt used to index the site, as it defines the properties
>>> that will be indexed.
>>> * propertyfilter.config as it defines import filter that will exclude
>>> some RDF triples from being imported form the RDF dump to the Jena TDB
>>> (used as source for the indexing)
>>>
>>> Only properties that are enabled by both filters will be present in the
>>> index!
>>>
>>> An other (pragmatic) possibility to determine available properties is
>>> to search for a very famous Entity of the type you are interested
>>> (e.g. Barack Obama for Persons) and request this Entity from the
>>> ReferencedSite
>>>
>>>
>>> http://localhost:8080/entityhub/site/freebase/entity?id=http://rdf.freebase.com/ns/m.03qccxj&header_Accept=
>>>
>>> As famous Entities usually do have values for all properties this as
>>> also a pragmatic possibility to check what properties are present.
>>>
>>> If you used the default configuration to create the freebase index the
>>> following properties of your example should be present
>>>
>>> > "rdf:type",
>>> > "fb:people.person.date_of_birth",
>>> > "fb:people.person.nationality",
>>> > "fb:people.person.date_of_birth",
>>>
>>> The following properties are not included
>>>
>>> > "fb:people.person.gender"
>>>
>>> imported in Jena TDB, but excluded in mappings.txt.
>>>
>>> and
>>>
>>> > "fb:common.topic",
>>>
>>> is not a property but a category (see
>>> http://www.freebase.com/common/topic?schema=) for properties defined
>>> under this category
>>>
>>> If you want to have other/more properties to be included you will need
>>> to change the above mentioned configurations accordingly and create an
>>> new index. The default configuration of the Freebase Indexing tool is
>>> optimized for the use with the Stanbol Enhancer for EntityLinking.
>>>
>>> best
>>> Rupert
>>>
>>> On Wed, Jun 12, 2013 at 3:11 PM, Manish Aggarwal <ma...@gmail.com>
>>> wrote:
>>> > Hi,
>>> > I am using fiedQuery:
>>> >
>>> > {
>>> > "selected": [
>>> > "rdf:type",
>>> > "fb:people.person.date_of_birth",
>>> > "fb:people.person.children",
>>> > "fb:common.topic",
>>> > "fb:people.person.nationality",
>>> > "fb:people.person.gender"
>>> > ],
>>> > "offset": "0",
>>> > "limit": "5",
>>> > "constraints": [{
>>> > "type": "text",
>>> > "language": "en",
>>> > "text": "Roger",
>>> > "field": "http:\/\/www.w3.org\/2000\/01\/rdf-schema#label"
>>> > }]
>>> > }
>>> >
>>> >
>>> >
>>> > Reagrds,
>>> > Manish
>>>
>>>
>>>
>>> --
>>> | Rupert Westenthaler rupert.westenthaler@gmail.com
>>> | Bodenlehenstraße 11 ++43-699-11108907
>>> | A-5500 Bischofshofen
>>>
>>
>>
--
| Rupert Westenthaler rupert.westenthaler@gmail.com
| Bodenlehenstraße 11 ++43-699-11108907
| A-5500 Bischofshofen
Re: indexing
Posted by Manish Aggarwal <ma...@gmail.com>.
Hi Rupert,
Does dbpedia also have some equivalent like
http://localhost:8080/entityhub/site/freebase/entity?id=http://rdf.freebase.com/ns/m.03qccxj&header_Accept=
I am trying
http://localhost:8080/entityhub/site/dbpedia/query?id=http://dbpedia.org/resource/Category:Honda_Civic&header_Accept=which
does not seems to be working.
Also, I created dbpedia index with mapping.txt which contains the entry
like:
dbp-ont:industry | d=entityhub:ref
dbp-prop:shortDescription | d=entityhub:text
rdf:type | d=entityhub:ref
But I am unable to fetch these properties from the resulting index file.
The fieldQuery that I am using is:
{
"selected": [
"rdf:type",
"rdfs:label",
"dbp-ont:industry",
"dbp-prop:shortDescription",
],
"offset": "0",
"limit": "5",
"constraints": [{
"type": "text",
"language": "en",
"text": "Honda Civic",
"field": "http:\/\/www.w3.org\/2000\/01\/rdf-schema#label"
}]
}
Index is created from the following dumps:
article_categories_en.nt.bz2 dbpedia_3.8.owl.bz2
infobox_properties_en.nt.bz2 instance_types_en.nt.bz2
pnd_en.nt.bz2
category_labels_en.nt.bz2 homepages_en.nt.bz2
infobox_property_definitions_en.nt.bz2 mappingbased_properties_en.nt.bz2
On Thu, Jun 13, 2013 at 12:06 PM, Manish Aggarwal <ma...@gmail.com>wrote:
> Thanks Rupert for your answer. It's very informative.
>
>
> On Wed, Jun 12, 2013 at 8:21 PM, Rupert Westenthaler <
> rupert.westenthaler@gmail.com> wrote:
>
>> Hi Manish,
>>
>> Currently ReferencedSite do not know what properties are present.
>> Generally it is not easy to know what properties are present, as this
>> depends on may things in the configuration of the Entityhub Indexing
>> Tool. In the case of Freebase one needs to consider two
>> configurations:
>>
>> * mappings.txt used to index the site, as it defines the properties
>> that will be indexed.
>> * propertyfilter.config as it defines import filter that will exclude
>> some RDF triples from being imported form the RDF dump to the Jena TDB
>> (used as source for the indexing)
>>
>> Only properties that are enabled by both filters will be present in the
>> index!
>>
>> An other (pragmatic) possibility to determine available properties is
>> to search for a very famous Entity of the type you are interested
>> (e.g. Barack Obama for Persons) and request this Entity from the
>> ReferencedSite
>>
>>
>> http://localhost:8080/entityhub/site/freebase/entity?id=http://rdf.freebase.com/ns/m.03qccxj&header_Accept=
>>
>> As famous Entities usually do have values for all properties this as
>> also a pragmatic possibility to check what properties are present.
>>
>> If you used the default configuration to create the freebase index the
>> following properties of your example should be present
>>
>> > "rdf:type",
>> > "fb:people.person.date_of_birth",
>> > "fb:people.person.nationality",
>> > "fb:people.person.date_of_birth",
>>
>> The following properties are not included
>>
>> > "fb:people.person.gender"
>>
>> imported in Jena TDB, but excluded in mappings.txt.
>>
>> and
>>
>> > "fb:common.topic",
>>
>> is not a property but a category (see
>> http://www.freebase.com/common/topic?schema=) for properties defined
>> under this category
>>
>> If you want to have other/more properties to be included you will need
>> to change the above mentioned configurations accordingly and create an
>> new index. The default configuration of the Freebase Indexing tool is
>> optimized for the use with the Stanbol Enhancer for EntityLinking.
>>
>> best
>> Rupert
>>
>> On Wed, Jun 12, 2013 at 3:11 PM, Manish Aggarwal <ma...@gmail.com>
>> wrote:
>> > Hi,
>> > I am using fiedQuery:
>> >
>> > {
>> > "selected": [
>> > "rdf:type",
>> > "fb:people.person.date_of_birth",
>> > "fb:people.person.children",
>> > "fb:common.topic",
>> > "fb:people.person.nationality",
>> > "fb:people.person.gender"
>> > ],
>> > "offset": "0",
>> > "limit": "5",
>> > "constraints": [{
>> > "type": "text",
>> > "language": "en",
>> > "text": "Roger",
>> > "field": "http:\/\/www.w3.org\/2000\/01\/rdf-schema#label"
>> > }]
>> > }
>> >
>> >
>> >
>> > Reagrds,
>> > Manish
>>
>>
>>
>> --
>> | Rupert Westenthaler rupert.westenthaler@gmail.com
>> | Bodenlehenstraße 11 ++43-699-11108907
>> | A-5500 Bischofshofen
>>
>
>
Re: indexing
Posted by Manish Aggarwal <ma...@gmail.com>.
Thanks Rupert for your answer. It's very informative.
On Wed, Jun 12, 2013 at 8:21 PM, Rupert Westenthaler <
rupert.westenthaler@gmail.com> wrote:
> Hi Manish,
>
> Currently ReferencedSite do not know what properties are present.
> Generally it is not easy to know what properties are present, as this
> depends on may things in the configuration of the Entityhub Indexing
> Tool. In the case of Freebase one needs to consider two
> configurations:
>
> * mappings.txt used to index the site, as it defines the properties
> that will be indexed.
> * propertyfilter.config as it defines import filter that will exclude
> some RDF triples from being imported form the RDF dump to the Jena TDB
> (used as source for the indexing)
>
> Only properties that are enabled by both filters will be present in the
> index!
>
> An other (pragmatic) possibility to determine available properties is
> to search for a very famous Entity of the type you are interested
> (e.g. Barack Obama for Persons) and request this Entity from the
> ReferencedSite
>
>
> http://localhost:8080/entityhub/site/freebase/entity?id=http://rdf.freebase.com/ns/m.03qccxj&header_Accept=
>
> As famous Entities usually do have values for all properties this as
> also a pragmatic possibility to check what properties are present.
>
> If you used the default configuration to create the freebase index the
> following properties of your example should be present
>
> > "rdf:type",
> > "fb:people.person.date_of_birth",
> > "fb:people.person.nationality",
> > "fb:people.person.date_of_birth",
>
> The following properties are not included
>
> > "fb:people.person.gender"
>
> imported in Jena TDB, but excluded in mappings.txt.
>
> and
>
> > "fb:common.topic",
>
> is not a property but a category (see
> http://www.freebase.com/common/topic?schema=) for properties defined
> under this category
>
> If you want to have other/more properties to be included you will need
> to change the above mentioned configurations accordingly and create an
> new index. The default configuration of the Freebase Indexing tool is
> optimized for the use with the Stanbol Enhancer for EntityLinking.
>
> best
> Rupert
>
> On Wed, Jun 12, 2013 at 3:11 PM, Manish Aggarwal <ma...@gmail.com>
> wrote:
> > Hi,
> > I am using fiedQuery:
> >
> > {
> > "selected": [
> > "rdf:type",
> > "fb:people.person.date_of_birth",
> > "fb:people.person.children",
> > "fb:common.topic",
> > "fb:people.person.nationality",
> > "fb:people.person.gender"
> > ],
> > "offset": "0",
> > "limit": "5",
> > "constraints": [{
> > "type": "text",
> > "language": "en",
> > "text": "Roger",
> > "field": "http:\/\/www.w3.org\/2000\/01\/rdf-schema#label"
> > }]
> > }
> >
> >
> >
> > Reagrds,
> > Manish
>
>
>
> --
> | Rupert Westenthaler rupert.westenthaler@gmail.com
> | Bodenlehenstraße 11 ++43-699-11108907
> | A-5500 Bischofshofen
>
Re: indexing
Posted by Rupert Westenthaler <ru...@gmail.com>.
Hi Manish,
Currently ReferencedSite do not know what properties are present.
Generally it is not easy to know what properties are present, as this
depends on may things in the configuration of the Entityhub Indexing
Tool. In the case of Freebase one needs to consider two
configurations:
* mappings.txt used to index the site, as it defines the properties
that will be indexed.
* propertyfilter.config as it defines import filter that will exclude
some RDF triples from being imported form the RDF dump to the Jena TDB
(used as source for the indexing)
Only properties that are enabled by both filters will be present in the index!
An other (pragmatic) possibility to determine available properties is
to search for a very famous Entity of the type you are interested
(e.g. Barack Obama for Persons) and request this Entity from the
ReferencedSite
http://localhost:8080/entityhub/site/freebase/entity?id=http://rdf.freebase.com/ns/m.03qccxj&header_Accept=
As famous Entities usually do have values for all properties this as
also a pragmatic possibility to check what properties are present.
If you used the default configuration to create the freebase index the
following properties of your example should be present
> "rdf:type",
> "fb:people.person.date_of_birth",
> "fb:people.person.nationality",
> "fb:people.person.date_of_birth",
The following properties are not included
> "fb:people.person.gender"
imported in Jena TDB, but excluded in mappings.txt.
and
> "fb:common.topic",
is not a property but a category (see
http://www.freebase.com/common/topic?schema=) for properties defined
under this category
If you want to have other/more properties to be included you will need
to change the above mentioned configurations accordingly and create an
new index. The default configuration of the Freebase Indexing tool is
optimized for the use with the Stanbol Enhancer for EntityLinking.
best
Rupert
On Wed, Jun 12, 2013 at 3:11 PM, Manish Aggarwal <ma...@gmail.com> wrote:
> Hi,
> I am using fiedQuery:
>
> {
> "selected": [
> "rdf:type",
> "fb:people.person.date_of_birth",
> "fb:people.person.children",
> "fb:common.topic",
> "fb:people.person.nationality",
> "fb:people.person.gender"
> ],
> "offset": "0",
> "limit": "5",
> "constraints": [{
> "type": "text",
> "language": "en",
> "text": "Roger",
> "field": "http:\/\/www.w3.org\/2000\/01\/rdf-schema#label"
> }]
> }
>
>
>
> Reagrds,
> Manish
--
| Rupert Westenthaler rupert.westenthaler@gmail.com
| Bodenlehenstraße 11 ++43-699-11108907
| A-5500 Bischofshofen