You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@marmotta.apache.org by FRANCISCO XAVIER SUMBA TORAL <xa...@ucuenca.ec> on 2015/06/15 23:45:51 UTC

[jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Hi all.

I have some news.

So far I have managed the implementation of 8 Boolean functions (RCC8) and also I have the implementation of one function "Non-Topologycal" (Buffer).
Queries work well on PostGIS. I worked with the implementation of NativeFunction. But here appeared a new problem. Some of the RDF files with  GeoSPARQL model, not loaded to marmotta.

ERROR: "Caused by: org.postgresql.util.PSQLException: ERROR: The string is too larg
to to tsvector (1177006 bytes, máximo 1048575 bytes) "

As I can solve this problem?.

Some geometries (Multipolygons, MultiLineString) have large WKT

By now it was not necessary to alter the database except for one comand to
activate postgis "CREATE EXTENSION postgis"

On the other hand, I’d like to commit my changes. Is there any structure to create the new branch?. 

Finally, I am so sorry for my confusion in the another email. 

Cheers.
Xavier Sumba.

Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by Sergio Fernández <wi...@apache.org>.
Francisco, let's talk at
https://plus.google.com/hangouts/_/redlink.co/marmotta-584

On Fri, Jun 26, 2015 at 8:47 AM, Sergio Fernández <wi...@apache.org> wrote:

> Hi Francisco,
>
> On Fri, Jun 26, 2015 at 5:39 AM, FRANCISCO XAVIER SUMBA TORAL <
> xavier.sumba93@ucuenca.ec> wrote:
>>
>> > OK, perfect. Please let me know if you'd need further advise. Maybe we
>> can
>> > arrange a call via skype/hangout next week?
>>
>> For sure, Could you on Monday at 11:00 AM Pacific Standard Time (GMT
>> -05:00)?
>
>
> That should also work me. I've just send you the appointment. Let's do it
> via hangout, so we can share the screen if necessary.
>
> > Great! It. d be great to have a table summarizing all GeoSPARQL
>> functions,
>> > what's currently supported native, what's currently supported in-memory,
>> > etc.
>> >
>> > Did you already get access to our wiki?
>> >
>>
>> Yes, I got access to the wiki.
>>
>
> Perfect. Then just add subpages per topics under
> https://wiki.apache.org/marmotta/GSoC/2015/MARMOTTA-584
>
>>
> Cheers,
>
> --
> Sergio Fernández
> Partner Technology Manager
> Redlink GmbH
> m: +43 6602747925
> e: sergio.fernandez@redlink.co
> w: http://redlink.co
>



-- 
Sergio Fernández
Partner Technology Manager
Redlink GmbH
m: +43 6602747925
e: sergio.fernandez@redlink.co
w: http://redlink.co

Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by Sergio Fernández <wi...@apache.org>.
Hi Francisco,

On Fri, Jun 26, 2015 at 5:39 AM, FRANCISCO XAVIER SUMBA TORAL <
xavier.sumba93@ucuenca.ec> wrote:
>
> > OK, perfect. Please let me know if you'd need further advise. Maybe we
> can
> > arrange a call via skype/hangout next week?
>
> For sure, Could you on Monday at 11:00 AM Pacific Standard Time (GMT
> -05:00)?


That should also work me. I've just send you the appointment. Let's do it
via hangout, so we can share the screen if necessary.

> Great! It. d be great to have a table summarizing all GeoSPARQL functions,
> > what's currently supported native, what's currently supported in-memory,
> > etc.
> >
> > Did you already get access to our wiki?
> >
>
> Yes, I got access to the wiki.
>

Perfect. Then just add subpages per topics under
https://wiki.apache.org/marmotta/GSoC/2015/MARMOTTA-584

>
Cheers,

-- 
Sergio Fernández
Partner Technology Manager
Redlink GmbH
m: +43 6602747925
e: sergio.fernandez@redlink.co
w: http://redlink.co

Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by FRANCISCO XAVIER SUMBA TORAL <xa...@ucuenca.ec>.
Hi Sergio,

> OK, perfect. Please let me know if you'd need further advise. Maybe we can
> arrange a call via skype/hangout next week?

For sure, Could you on Monday at 11:00 AM Pacific Standard Time (GMT -05:00)? 


> Great! It. d be great to have a table summarizing all GeoSPARQL functions,
> what's currently supported native, what's currently supported in-memory,
> etc.
> 
> Did you already get access to our wiki?
> 

Yes, I got access to the wiki.

Cheers,
Xavier.

Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by Sergio Fernández <wi...@apache.org>.
Hi,

On Thu, Jun 25, 2015 at 8:24 AM, FRANCISCO XAVIER SUMBA TORAL <
xavier.sumba93@ucuenca.ec> wrote:
>
> I am still working in that issue. If there is any progress or question for
> that mistake I will inform you immediately.
>

OK, perfect. Please let me know if you'd need further advise. Maybe we can
arrange a call via skype/hangout next week?

>
> I have committed another function of GeoSPARQL in GitHub and It’ll be
> great to improve our communication. Reports will be great. On the other
> hand, I will start writing in the wiki documentation this week.
>

Great! It. d be great to have a table summarizing all GeoSPARQL functions,
what's currently supported native, what's currently supported in-memory,
etc.

Did you already get access to our wiki?

Yes, I will try to do some advances this week to send to the mid-term
> evaluation and I have already read the questions for the evaluation.


Perfect. Thanks.

Cheers,

-- 
Sergio Fernández
Partner Technology Manager
Redlink GmbH
m: +43 6602747925
e: sergio.fernandez@redlink.co
w: http://redlink.co

Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by FRANCISCO XAVIER SUMBA TORAL <xa...@ucuenca.ec>.
Hi Sergio,

> any progress on this issue?

I am still working in that issue. If there is any progress or question for that mistake I will inform you immediately.

> 
> Since I do not see that much activity in the code level, honestly I'd
> prefer a more fluent communication here. Maybe weekly reports on your
> progress would work to keep us aligned with the working plan.
> 

I have committed another function of GeoSPARQL in GitHub and It’ll be great to improve our communication. Reports will be great. On the other hand, I will start writing in the wiki documentation this week.

> In addition, according the program timeline we're approaching the
> mid-term evaluation. So please, take it into account.

Yes, I will try to do some advances this week to send to the mid-term evaluation and I have already read the questions for the evaluation.

Cheers, 
Xavier.




Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by Sergio Fernández <wi...@apache.org>.
Hi Francisco,

any progress on this issue?

Since I do not see that much activity in the code level [1], honestly I'd
prefer a more fluent communication here. Maybe weekly reports on your
progress would work to keep us aligned with the working plan.

In addition, according the program timeline [2] we're approaching the
mid-term evaluation. So please, take it into account.

Cheers,

[1] https://github.com/cuent/marmotta/commits/MARMOTTA-584
[2] https://www.google-melange.com/gsoc/events/google/gsoc2015


On Fri, Jun 19, 2015 at 8:16 AM, Sergio Fernández <wi...@apache.org> wrote:

> Hi Xavier,
>
> On Fri, Jun 19, 2015 at 4:23 AM, FRANCISCO XAVIER SUMBA TORAL <
> xavier.sumba93@ucuenca.ec> wrote:
>>
>> > It'd be great if you could point us the fork at github. Then I can
>> closely
>> > follow the development, checking the commits, giving feedback on the
>> > patches, etc.
>>
>> I’ve created a new branch from develop and I add you as a contributor
>> [1]. There is 10 functions implemented.
>
>
> Perfect, thanks. I've just pointed it from our wiki. The ongoing patch
> could be found at
> https://github.com/apache/marmotta/compare/develop...cuent:MARMOTTA-584
> I'll try to follow the development from there.
>
> BTW, where are you writing the documentation we discussed earlier in the
> project? As I said, I'd prefer our wiki; although markdown in your code
> would be better than loosing such knowledge.
>
>
>> My account of GitHub is from another email of Hotmail, is that a problem?
>
>
> Not really.
>
> >> I worked with the implementation of NativeFunction. But here appeared a
>> >> new problem. Some of the RDF files with  GeoSPARQL model, not loaded to
>> >> marmotta.
>> >>
>> >> ERROR: "Caused by: org.postgresql.util.PSQLException: ERROR: The
>> string is
>> >> too larg
>> >> to to tsvector (1177006 bytes, máximo 1048575 bytes) "
>> >>
>> >> As I can solve this problem?.
>> >>
>> >> Some geometries (Multipolygons, MultiLineString) have large WKT
>> >
>> > Looks that module has some limitations, but I can only found old
>> references
>> > related with the issue, such as:
>> >
>> > http://requesttracker.wikia.com/wiki/PostgreSQLFullText
>> >
>> http://www.postgresql.org/message-id/BANLkTikWX0dTrU0zAdK=0Oi_kUxr7=f6Zg@mail.gmail.com
>> >
>> > What version of PostgreSQL are you using?
>>
>> I keep having the same issue. I’m using the version 9.4,
>>
>
>  Then it's a serious issue. I found the current limitations at:
>
> http://www.postgresql.org/docs/9.4/static/textsearch-limitations.html
>
> Going into more detail, a text search vector is an array of distinct
> lexemes (less any stopwords) and their positions. It looks like the
> tsvector data consumes 2x the space required by the input text, but I think
> it actually depends on your concrete configuration and input data.
>
> Why do we need to store the geometries in a vector? I guess we're not
> gonna perform full-text search over them, right? Therefore we may need to
> change how those concrete literals are stored in KiWi.
>
> Good progress! Please, continue working and discussing here.
>
> Cheers,
>
> --
> Sergio Fernández
> Partner Technology Manager
> Redlink GmbH
> m: +43 6602747925
> e: sergio.fernandez@redlink.co
> w: http://redlink.co
>



-- 
Sergio Fernández
Partner Technology Manager
Redlink GmbH
m: +43 6602747925
e: sergio.fernandez@redlink.co
w: http://redlink.co

Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by Sergio Fernández <wi...@apache.org>.
Hi Xavier,

On Fri, Jun 19, 2015 at 4:23 AM, FRANCISCO XAVIER SUMBA TORAL <
xavier.sumba93@ucuenca.ec> wrote:
>
> > It'd be great if you could point us the fork at github. Then I can
> closely
> > follow the development, checking the commits, giving feedback on the
> > patches, etc.
>
> I’ve created a new branch from develop and I add you as a contributor [1].
> There is 10 functions implemented.


Perfect, thanks. I've just pointed it from our wiki. The ongoing patch
could be found at
https://github.com/apache/marmotta/compare/develop...cuent:MARMOTTA-584
I'll try to follow the development from there.

BTW, where are you writing the documentation we discussed earlier in the
project? As I said, I'd prefer our wiki; although markdown in your code
would be better than loosing such knowledge.


> My account of GitHub is from another email of Hotmail, is that a problem?


Not really.

>> I worked with the implementation of NativeFunction. But here appeared a
> >> new problem. Some of the RDF files with  GeoSPARQL model, not loaded to
> >> marmotta.
> >>
> >> ERROR: "Caused by: org.postgresql.util.PSQLException: ERROR: The string
> is
> >> too larg
> >> to to tsvector (1177006 bytes, máximo 1048575 bytes) "
> >>
> >> As I can solve this problem?.
> >>
> >> Some geometries (Multipolygons, MultiLineString) have large WKT
> >
> > Looks that module has some limitations, but I can only found old
> references
> > related with the issue, such as:
> >
> > http://requesttracker.wikia.com/wiki/PostgreSQLFullText
> >
> http://www.postgresql.org/message-id/BANLkTikWX0dTrU0zAdK=0Oi_kUxr7=f6Zg@mail.gmail.com
> >
> > What version of PostgreSQL are you using?
>
> I keep having the same issue. I’m using the version 9.4,
>

 Then it's a serious issue. I found the current limitations at:

http://www.postgresql.org/docs/9.4/static/textsearch-limitations.html

Going into more detail, a text search vector is an array of distinct
lexemes (less any stopwords) and their positions. It looks like the
tsvector data consumes 2x the space required by the input text, but I think
it actually depends on your concrete configuration and input data.

Why do we need to store the geometries in a vector? I guess we're not gonna
perform full-text search over them, right? Therefore we may need to change
how those concrete literals are stored in KiWi.

Good progress! Please, continue working and discussing here.

Cheers,

-- 
Sergio Fernández
Partner Technology Manager
Redlink GmbH
m: +43 6602747925
e: sergio.fernandez@redlink.co
w: http://redlink.co

Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by FRANCISCO XAVIER SUMBA TORAL <xa...@ucuenca.ec>.
Hi Sergio,

>> 
>> I have some news.
>> 
>> So far I have managed the implementation of 8 Boolean functions (RCC8) and
>> also I have the implementation of one function "Non-Topologycal" (Buffer).
>> Queries work well on PostGIS.
> 
> 
> That are great news about the progress of the project!
> 
> It'd be great if you could point us the fork at github. Then I can closely
> follow the development, checking the commits, giving feedback on the
> patches, etc.
> 

I’ve created a new branch from develop and I add you as a contributor [1]. There is 10 functions implemented. My account of GitHub is from another email of Hotmail, is that a problem?


> 
>> I worked with the implementation of NativeFunction. But here appeared a
>> new problem. Some of the RDF files with  GeoSPARQL model, not loaded to
>> marmotta.
>> 
>> ERROR: "Caused by: org.postgresql.util.PSQLException: ERROR: The string is
>> too larg
>> to to tsvector (1177006 bytes, máximo 1048575 bytes) "
>> 
>> As I can solve this problem?.
>> 
>> Some geometries (Multipolygons, MultiLineString) have large WKT
>> 
> 
> Looks that module has some limitations, but I can only found old references
> related with the issue, such as:
> 
> http://requesttracker.wikia.com/wiki/PostgreSQLFullText
> http://www.postgresql.org/message-id/BANLkTikWX0dTrU0zAdK=0Oi_kUxr7=f6Zg@mail.gmail.com
> 
> What version of PostgreSQL are you using?
> 

I keep having the same issue. I’m using the version 9.4, 

Cheers, 
Xavier

[1] https://github.com/cuent/marmotta/tree/MARMOTTA-584 <https://github.com/cuent/marmotta/tree/MARMOTTA-584>



Re: [jira] [Commented] (MARMOTTA-584) Add GeoSPARQL support to KiWi triple store‏‏

Posted by Sergio Fernández <wi...@apache.org>.
Hi Francisco,

On Mon, Jun 15, 2015 at 11:45 PM, FRANCISCO XAVIER SUMBA TORAL <
xavier.sumba93@ucuenca.ec> wrote:
>
> I have some news.
>
> So far I have managed the implementation of 8 Boolean functions (RCC8) and
> also I have the implementation of one function "Non-Topologycal" (Buffer).
> Queries work well on PostGIS.


That are great news about the progress of the project!

It'd be great if you could point us the fork at github. Then I can closely
follow the development, checking the commits, giving feedback on the
patches, etc.


> I worked with the implementation of NativeFunction. But here appeared a
> new problem. Some of the RDF files with  GeoSPARQL model, not loaded to
> marmotta.
>
> ERROR: "Caused by: org.postgresql.util.PSQLException: ERROR: The string is
> too larg
> to to tsvector (1177006 bytes, máximo 1048575 bytes) "
>
> As I can solve this problem?.
>
> Some geometries (Multipolygons, MultiLineString) have large WKT
>

Looks that module has some limitations, but I can only found old references
related with the issue, such as:

http://requesttracker.wikia.com/wiki/PostgreSQLFullText
http://www.postgresql.org/message-id/BANLkTikWX0dTrU0zAdK=0Oi_kUxr7=f6Zg@mail.gmail.com

What version of PostgreSQL are you using?


> By now it was not necessary to alter the database except for one comand to
> activate postgis "CREATE EXTENSION postgis"
>

That's great for backwards compatibility. Something to ways take into
account for making easier the transition to the new version when this
feature will be included.


> On the other hand, I’d like to commit my changes. Is there any structure
> to create the new branch?.
>

Yes, please, follow the methodology described at
http://wiki.apache.org/marmotta/GSoC/Methodology

Cheers,

-- 
Sergio Fernández
Partner Technology Manager
Redlink GmbH
m: +43 6602747925
e: sergio.fernandez@redlink.co
w: http://redlink.co