You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jena.apache.org by anuj kumar <an...@gmail.com> on 2018/04/24 15:34:23 UTC
Extending ARQ to retrieve FILTER operations from Sparql Queries
I have another query, this time relating to ARQ and how I can extend it.
*Background*
I am using HBase as the underlying Data Store for Triples (by implementing
various Jena Extension points).
So far so good.
But now I have certain SPARQL queries that have FILTER operations defined.
With a huge data set, that I have, its taking a lot of time to FILTER the
data out.
So, I want to extract the FILTER portion of the Query out and simply want
to pass it as a HBase Filter to the HBase client so that filtering can
happen at RegionServer level itself.
This question is very similar to the question here
<https://stackoverflow.com/questions/48648677/apache-jena-arq-filter-optimization?rq=1>
on
stackoverflow.
I have been reading about ARQ and OpExecutor and believe that it may be
what I need but I cant seem to find a simple example on which I can build
up.
Can someone help me with getting to understand how I can parse the incoming
query to REMOVE the FILTER clause from it and instead take the filter
statement and evaluate it.
Thanks,
--
*Anuj Kumar*
Re: Extending ARQ to retrieve FILTER operations from Sparql Queries
Posted by anuj kumar <an...@gmail.com>.
Thanks Rob for the pointers. I will start digging now.
On Tue, Apr 24, 2018 at 5:57 PM, Rob Vesse <rv...@dotnetrdf.org> wrote:
> Looking at the code for how TDB does this might be useful:
>
> https://github.com/apache/jena/blob/master/jena-tdb/src/
> main/java/org/apache/jena/tdb/solver/OpExecutorTDB1.java
>
> Rob
>
> On 24/04/2018, 16:54, "Rob Vesse" <rv...@dotnetrdf.org> wrote:
>
> The point is to not modify the parsing but the execution
>
> By substituting a different OpExecutor implementation you can provide
> a custom executeOp() implementation that recognizes when an OpFilter
> operator is seen and acts accordingly
>
> Rob
>
> On 24/04/2018, 16:34, "anuj kumar" <an...@gmail.com> wrote:
>
> I have another query, this time relating to ARQ and how I can
> extend it.
> *Background*
>
> I am using HBase as the underlying Data Store for Triples (by
> implementing
> various Jena Extension points).
> So far so good.
> But now I have certain SPARQL queries that have FILTER operations
> defined.
> With a huge data set, that I have, its taking a lot of time to
> FILTER the
> data out.
>
> So, I want to extract the FILTER portion of the Query out and
> simply want
> to pass it as a HBase Filter to the HBase client so that filtering
> can
> happen at RegionServer level itself.
>
> This question is very similar to the question here
> <https://stackoverflow.com/questions/48648677/apache-
> jena-arq-filter-optimization?rq=1>
> on
> stackoverflow.
>
> I have been reading about ARQ and OpExecutor and believe that it
> may be
> what I need but I cant seem to find a simple example on which I
> can build
> up.
>
> Can someone help me with getting to understand how I can parse the
> incoming
> query to REMOVE the FILTER clause from it and instead take the
> filter
> statement and evaluate it.
>
> Thanks,
> --
> *Anuj Kumar*
>
>
>
>
>
>
>
>
>
>
>
--
*Anuj Kumar*
Re: Extending ARQ to retrieve FILTER operations from Sparql Queries
Posted by Rob Vesse <rv...@dotnetrdf.org>.
Looking at the code for how TDB does this might be useful:
https://github.com/apache/jena/blob/master/jena-tdb/src/main/java/org/apache/jena/tdb/solver/OpExecutorTDB1.java
Rob
On 24/04/2018, 16:54, "Rob Vesse" <rv...@dotnetrdf.org> wrote:
The point is to not modify the parsing but the execution
By substituting a different OpExecutor implementation you can provide a custom executeOp() implementation that recognizes when an OpFilter operator is seen and acts accordingly
Rob
On 24/04/2018, 16:34, "anuj kumar" <an...@gmail.com> wrote:
I have another query, this time relating to ARQ and how I can extend it.
*Background*
I am using HBase as the underlying Data Store for Triples (by implementing
various Jena Extension points).
So far so good.
But now I have certain SPARQL queries that have FILTER operations defined.
With a huge data set, that I have, its taking a lot of time to FILTER the
data out.
So, I want to extract the FILTER portion of the Query out and simply want
to pass it as a HBase Filter to the HBase client so that filtering can
happen at RegionServer level itself.
This question is very similar to the question here
<https://stackoverflow.com/questions/48648677/apache-jena-arq-filter-optimization?rq=1>
on
stackoverflow.
I have been reading about ARQ and OpExecutor and believe that it may be
what I need but I cant seem to find a simple example on which I can build
up.
Can someone help me with getting to understand how I can parse the incoming
query to REMOVE the FILTER clause from it and instead take the filter
statement and evaluate it.
Thanks,
--
*Anuj Kumar*
Re: Extending ARQ to retrieve FILTER operations from Sparql Queries
Posted by Rob Vesse <rv...@dotnetrdf.org>.
The point is to not modify the parsing but the execution
By substituting a different OpExecutor implementation you can provide a custom executeOp() implementation that recognizes when an OpFilter operator is seen and acts accordingly
Rob
On 24/04/2018, 16:34, "anuj kumar" <an...@gmail.com> wrote:
I have another query, this time relating to ARQ and how I can extend it.
*Background*
I am using HBase as the underlying Data Store for Triples (by implementing
various Jena Extension points).
So far so good.
But now I have certain SPARQL queries that have FILTER operations defined.
With a huge data set, that I have, its taking a lot of time to FILTER the
data out.
So, I want to extract the FILTER portion of the Query out and simply want
to pass it as a HBase Filter to the HBase client so that filtering can
happen at RegionServer level itself.
This question is very similar to the question here
<https://stackoverflow.com/questions/48648677/apache-jena-arq-filter-optimization?rq=1>
on
stackoverflow.
I have been reading about ARQ and OpExecutor and believe that it may be
what I need but I cant seem to find a simple example on which I can build
up.
Can someone help me with getting to understand how I can parse the incoming
query to REMOVE the FILTER clause from it and instead take the filter
statement and evaluate it.
Thanks,
--
*Anuj Kumar*