You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gora.apache.org by "raf shin (Created) (JIRA)" <ji...@apache.org> on 2012/04/14 16:59:16 UTC
[jira] [Created] (GORA-119) implement a filter enabled scan in gora
implement a filter enabled scan in gora
---------------------------------------
Key: GORA-119
URL: https://issues.apache.org/jira/browse/GORA-119
Project: Apache Gora
Issue Type: Improvement
Environment: gora hbase gora-core gora-hbase
Reporter: raf shin
it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Lewis John McGibbney (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254311#comment-13254311 ]
Lewis John McGibbney commented on GORA-119:
-------------------------------------------
Hi Raf. Do you have a patch for trunk? Or a suggestion of how this issue should be addressed? Thanks
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GORA-119) implement a filter enabled scan in gora
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ferdy Galema updated GORA-119:
------------------------------
Attachment: GORA-119-v1.txt
I went ahead and made a proposal implementation for C.
It currently consists of a single filter, SingleFieldValueFilter. It is able to include or exclude a row based on value of a single field. Tests are included. It will work for every store, because it filters client-side. Additionally, the HBaseStore sets the filter regionserver-side for efficiency. Of course the GoraFilter has been designed with the HBase filter in mind, more or less.
This is just a start. There is still a lot of work to do, such as adding more filters (for example RowKeyFilter, ColumnPrefixFilter, FilterList etcetera) and more compare operations.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (GORA-119) implement a filter enabled scan
in gora
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444760#comment-13444760 ]
Ferdy Galema edited comment on GORA-119 at 8/30/12 6:35 PM:
------------------------------------------------------------
Hi Renato,
Unfortunately it is not yet in trunk. I think it is best to go with Keith's suggestion to introduce a new maven project for the filter implementations. If anyone wants to pick this up, feel free to do so.
was (Author: ferdy.g):
Hi Renato,
Unfortunately it is not yet in trunk. I think it is best to go with Keith's suggestion to introduce a new maven project for the filter implementations. If anyone wants to pick this up, feel feel to do so.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262804#comment-13262804 ]
Ferdy Galema commented on GORA-119:
-----------------------------------
Yeah therefore it is very important to design the optimizer interfaces in the most defensive manner possible. For example
interface HBaseQueryOptimizer extends QueryOptimizer {
void optimize(Scan scan, HBaseStore);
}
vs
interface HBaseQueryOptimizer extends QueryOptimizer {
Filter getHBaseFilter(HBaseMapping mapping);
}
The first variant exposes both the Scan and HBaseStore objects to the filter. This arguably gives filters too much control. It could modify Scan in wrong way or call wrong HBaseStore methods so that nasty bugs may be introduced.
The latter simply asks the Optimizer to return the HBase filter. It provides one or two objects (HBaseMapping in this case) that are unharmful (immutable, copied or whatever) that can be used to build the filter. The filter has no way to modify crucial parts.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Keith Turner (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262792#comment-13262792 ]
Keith Turner commented on GORA-119:
-----------------------------------
I think there is one peril to the design I suggested, it exposes the internals of a datastore to users who write filters. Therefore it become part of the public API, possibly impacting the ability to make drastic changes to a datastore. If the optimizer interface only exposes stable hbase and accumulo APIs, then maybe this not an issue.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Keith Turner (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262834#comment-13262834 ]
Keith Turner commented on GORA-119:
-----------------------------------
I agree w/ what you said about being defensive. For the example design I just took what was passed to HBaseFilterUtil.setFilter() in your patch. What do you think about having a gora-filters maven project?
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444760#comment-13444760 ]
Ferdy Galema commented on GORA-119:
-----------------------------------
Hi Renato,
Unfortunately it is not yet in trunk. I think it is best to go with Keith's suggestion to introduce a new maven project for the filter implementations. If anyone wants to pick this up, feel feel to do so.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Keith Turner (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262692#comment-13262692 ]
Keith Turner commented on GORA-119:
-----------------------------------
I like option C. Accumulo could support this too, it has server side iterators which support arbitrary filtering.
I took a look at the patch, the strategy seems to be that the store has special case code where it checks the type of the filter and determines if it can optimize for it. So the stores that ship w/ gora may support the filters that ship with gora. However if a user writes their own filter, it will always be applied client side w/o any optimization. To address this maybe optimizations could for filters could be associated with the filter instead of the store. Then if a user writes a filter they could optionally write optimizations for the data stores they care about. Below is sketch of how this might be done.
interface GoraFilter {
public boolean filter(K key, T persistent);
public QueryOptimizer getOptimizer(DataStore ds);
}
interface QueryOptimizer {
}
interface HBaseQueryOptimizer extends QueryOptimizer {
void optimize(Scan scan, HBaseStore);
}
class SingleFieldValueFilter implements GoraFilter {
public boolean filter(K key, T persistent){
//generic implemetation for store w/o optimization
}
public QueryOptimizer getOptimizer(DataStore ds) {
if(ds instanceof HBaseStore){
return new HBaseQueryOptimizer(){...};
} else if(ds instanceof AccumuloStore){
return new AccumuloQueryOptimizer(){...};
}
return null;
}
}
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262757#comment-13262757 ]
Ferdy Galema commented on GORA-119:
-----------------------------------
Hey Keith,
I like your idea about QueryOptimizer! I was struggling a bit on my own about how to cleanly design the filter interface so that the optimization is coupled with the implementation of the filter itself. Your suggestion exactly does that! And indeed has the additional benefit of allowing users to implement optimizers for their own filters. Only thing is that when implementing a QueryOptimizer, a user might not want to be bothered with implementing the generic non-optimized variant. (Not that it matters much, they could leave it empty of course since it is a locally implemented filter). A slightly bigger issue is that the Gora-supplied filters have knowledge about stores. (Dependency inversion?). But then again we could simply leave the optimization empty so that is up to each store to implement optimizations for those filters.
About the list of filters, this can easily be implemented with a Gora-supplied filter that accepts a list with optional an operater (i.e. AND, OR).
Thanks.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GORA-119) implement a filter enabled scan in gora
Posted by "Lewis John McGibbney (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lewis John McGibbney updated GORA-119:
--------------------------------------
Affects Version/s: 0.2
Fix Version/s: 0.3
Set and classify
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Ferdy Galema (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256412#comment-13256412 ]
Ferdy Galema commented on GORA-119:
-----------------------------------
This would be very useful indeed. I can think of Nutchgora that uses it for skipping rows that do not match the (generate/fetch..) mark. There are a few ways to implement it:
A) The quick cheap workaround by passing filter options on Configuration so that the store instance will apply it to all queries. A way to only make it work for HBase. Easy to implement.
B) Make it a generic Query option, but make it optional. This allows for some stores to implement it, but it won't be necessary. Clients need to accept that filtering *might* be done, but still have to check every row in order to skip were necessary.
C) Like B, the generic option, but create a generic implementation that makes sure filtering is always applied, even for a Store does not explicitely implements it. This way it is still optional for a store to implement it (i.e. HBaseStore that applies regionside filtering) but when they don't, the generic implementation at the Gora client side will still skip the rows before they are passed to the application client.
I like to adopt for C.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262814#comment-13262814 ]
Ferdy Galema commented on GORA-119:
-----------------------------------
(Not to undermine your comments about it becoming part of the API, I agree that this is an important design consideration too).
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Keith Turner (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262785#comment-13262785 ]
Keith Turner commented on GORA-119:
-----------------------------------
For the dependency issue, one solution is putting filters in another top level maven project. Could have something like the following :
gora-core # contains the filter interfaces
gora-accumulo
gora-hbase
gora-filters #depends on core and stores like hbase and accumulo....
.
.
.
I like the filter of filters that supports AND, OR. It will be interesting trying to push this one to the servers side. I could develop an iterator for accumulo that does this. The list of filters would influence the design of the AccumuloOptimizer, because it would need info from the child filter optimizers.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262914#comment-13262914 ]
Ferdy Galema commented on GORA-119:
-----------------------------------
I think it's a good idea. It's possibly the only solution to the dependency issue. However I do like to give it a good night's rest.. perhaps there is an easier method. (Also I'm far from a Maven buff so any help with regard to getting this started would be greatly appreciated).
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Keith Turner (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262699#comment-13262699 ]
Keith Turner commented on GORA-119:
-----------------------------------
In Query, we may want to consider letting a user set a list of filters. Accumulo supports setting multiple server side iterators for a scan.
public void setFilters(Collection<GoraFilter<K, T>> filters);
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-119) implement a filter enabled scan in
gora
Posted by "Renato Javier Marroquín Mogrovejo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444211#comment-13444211 ]
Renato Javier Marroquín Mogrovejo commented on GORA-119:
--------------------------------------------------------
Did this ever made it to trunk? Are we planning to include this in Gora's API? The DynamoDB module is able to use filters in scan operations, and I have implemented them by creating two different types of queries (range queries and scan queries) and I build them depending on the parameters gotten through configurating the query. Yeah I now see this is not such an elegant solution, and I like the query optimizer idea much better.
> implement a filter enabled scan in gora
> ---------------------------------------
>
> Key: GORA-119
> URL: https://issues.apache.org/jira/browse/GORA-119
> Project: Apache Gora
> Issue Type: Improvement
> Affects Versions: 0.2
> Environment: gora hbase gora-core gora-hbase
> Reporter: raf shin
> Labels: filter, gora-core, gora-hbase, scan
> Fix For: 0.3
>
> Attachments: GORA-119-v1.txt
>
>
> it'll be very of help to implement a filtered scan to reduce the time of scan in gora-core and gora-hbase components.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira