You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Nishanth S <ni...@gmail.com> on 2014/09/11 19:37:03 UTC
Custom Filter on hbase Column
Hi All,
I have an hbase table with multiple cfs (say c1,c2,c3).Each of this column
family has a column 'message' which is about 5K.What I need to do is to
grab only the first 1000 Characters of this message when I do a get on the
table using row Key.I was thinking of using filters to do this on hbase
sever side.Can some one help me on how to go about this.
Thanks,
Nishan
Re: Custom Filter on hbase Column
Posted by Ted Yu <yu...@gmail.com>.
Take a look at StoreScanner#next():
ScanQueryMatcher.MatchCode qcode = matcher.match(kv);
switch(qcode) {
case INCLUDE:
case INCLUDE_AND_SEEK_NEXT_ROW:
case INCLUDE_AND_SEEK_NEXT_COL:
Filter f = matcher.getFilter();
if (f != null) {
// TODO convert Scan Query Matcher to be Cell instead of KV
based ?
kv = KeyValueUtil.ensureKeyValue(f.transformCell(kv));
}
Cheers
On Mon, Sep 15, 2014 at 8:27 AM, Nishanth S <ni...@gmail.com> wrote:
> Thanks Anoop.I did that but the only method that was getting called in my
> filter was public byte[] toByteArray() ,even though I over ride
> transformcell.
>
>
> Thanks,
> Nishanth
>
> On Thu, Sep 11, 2014 at 10:51 PM, Anoop John <an...@gmail.com>
> wrote:
>
> > And u have to implement
> > transformCell(*final* Cell v)
> > in your custom Filter.
> >
> > JFYI
> >
> > -Anoop-
> >
> > On Fri, Sep 12, 2014 at 4:36 AM, Nishanth S <ni...@gmail.com>
> > wrote:
> >
> > > Sure Sean.This is much needed.
> > >
> > > -Nishan
> > >
> > > On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey <bu...@cloudera.com>
> > wrote:
> > >
> > > > I filed HBASE-11950 to get some details added to the book on this
> > > topic[1].
> > > >
> > > > Nishanth, could you follow that ticket and give feedback on whatever
> > > update
> > > > ends up proposed?
> > > >
> > > > [1]: https://issues.apache.org/jira/browse/HBASE-11950
> > > >
> > > > On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu <yu...@gmail.com> wrote:
> > > >
> > > > > See http://search-hadoop.com/m/DHED4xWh622
> > > > >
> > > > > On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S <
> nishanth.2884@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > > Hey All,
> > > > > >
> > > > > > I am sorry if this is a naive question.Do we need to generate a
> > proto
> > > > > file
> > > > > > using proto buffer compiler when implementing a filter.I did not
> > see
> > > > that
> > > > > > any where in the documentation.Can some one help please?
> > > > > >
> > > > > > On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <
> > > nishanth.2884@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Thanks Dima and Ted.Yes I need to return the first the 1000
> > > > > > > characters.There is no matching involved.
> > > > > > >
> > > > > > > -Nishan
> > > > > > >
> > > > > > > On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com>
> > > > wrote:
> > > > > > >
> > > > > > >> In Nishanth's case, the 5K message is stored in one KeyValue,
> > > right
> > > > ?
> > > > > > >>
> > > > > > >> If only the first 1000 Characters of this message are to be
> > > > returned,
> > > > > > >> a new KeyValue
> > > > > > >> needs to be composed and returned.
> > > > > > >>
> > > > > > >> Cheers
> > > > > > >>
> > > > > > >> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <
> > > dspivak@cloudera.com
> > > > >
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > Hi Nishanth,
> > > > > > >> >
> > > > > > >> > Take a look at
> > http://hbase.apache.org/book/client.filter.html
> > > .
> > > > > If I
> > > > > > >> > understand your use case correctly, you might want to look
> at
> > > > > > >> > RegexStringComparator to match the first 1000 characters of
> > your
> > > > > > column
> > > > > > >> > qualifier.
> > > > > > >> >
> > > > > > >> > -Dima
> > > > > > >> >
> > > > > > >> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <
> > > > > nishanth.2884@gmail.com
> > > > > > >
> > > > > > >> > wrote:
> > > > > > >> >
> > > > > > >> > > Hi All,
> > > > > > >> > >
> > > > > > >> > > I have an hbase table with multiple cfs (say
> c1,c2,c3).Each
> > of
> > > > > this
> > > > > > >> > column
> > > > > > >> > > family has a column 'message' which is about 5K.What I
> need
> > > to
> > > > do
> > > > > > is
> > > > > > >> to
> > > > > > >> > > grab only the first 1000 Characters of this message when I
> > do
> > > a
> > > > > get
> > > > > > on
> > > > > > >> > the
> > > > > > >> > > table using row Key.I was thinking of using filters to do
> > > this
> > > > on
> > > > > > >> hbase
> > > > > > >> > > sever side.Can some one help me on how to go about this.
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > > Thanks,
> > > > > > >> > > Nishan
> > > > > > >> > >
> > > > > > >> >
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sean
> > > >
> > >
> >
>
Re: Custom Filter on hbase Column
Posted by Nishanth S <ni...@gmail.com>.
Thanks Anoop.I did that but the only method that was getting called in my
filter was public byte[] toByteArray() ,even though I over ride
transformcell.
Thanks,
Nishanth
On Thu, Sep 11, 2014 at 10:51 PM, Anoop John <an...@gmail.com> wrote:
> And u have to implement
> transformCell(*final* Cell v)
> in your custom Filter.
>
> JFYI
>
> -Anoop-
>
> On Fri, Sep 12, 2014 at 4:36 AM, Nishanth S <ni...@gmail.com>
> wrote:
>
> > Sure Sean.This is much needed.
> >
> > -Nishan
> >
> > On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey <bu...@cloudera.com>
> wrote:
> >
> > > I filed HBASE-11950 to get some details added to the book on this
> > topic[1].
> > >
> > > Nishanth, could you follow that ticket and give feedback on whatever
> > update
> > > ends up proposed?
> > >
> > > [1]: https://issues.apache.org/jira/browse/HBASE-11950
> > >
> > > On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > See http://search-hadoop.com/m/DHED4xWh622
> > > >
> > > > On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S <nishanth.2884@gmail.com
> >
> > > > wrote:
> > > >
> > > > > Hey All,
> > > > >
> > > > > I am sorry if this is a naive question.Do we need to generate a
> proto
> > > > file
> > > > > using proto buffer compiler when implementing a filter.I did not
> see
> > > that
> > > > > any where in the documentation.Can some one help please?
> > > > >
> > > > > On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <
> > nishanth.2884@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks Dima and Ted.Yes I need to return the first the 1000
> > > > > > characters.There is no matching involved.
> > > > > >
> > > > > > -Nishan
> > > > > >
> > > > > > On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com>
> > > wrote:
> > > > > >
> > > > > >> In Nishanth's case, the 5K message is stored in one KeyValue,
> > right
> > > ?
> > > > > >>
> > > > > >> If only the first 1000 Characters of this message are to be
> > > returned,
> > > > > >> a new KeyValue
> > > > > >> needs to be composed and returned.
> > > > > >>
> > > > > >> Cheers
> > > > > >>
> > > > > >> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <
> > dspivak@cloudera.com
> > > >
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Hi Nishanth,
> > > > > >> >
> > > > > >> > Take a look at
> http://hbase.apache.org/book/client.filter.html
> > .
> > > > If I
> > > > > >> > understand your use case correctly, you might want to look at
> > > > > >> > RegexStringComparator to match the first 1000 characters of
> your
> > > > > column
> > > > > >> > qualifier.
> > > > > >> >
> > > > > >> > -Dima
> > > > > >> >
> > > > > >> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <
> > > > nishanth.2884@gmail.com
> > > > > >
> > > > > >> > wrote:
> > > > > >> >
> > > > > >> > > Hi All,
> > > > > >> > >
> > > > > >> > > I have an hbase table with multiple cfs (say c1,c2,c3).Each
> of
> > > > this
> > > > > >> > column
> > > > > >> > > family has a column 'message' which is about 5K.What I need
> > to
> > > do
> > > > > is
> > > > > >> to
> > > > > >> > > grab only the first 1000 Characters of this message when I
> do
> > a
> > > > get
> > > > > on
> > > > > >> > the
> > > > > >> > > table using row Key.I was thinking of using filters to do
> > this
> > > on
> > > > > >> hbase
> > > > > >> > > sever side.Can some one help me on how to go about this.
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > Thanks,
> > > > > >> > > Nishan
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Sean
> > >
> >
>
Re: Custom Filter on hbase Column
Posted by Anoop John <an...@gmail.com>.
And u have to implement
transformCell(*final* Cell v)
in your custom Filter.
JFYI
-Anoop-
On Fri, Sep 12, 2014 at 4:36 AM, Nishanth S <ni...@gmail.com> wrote:
> Sure Sean.This is much needed.
>
> -Nishan
>
> On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey <bu...@cloudera.com> wrote:
>
> > I filed HBASE-11950 to get some details added to the book on this
> topic[1].
> >
> > Nishanth, could you follow that ticket and give feedback on whatever
> update
> > ends up proposed?
> >
> > [1]: https://issues.apache.org/jira/browse/HBASE-11950
> >
> > On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > See http://search-hadoop.com/m/DHED4xWh622
> > >
> > > On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S <ni...@gmail.com>
> > > wrote:
> > >
> > > > Hey All,
> > > >
> > > > I am sorry if this is a naive question.Do we need to generate a proto
> > > file
> > > > using proto buffer compiler when implementing a filter.I did not see
> > that
> > > > any where in the documentation.Can some one help please?
> > > >
> > > > On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <
> nishanth.2884@gmail.com>
> > > > wrote:
> > > >
> > > > > Thanks Dima and Ted.Yes I need to return the first the 1000
> > > > > characters.There is no matching involved.
> > > > >
> > > > > -Nishan
> > > > >
> > > > > On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com>
> > wrote:
> > > > >
> > > > >> In Nishanth's case, the 5K message is stored in one KeyValue,
> right
> > ?
> > > > >>
> > > > >> If only the first 1000 Characters of this message are to be
> > returned,
> > > > >> a new KeyValue
> > > > >> needs to be composed and returned.
> > > > >>
> > > > >> Cheers
> > > > >>
> > > > >> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <
> dspivak@cloudera.com
> > >
> > > > >> wrote:
> > > > >>
> > > > >> > Hi Nishanth,
> > > > >> >
> > > > >> > Take a look at http://hbase.apache.org/book/client.filter.html
> .
> > > If I
> > > > >> > understand your use case correctly, you might want to look at
> > > > >> > RegexStringComparator to match the first 1000 characters of your
> > > > column
> > > > >> > qualifier.
> > > > >> >
> > > > >> > -Dima
> > > > >> >
> > > > >> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <
> > > nishanth.2884@gmail.com
> > > > >
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Hi All,
> > > > >> > >
> > > > >> > > I have an hbase table with multiple cfs (say c1,c2,c3).Each of
> > > this
> > > > >> > column
> > > > >> > > family has a column 'message' which is about 5K.What I need
> to
> > do
> > > > is
> > > > >> to
> > > > >> > > grab only the first 1000 Characters of this message when I do
> a
> > > get
> > > > on
> > > > >> > the
> > > > >> > > table using row Key.I was thinking of using filters to do
> this
> > on
> > > > >> hbase
> > > > >> > > sever side.Can some one help me on how to go about this.
> > > > >> > >
> > > > >> > >
> > > > >> > > Thanks,
> > > > >> > > Nishan
> > > > >> > >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > Sean
> >
>
Re: Custom Filter on hbase Column
Posted by Nishanth S <ni...@gmail.com>.
Sure Sean.This is much needed.
-Nishan
On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey <bu...@cloudera.com> wrote:
> I filed HBASE-11950 to get some details added to the book on this topic[1].
>
> Nishanth, could you follow that ticket and give feedback on whatever update
> ends up proposed?
>
> [1]: https://issues.apache.org/jira/browse/HBASE-11950
>
> On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu <yu...@gmail.com> wrote:
>
> > See http://search-hadoop.com/m/DHED4xWh622
> >
> > On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S <ni...@gmail.com>
> > wrote:
> >
> > > Hey All,
> > >
> > > I am sorry if this is a naive question.Do we need to generate a proto
> > file
> > > using proto buffer compiler when implementing a filter.I did not see
> that
> > > any where in the documentation.Can some one help please?
> > >
> > > On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <ni...@gmail.com>
> > > wrote:
> > >
> > > > Thanks Dima and Ted.Yes I need to return the first the 1000
> > > > characters.There is no matching involved.
> > > >
> > > > -Nishan
> > > >
> > > > On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com>
> wrote:
> > > >
> > > >> In Nishanth's case, the 5K message is stored in one KeyValue, right
> ?
> > > >>
> > > >> If only the first 1000 Characters of this message are to be
> returned,
> > > >> a new KeyValue
> > > >> needs to be composed and returned.
> > > >>
> > > >> Cheers
> > > >>
> > > >> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <dspivak@cloudera.com
> >
> > > >> wrote:
> > > >>
> > > >> > Hi Nishanth,
> > > >> >
> > > >> > Take a look at http://hbase.apache.org/book/client.filter.html .
> > If I
> > > >> > understand your use case correctly, you might want to look at
> > > >> > RegexStringComparator to match the first 1000 characters of your
> > > column
> > > >> > qualifier.
> > > >> >
> > > >> > -Dima
> > > >> >
> > > >> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <
> > nishanth.2884@gmail.com
> > > >
> > > >> > wrote:
> > > >> >
> > > >> > > Hi All,
> > > >> > >
> > > >> > > I have an hbase table with multiple cfs (say c1,c2,c3).Each of
> > this
> > > >> > column
> > > >> > > family has a column 'message' which is about 5K.What I need to
> do
> > > is
> > > >> to
> > > >> > > grab only the first 1000 Characters of this message when I do a
> > get
> > > on
> > > >> > the
> > > >> > > table using row Key.I was thinking of using filters to do this
> on
> > > >> hbase
> > > >> > > sever side.Can some one help me on how to go about this.
> > > >> > >
> > > >> > >
> > > >> > > Thanks,
> > > >> > > Nishan
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
>
>
> --
> Sean
>
Re: Custom Filter on hbase Column
Posted by Sean Busbey <bu...@cloudera.com>.
I filed HBASE-11950 to get some details added to the book on this topic[1].
Nishanth, could you follow that ticket and give feedback on whatever update
ends up proposed?
[1]: https://issues.apache.org/jira/browse/HBASE-11950
On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu <yu...@gmail.com> wrote:
> See http://search-hadoop.com/m/DHED4xWh622
>
> On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S <ni...@gmail.com>
> wrote:
>
> > Hey All,
> >
> > I am sorry if this is a naive question.Do we need to generate a proto
> file
> > using proto buffer compiler when implementing a filter.I did not see that
> > any where in the documentation.Can some one help please?
> >
> > On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <ni...@gmail.com>
> > wrote:
> >
> > > Thanks Dima and Ted.Yes I need to return the first the 1000
> > > characters.There is no matching involved.
> > >
> > > -Nishan
> > >
> > > On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > >> In Nishanth's case, the 5K message is stored in one KeyValue, right ?
> > >>
> > >> If only the first 1000 Characters of this message are to be returned,
> > >> a new KeyValue
> > >> needs to be composed and returned.
> > >>
> > >> Cheers
> > >>
> > >> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <ds...@cloudera.com>
> > >> wrote:
> > >>
> > >> > Hi Nishanth,
> > >> >
> > >> > Take a look at http://hbase.apache.org/book/client.filter.html .
> If I
> > >> > understand your use case correctly, you might want to look at
> > >> > RegexStringComparator to match the first 1000 characters of your
> > column
> > >> > qualifier.
> > >> >
> > >> > -Dima
> > >> >
> > >> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <
> nishanth.2884@gmail.com
> > >
> > >> > wrote:
> > >> >
> > >> > > Hi All,
> > >> > >
> > >> > > I have an hbase table with multiple cfs (say c1,c2,c3).Each of
> this
> > >> > column
> > >> > > family has a column 'message' which is about 5K.What I need to do
> > is
> > >> to
> > >> > > grab only the first 1000 Characters of this message when I do a
> get
> > on
> > >> > the
> > >> > > table using row Key.I was thinking of using filters to do this on
> > >> hbase
> > >> > > sever side.Can some one help me on how to go about this.
> > >> > >
> > >> > >
> > >> > > Thanks,
> > >> > > Nishan
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
--
Sean
Re: Custom Filter on hbase Column
Posted by Ted Yu <yu...@gmail.com>.
See http://search-hadoop.com/m/DHED4xWh622
On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S <ni...@gmail.com> wrote:
> Hey All,
>
> I am sorry if this is a naive question.Do we need to generate a proto file
> using proto buffer compiler when implementing a filter.I did not see that
> any where in the documentation.Can some one help please?
>
> On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <ni...@gmail.com>
> wrote:
>
> > Thanks Dima and Ted.Yes I need to return the first the 1000
> > characters.There is no matching involved.
> >
> > -Nishan
> >
> > On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com> wrote:
> >
> >> In Nishanth's case, the 5K message is stored in one KeyValue, right ?
> >>
> >> If only the first 1000 Characters of this message are to be returned,
> >> a new KeyValue
> >> needs to be composed and returned.
> >>
> >> Cheers
> >>
> >> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <ds...@cloudera.com>
> >> wrote:
> >>
> >> > Hi Nishanth,
> >> >
> >> > Take a look at http://hbase.apache.org/book/client.filter.html . If I
> >> > understand your use case correctly, you might want to look at
> >> > RegexStringComparator to match the first 1000 characters of your
> column
> >> > qualifier.
> >> >
> >> > -Dima
> >> >
> >> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <nishanth.2884@gmail.com
> >
> >> > wrote:
> >> >
> >> > > Hi All,
> >> > >
> >> > > I have an hbase table with multiple cfs (say c1,c2,c3).Each of this
> >> > column
> >> > > family has a column 'message' which is about 5K.What I need to do
> is
> >> to
> >> > > grab only the first 1000 Characters of this message when I do a get
> on
> >> > the
> >> > > table using row Key.I was thinking of using filters to do this on
> >> hbase
> >> > > sever side.Can some one help me on how to go about this.
> >> > >
> >> > >
> >> > > Thanks,
> >> > > Nishan
> >> > >
> >> >
> >>
> >
> >
>
Re: Custom Filter on hbase Column
Posted by Nishanth S <ni...@gmail.com>.
Hey All,
I am sorry if this is a naive question.Do we need to generate a proto file
using proto buffer compiler when implementing a filter.I did not see that
any where in the documentation.Can some one help please?
On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <ni...@gmail.com>
wrote:
> Thanks Dima and Ted.Yes I need to return the first the 1000
> characters.There is no matching involved.
>
> -Nishan
>
> On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com> wrote:
>
>> In Nishanth's case, the 5K message is stored in one KeyValue, right ?
>>
>> If only the first 1000 Characters of this message are to be returned,
>> a new KeyValue
>> needs to be composed and returned.
>>
>> Cheers
>>
>> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <ds...@cloudera.com>
>> wrote:
>>
>> > Hi Nishanth,
>> >
>> > Take a look at http://hbase.apache.org/book/client.filter.html . If I
>> > understand your use case correctly, you might want to look at
>> > RegexStringComparator to match the first 1000 characters of your column
>> > qualifier.
>> >
>> > -Dima
>> >
>> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <ni...@gmail.com>
>> > wrote:
>> >
>> > > Hi All,
>> > >
>> > > I have an hbase table with multiple cfs (say c1,c2,c3).Each of this
>> > column
>> > > family has a column 'message' which is about 5K.What I need to do is
>> to
>> > > grab only the first 1000 Characters of this message when I do a get on
>> > the
>> > > table using row Key.I was thinking of using filters to do this on
>> hbase
>> > > sever side.Can some one help me on how to go about this.
>> > >
>> > >
>> > > Thanks,
>> > > Nishan
>> > >
>> >
>>
>
>
Re: Custom Filter on hbase Column
Posted by Nishanth S <ni...@gmail.com>.
Thanks Dima and Ted.Yes I need to return the first the 1000
characters.There is no matching involved.
-Nishan
On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yu...@gmail.com> wrote:
> In Nishanth's case, the 5K message is stored in one KeyValue, right ?
>
> If only the first 1000 Characters of this message are to be returned,
> a new KeyValue
> needs to be composed and returned.
>
> Cheers
>
> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <ds...@cloudera.com>
> wrote:
>
> > Hi Nishanth,
> >
> > Take a look at http://hbase.apache.org/book/client.filter.html . If I
> > understand your use case correctly, you might want to look at
> > RegexStringComparator to match the first 1000 characters of your column
> > qualifier.
> >
> > -Dima
> >
> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <ni...@gmail.com>
> > wrote:
> >
> > > Hi All,
> > >
> > > I have an hbase table with multiple cfs (say c1,c2,c3).Each of this
> > column
> > > family has a column 'message' which is about 5K.What I need to do is
> to
> > > grab only the first 1000 Characters of this message when I do a get on
> > the
> > > table using row Key.I was thinking of using filters to do this on
> hbase
> > > sever side.Can some one help me on how to go about this.
> > >
> > >
> > > Thanks,
> > > Nishan
> > >
> >
>
Re: Custom Filter on hbase Column
Posted by Ted Yu <yu...@gmail.com>.
In Nishanth's case, the 5K message is stored in one KeyValue, right ?
If only the first 1000 Characters of this message are to be returned,
a new KeyValue
needs to be composed and returned.
Cheers
On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <ds...@cloudera.com> wrote:
> Hi Nishanth,
>
> Take a look at http://hbase.apache.org/book/client.filter.html . If I
> understand your use case correctly, you might want to look at
> RegexStringComparator to match the first 1000 characters of your column
> qualifier.
>
> -Dima
>
> On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <ni...@gmail.com>
> wrote:
>
> > Hi All,
> >
> > I have an hbase table with multiple cfs (say c1,c2,c3).Each of this
> column
> > family has a column 'message' which is about 5K.What I need to do is to
> > grab only the first 1000 Characters of this message when I do a get on
> the
> > table using row Key.I was thinking of using filters to do this on hbase
> > sever side.Can some one help me on how to go about this.
> >
> >
> > Thanks,
> > Nishan
> >
>
Re: Custom Filter on hbase Column
Posted by Dima Spivak <ds...@cloudera.com>.
Hi Nishanth,
Take a look at http://hbase.apache.org/book/client.filter.html . If I
understand your use case correctly, you might want to look at
RegexStringComparator to match the first 1000 characters of your column
qualifier.
-Dima
On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <ni...@gmail.com>
wrote:
> Hi All,
>
> I have an hbase table with multiple cfs (say c1,c2,c3).Each of this column
> family has a column 'message' which is about 5K.What I need to do is to
> grab only the first 1000 Characters of this message when I do a get on the
> table using row Key.I was thinking of using filters to do this on hbase
> sever side.Can some one help me on how to go about this.
>
>
> Thanks,
> Nishan
>