You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jeetendra Gangele <ga...@gmail.com> on 2015/04/16 16:06:02 UTC
Need hlep in substring filter
Hi All I have get all the records using scan with end with particular
string let
say record key ending with "12567". I need to scan and get all such result.
I am values filter and do the substring there but i want to avoid this
because its slow.
Regards
jeetendra
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
How about this but again it will be slow i dont want to use any string
based filter
RegexStringComparator comp = new RegexStringComparator(".12567"); // any
value that starts with 'end with 12567'
SingleColumnValueFilter filter = new SingleColumnValueFilter(
cf,
column,
CompareOp.EQUAL,
comp
);
scan.setFilter(filter);
On 16 April 2015 at 19:57, Jeetendra Gangele <ga...@gmail.com> wrote:
> Thanks for your reply.Ya I am filtering on row-key which ended with "12567"
>
> I did not understand properly what do you mean by "You can compose
> SuffixFilter which filters row key by comparing suffix."
>
> can you elaborate .
>
> On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
>
>> bq. record key ending with "12567"
>>
>> Can you clarify whether you're filtering by row key ?
>> If so, please take a look at PrefixFilter.
>> You can compose SuffixFilter which filters row key by comparing suffix.
>>
>> Cheers
>>
>> On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <ga...@gmail.com>
>> wrote:
>>
>> > Hi All I have get all the records using scan with end with particular
>> > string let
>> > say record key ending with "12567". I need to scan and get all such
>> result.
>> >
>> > I am values filter and do the substring there but i want to avoid this
>> > because its slow.
>> >
>> > Regards
>> > jeetendra
>> >
>>
>
>
>
>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
it did worked now we have to create the lib folder in the room dir of hbase
then only it worked.
thanks all for your help.
On 20 April 2015 at 17:20, Ted Yu <yu...@gmail.com> wrote:
> What's the value for hbase.dynamic.jars.dir ?
>
> Cheers
>
>
>
> > On Apr 20, 2015, at 12:53 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
> >
> > I have put my jar in sub folder of hbase.rootdir still not working
> > I am getting same error class not found.
> >
> >> On 18 April 2015 at 03:54, Ted Yu <yu...@gmail.com> wrote:
> >>
> >> bq. This will @ hbase-site.xml?
> >>
> >> Yes.
> >>
> >> bq. can I pur my jar containing SuffixFilter class into hbase.rootdir?
> >>
> >> Better create a sub-folder under the rootdir.
> >>
> >> On Fri, Apr 17, 2015 at 1:58 PM, Jeetendra Gangele <
> gangele397@gmail.com>
> >> wrote:
> >>
> >>> This will @ hbase-site.xml?
> >>>
> >>> can I pur my jar containing SuffixFilter class into hbase.rootdir?
> >>>
> >>>> On 18 April 2015 at 02:19, Ted Yu <yu...@gmail.com> wrote:
> >>>>
> >>>> bq. Hbase 0.98.4 so this feature already should be there?
> >>>>
> >>>> Yes.
> >>>>
> >>>> Drop the class containing SuffixFilter class in location specified by
> >>>> hbase.dynamic.jars.dir
> >>>> config. Then region server should be able to find it.
> >>>>
> >>>> On Fri, Apr 17, 2015 at 10:22 AM, Jeetendra Gangele <
> >>> gangele397@gmail.com>
> >>>> wrote:
> >>>>
> >>>>> I am using Hbase 0.98.4 so this feature already should be there?
> >>>>> problem is FilterList class(when we add this filter) not able to find
> >>> the
> >>>>> SuffixFilter
> >>>>>
> >>>>>> On 17 April 2015 at 22:47, Jeetendra Gangele <ga...@gmail.com>
> >>>>> wrote:
> >>>>>
> >>>>>> Yes I used inside my project. This project will build the jar that
> >>> jar
> >>>> I
> >>>>>> added with classpath when running the job
> >>>>>>
> >>>>>>> On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
> >>>>>>>
> >>>>>>> bq. java.io.IOException: java.lang.ClassNotFoundException:
> >>>>>>> com.insideview.yam.HbaseClient.SuffixFilter
> >>>>>>>
> >>>>>>> I assume you copied SuffixFilter class to your insideview project.
> >>> How
> >>>>> did
> >>>>>>> you deploy the jar containing SuffixFilter to hbase cluster ?
> >>>>>>> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
> >>>>>>> introduced.
> >>>>>>>
> >>>>>>> Cheers
> >>>>>>>
> >>>>>>> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <
> >>>>> gangele397@gmail.com>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> at java.lang.Thread.run(Thread.java:745)
> >>>>>>>> Caused by: java.lang.reflect.InvocationTargetException
> >>>>>>>> at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown
> >>>>> Source)
> >>>>>>>> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>>>>>>> at java.lang.reflect.Method.invoke(Method.java:606)
> >>>>>>>> at
> >>
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> >>>>>>>> ... 8 more
> >>>>>>>> Caused by:
> >>>>> org.apache.hadoop.hbase.exceptions.DeserializationException:
> >>>>>>>> java.io.IOException: java.lang.ClassNotFoundException:
> >>>>>>>> com.insideview.yam.HbaseClient.SuffixFilter
> >>>>>>>> at
> >>>
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> >>>>>>>> ... 12 more
> >>>>>>>> Caused by: java.io.IOException:
> >> java.lang.ClassNotFoundException:
> >>>>>>>> com.insideview.yam.HbaseClient.SuffixFilter
> >>>>>>>> at
> >>
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> >>>>>>>> at
> >>>
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
> >>>>>>>>
> >>>>>>>> This is the error i m getting
> >>>>>>>>> On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> >>>>>>>>>
> >>>>>>>>> Here is an example
> >>>>>>>>> from
> >>
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> >>>>>>>>> :
> >>>>>>>>>
> >>>>>>>>> byte[] suffix =
> >>>>>>>>> ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> >>>>>>>>> SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> >>>>>>>>> SuffixFilter rowFilter = new SuffixFilter(suffix);
> >>>>>>>>> Filter filter = new FilterList(linkFilter, rowFilter);
> >>>>>>>>>
> >>>>>>>>> You can use the following method from Bytes.java (in
> >>> hbase-common)
> >>>>> to
> >>>>>>>>> obtain byte[] from "12345"
> >>>>>>>>>
> >>>>>>>>> public static byte[] toBytes(String s) {
> >>>>>>>>>
> >>>>>>>>> Cheers
> >>>>>>>>>
> >>>>>>>>> On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
> >>>>>>> gangele397@gmail.com
> >>>>>>>>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> filterRowKey what is these arguments? Can you please explain
> >>>> lets
> >>>>>>> say I
> >>>>>>>>>> have data like abcde_12345 similary way
> >>>>>>>>>> and I want to scan all the records ending with "12345" what
> >>>>> should I
> >>>>>>>> pass
> >>>>>>>>>> to this function?
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com>
> >>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>> Please take a look
> >>>>>>>>>>> at
> >>
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> >>>>>>>>>>> in Phoenix repo.
> >>>>>>>>>>>
> >>>>>>>>>>> Processing is done in the following method:
> >>>>>>>>>>>
> >>>>>>>>>>> public boolean filterRowKey(byte[] buffer, int offset,
> >> int
> >>>>>>> length)
> >>>>>>>> {
> >>>>>>>>>>>
> >>>>>>>>>>> Note: the suffix is expressed in byte array.
> >>>>>>>>>>>
> >>>>>>>>>>> FYI
> >>>>>>>>>>>
> >>>>>>>>>>> On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> >>>>>>>>> gangele397@gmail.com
> >>>>>>>>>>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> Thanks for your reply.Ya I am filtering on row-key which
> >>>> ended
> >>>>>>> with
> >>>>>>>>>>> "12567"
> >>>>>>>>>>>>
> >>>>>>>>>>>> I did not understand properly what do you mean by "You
> >> can
> >>>>>>> compose
> >>>>>>>>>>>> SuffixFilter which filters row key by comparing suffix."
> >>>>>>>>>>>>
> >>>>>>>>>>>> can you elaborate .
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com>
> >>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> bq. record key ending with "12567"
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Can you clarify whether you're filtering by row key ?
> >>>>>>>>>>>>> If so, please take a look at PrefixFilter.
> >>>>>>>>>>>>> You can compose SuffixFilter which filters row key by
> >>>>>>> comparing
> >>>>>>>>>> suffix.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Cheers
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> >>>>>>>>>>> gangele397@gmail.com
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Hi All I have get all the records using scan with
> >> end
> >>>> with
> >>>>>>>>>> particular
> >>>>>>>>>>>>>> string let
> >>>>>>>>>>>>>> say record key ending with "12567". I need to scan
> >> and
> >>>> get
> >>>>>>> all
> >>>>>>>>> such
> >>>>>>>>>>>>> result.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> I am values filter and do the substring there but i
> >>> want
> >>>>> to
> >>>>>>>> avoid
> >>>>>>>>>>> this
> >>>>>>>>>>>>>> because its slow.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Regards
> >>>>>>>>>>>>>> jeetendra
> >>
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
What's the value for hbase.dynamic.jars.dir ?
Cheers
> On Apr 20, 2015, at 12:53 AM, Jeetendra Gangele <ga...@gmail.com> wrote:
>
> I have put my jar in sub folder of hbase.rootdir still not working
> I am getting same error class not found.
>
>> On 18 April 2015 at 03:54, Ted Yu <yu...@gmail.com> wrote:
>>
>> bq. This will @ hbase-site.xml?
>>
>> Yes.
>>
>> bq. can I pur my jar containing SuffixFilter class into hbase.rootdir?
>>
>> Better create a sub-folder under the rootdir.
>>
>> On Fri, Apr 17, 2015 at 1:58 PM, Jeetendra Gangele <ga...@gmail.com>
>> wrote:
>>
>>> This will @ hbase-site.xml?
>>>
>>> can I pur my jar containing SuffixFilter class into hbase.rootdir?
>>>
>>>> On 18 April 2015 at 02:19, Ted Yu <yu...@gmail.com> wrote:
>>>>
>>>> bq. Hbase 0.98.4 so this feature already should be there?
>>>>
>>>> Yes.
>>>>
>>>> Drop the class containing SuffixFilter class in location specified by
>>>> hbase.dynamic.jars.dir
>>>> config. Then region server should be able to find it.
>>>>
>>>> On Fri, Apr 17, 2015 at 10:22 AM, Jeetendra Gangele <
>>> gangele397@gmail.com>
>>>> wrote:
>>>>
>>>>> I am using Hbase 0.98.4 so this feature already should be there?
>>>>> problem is FilterList class(when we add this filter) not able to find
>>> the
>>>>> SuffixFilter
>>>>>
>>>>>> On 17 April 2015 at 22:47, Jeetendra Gangele <ga...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Yes I used inside my project. This project will build the jar that
>>> jar
>>>> I
>>>>>> added with classpath when running the job
>>>>>>
>>>>>>> On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
>>>>>>>
>>>>>>> bq. java.io.IOException: java.lang.ClassNotFoundException:
>>>>>>> com.insideview.yam.HbaseClient.SuffixFilter
>>>>>>>
>>>>>>> I assume you copied SuffixFilter class to your insideview project.
>>> How
>>>>> did
>>>>>>> you deploy the jar containing SuffixFilter to hbase cluster ?
>>>>>>> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
>>>>>>> introduced.
>>>>>>>
>>>>>>> Cheers
>>>>>>>
>>>>>>> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <
>>>>> gangele397@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>>>> at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown
>>>>> Source)
>>>>>>>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>>>>>> at
>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
>>>>>>>> ... 8 more
>>>>>>>> Caused by:
>>>>> org.apache.hadoop.hbase.exceptions.DeserializationException:
>>>>>>>> java.io.IOException: java.lang.ClassNotFoundException:
>>>>>>>> com.insideview.yam.HbaseClient.SuffixFilter
>>>>>>>> at
>>> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
>>>>>>>> ... 12 more
>>>>>>>> Caused by: java.io.IOException:
>> java.lang.ClassNotFoundException:
>>>>>>>> com.insideview.yam.HbaseClient.SuffixFilter
>>>>>>>> at
>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
>>>>>>>> at
>>> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
>>>>>>>>
>>>>>>>> This is the error i m getting
>>>>>>>>> On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>> Here is an example
>>>>>>>>> from
>> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
>>>>>>>>> :
>>>>>>>>>
>>>>>>>>> byte[] suffix =
>>>>>>>>> ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
>>>>>>>>> SchemaUtil.getTableNameAsBytes(schemaName, tableName));
>>>>>>>>> SuffixFilter rowFilter = new SuffixFilter(suffix);
>>>>>>>>> Filter filter = new FilterList(linkFilter, rowFilter);
>>>>>>>>>
>>>>>>>>> You can use the following method from Bytes.java (in
>>> hbase-common)
>>>>> to
>>>>>>>>> obtain byte[] from "12345"
>>>>>>>>>
>>>>>>>>> public static byte[] toBytes(String s) {
>>>>>>>>>
>>>>>>>>> Cheers
>>>>>>>>>
>>>>>>>>> On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
>>>>>>> gangele397@gmail.com
>>>>>>>>>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> filterRowKey what is these arguments? Can you please explain
>>>> lets
>>>>>>> say I
>>>>>>>>>> have data like abcde_12345 similary way
>>>>>>>>>> and I want to scan all the records ending with "12345" what
>>>>> should I
>>>>>>>> pass
>>>>>>>>>> to this function?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com>
>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Please take a look
>>>>>>>>>>> at
>> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
>>>>>>>>>>> in Phoenix repo.
>>>>>>>>>>>
>>>>>>>>>>> Processing is done in the following method:
>>>>>>>>>>>
>>>>>>>>>>> public boolean filterRowKey(byte[] buffer, int offset,
>> int
>>>>>>> length)
>>>>>>>> {
>>>>>>>>>>>
>>>>>>>>>>> Note: the suffix is expressed in byte array.
>>>>>>>>>>>
>>>>>>>>>>> FYI
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
>>>>>>>>> gangele397@gmail.com
>>>>>>>>>>>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Thanks for your reply.Ya I am filtering on row-key which
>>>> ended
>>>>>>> with
>>>>>>>>>>> "12567"
>>>>>>>>>>>>
>>>>>>>>>>>> I did not understand properly what do you mean by "You
>> can
>>>>>>> compose
>>>>>>>>>>>> SuffixFilter which filters row key by comparing suffix."
>>>>>>>>>>>>
>>>>>>>>>>>> can you elaborate .
>>>>>>>>>>>>
>>>>>>>>>>>> On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com>
>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> bq. record key ending with "12567"
>>>>>>>>>>>>>
>>>>>>>>>>>>> Can you clarify whether you're filtering by row key ?
>>>>>>>>>>>>> If so, please take a look at PrefixFilter.
>>>>>>>>>>>>> You can compose SuffixFilter which filters row key by
>>>>>>> comparing
>>>>>>>>>> suffix.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Cheers
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
>>>>>>>>>>> gangele397@gmail.com
>>>>>>>>>>>>>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi All I have get all the records using scan with
>> end
>>>> with
>>>>>>>>>> particular
>>>>>>>>>>>>>> string let
>>>>>>>>>>>>>> say record key ending with "12567". I need to scan
>> and
>>>> get
>>>>>>> all
>>>>>>>>> such
>>>>>>>>>>>>> result.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I am values filter and do the substring there but i
>>> want
>>>>> to
>>>>>>>> avoid
>>>>>>>>>>> this
>>>>>>>>>>>>>> because its slow.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Regards
>>>>>>>>>>>>>> jeetendra
>>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
I have put my jar in sub folder of hbase.rootdir still not working
I am getting same error class not found.
On 18 April 2015 at 03:54, Ted Yu <yu...@gmail.com> wrote:
> bq. This will @ hbase-site.xml?
>
> Yes.
>
> bq. can I pur my jar containing SuffixFilter class into hbase.rootdir?
>
> Better create a sub-folder under the rootdir.
>
> On Fri, Apr 17, 2015 at 1:58 PM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
> > This will @ hbase-site.xml?
> >
> > can I pur my jar containing SuffixFilter class into hbase.rootdir?
> >
> > On 18 April 2015 at 02:19, Ted Yu <yu...@gmail.com> wrote:
> >
> > > bq. Hbase 0.98.4 so this feature already should be there?
> > >
> > > Yes.
> > >
> > > Drop the class containing SuffixFilter class in location specified by
> > > hbase.dynamic.jars.dir
> > > config. Then region server should be able to find it.
> > >
> > > On Fri, Apr 17, 2015 at 10:22 AM, Jeetendra Gangele <
> > gangele397@gmail.com>
> > > wrote:
> > >
> > > > I am using Hbase 0.98.4 so this feature already should be there?
> > > > problem is FilterList class(when we add this filter) not able to find
> > the
> > > > SuffixFilter
> > > >
> > > > On 17 April 2015 at 22:47, Jeetendra Gangele <ga...@gmail.com>
> > > wrote:
> > > >
> > > > > Yes I used inside my project. This project will build the jar that
> > jar
> > > I
> > > > > added with classpath when running the job
> > > > >
> > > > > On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
> > > > >
> > > > >> bq. java.io.IOException: java.lang.ClassNotFoundException:
> > > > >> com.insideview.yam.HbaseClient.SuffixFilter
> > > > >>
> > > > >> I assume you copied SuffixFilter class to your insideview project.
> > How
> > > > did
> > > > >> you deploy the jar containing SuffixFilter to hbase cluster ?
> > > > >> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
> > > > >> introduced.
> > > > >>
> > > > >> Cheers
> > > > >>
> > > > >> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <
> > > > gangele397@gmail.com>
> > > > >> wrote:
> > > > >>
> > > > >> > at java.lang.Thread.run(Thread.java:745)
> > > > >> > Caused by: java.lang.reflect.InvocationTargetException
> > > > >> > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown
> > > > Source)
> > > > >> > at
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > >> > at java.lang.reflect.Method.invoke(Method.java:606)
> > > > >> > at
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> > > > >> > ... 8 more
> > > > >> > Caused by:
> > > > org.apache.hadoop.hbase.exceptions.DeserializationException:
> > > > >> > java.io.IOException: java.lang.ClassNotFoundException:
> > > > >> > com.insideview.yam.HbaseClient.SuffixFilter
> > > > >> > at
> > > > >> >
> > > >
> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> > > > >> > ... 12 more
> > > > >> > Caused by: java.io.IOException:
> java.lang.ClassNotFoundException:
> > > > >> > com.insideview.yam.HbaseClient.SuffixFilter
> > > > >> > at
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> > > > >> > at
> > > > >> >
> > > >
> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
> > > > >> >
> > > > >> > This is the error i m getting
> > > > >> > On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> > > > >> >
> > > > >> > > Here is an example
> > > > >> > > from
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> > > > >> > > :
> > > > >> > >
> > > > >> > > byte[] suffix =
> > > > >> > > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> > > > >> > > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> > > > >> > > SuffixFilter rowFilter = new SuffixFilter(suffix);
> > > > >> > > Filter filter = new FilterList(linkFilter, rowFilter);
> > > > >> > >
> > > > >> > > You can use the following method from Bytes.java (in
> > hbase-common)
> > > > to
> > > > >> > > obtain byte[] from "12345"
> > > > >> > >
> > > > >> > > public static byte[] toBytes(String s) {
> > > > >> > >
> > > > >> > > Cheers
> > > > >> > >
> > > > >> > > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
> > > > >> gangele397@gmail.com
> > > > >> > >
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > > filterRowKey what is these arguments? Can you please explain
> > > lets
> > > > >> say I
> > > > >> > > > have data like abcde_12345 similary way
> > > > >> > > > and I want to scan all the records ending with "12345" what
> > > > should I
> > > > >> > pass
> > > > >> > > > to this function?
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com>
> > wrote:
> > > > >> > > >
> > > > >> > > > > Please take a look
> > > > >> > > > > at
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > > > >> > > > > in Phoenix repo.
> > > > >> > > > >
> > > > >> > > > > Processing is done in the following method:
> > > > >> > > > >
> > > > >> > > > > public boolean filterRowKey(byte[] buffer, int offset,
> int
> > > > >> length)
> > > > >> > {
> > > > >> > > > >
> > > > >> > > > > Note: the suffix is expressed in byte array.
> > > > >> > > > >
> > > > >> > > > > FYI
> > > > >> > > > >
> > > > >> > > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> > > > >> > > gangele397@gmail.com
> > > > >> > > > >
> > > > >> > > > > wrote:
> > > > >> > > > >
> > > > >> > > > > > Thanks for your reply.Ya I am filtering on row-key which
> > > ended
> > > > >> with
> > > > >> > > > > "12567"
> > > > >> > > > > >
> > > > >> > > > > > I did not understand properly what do you mean by "You
> can
> > > > >> compose
> > > > >> > > > > > SuffixFilter which filters row key by comparing suffix."
> > > > >> > > > > >
> > > > >> > > > > > can you elaborate .
> > > > >> > > > > >
> > > > >> > > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com>
> > > > wrote:
> > > > >> > > > > >
> > > > >> > > > > > > bq. record key ending with "12567"
> > > > >> > > > > > >
> > > > >> > > > > > > Can you clarify whether you're filtering by row key ?
> > > > >> > > > > > > If so, please take a look at PrefixFilter.
> > > > >> > > > > > > You can compose SuffixFilter which filters row key by
> > > > >> comparing
> > > > >> > > > suffix.
> > > > >> > > > > > >
> > > > >> > > > > > > Cheers
> > > > >> > > > > > >
> > > > >> > > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > > > >> > > > > gangele397@gmail.com
> > > > >> > > > > > >
> > > > >> > > > > > > wrote:
> > > > >> > > > > > >
> > > > >> > > > > > > > Hi All I have get all the records using scan with
> end
> > > with
> > > > >> > > > particular
> > > > >> > > > > > > > string let
> > > > >> > > > > > > > say record key ending with "12567". I need to scan
> and
> > > get
> > > > >> all
> > > > >> > > such
> > > > >> > > > > > > result.
> > > > >> > > > > > > >
> > > > >> > > > > > > > I am values filter and do the substring there but i
> > want
> > > > to
> > > > >> > avoid
> > > > >> > > > > this
> > > > >> > > > > > > > because its slow.
> > > > >> > > > > > > >
> > > > >> > > > > > > > Regards
> > > > >> > > > > > > > jeetendra
> > > > >> > > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
bq. This will @ hbase-site.xml?
Yes.
bq. can I pur my jar containing SuffixFilter class into hbase.rootdir?
Better create a sub-folder under the rootdir.
On Fri, Apr 17, 2015 at 1:58 PM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> This will @ hbase-site.xml?
>
> can I pur my jar containing SuffixFilter class into hbase.rootdir?
>
> On 18 April 2015 at 02:19, Ted Yu <yu...@gmail.com> wrote:
>
> > bq. Hbase 0.98.4 so this feature already should be there?
> >
> > Yes.
> >
> > Drop the class containing SuffixFilter class in location specified by
> > hbase.dynamic.jars.dir
> > config. Then region server should be able to find it.
> >
> > On Fri, Apr 17, 2015 at 10:22 AM, Jeetendra Gangele <
> gangele397@gmail.com>
> > wrote:
> >
> > > I am using Hbase 0.98.4 so this feature already should be there?
> > > problem is FilterList class(when we add this filter) not able to find
> the
> > > SuffixFilter
> > >
> > > On 17 April 2015 at 22:47, Jeetendra Gangele <ga...@gmail.com>
> > wrote:
> > >
> > > > Yes I used inside my project. This project will build the jar that
> jar
> > I
> > > > added with classpath when running the job
> > > >
> > > > On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
> > > >
> > > >> bq. java.io.IOException: java.lang.ClassNotFoundException:
> > > >> com.insideview.yam.HbaseClient.SuffixFilter
> > > >>
> > > >> I assume you copied SuffixFilter class to your insideview project.
> How
> > > did
> > > >> you deploy the jar containing SuffixFilter to hbase cluster ?
> > > >> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
> > > >> introduced.
> > > >>
> > > >> Cheers
> > > >>
> > > >> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <
> > > gangele397@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > at java.lang.Thread.run(Thread.java:745)
> > > >> > Caused by: java.lang.reflect.InvocationTargetException
> > > >> > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown
> > > Source)
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > >> > at java.lang.reflect.Method.invoke(Method.java:606)
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> > > >> > ... 8 more
> > > >> > Caused by:
> > > org.apache.hadoop.hbase.exceptions.DeserializationException:
> > > >> > java.io.IOException: java.lang.ClassNotFoundException:
> > > >> > com.insideview.yam.HbaseClient.SuffixFilter
> > > >> > at
> > > >> >
> > >
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> > > >> > ... 12 more
> > > >> > Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> > > >> > com.insideview.yam.HbaseClient.SuffixFilter
> > > >> > at
> > > >> >
> > > >> >
> > > >>
> > >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> > > >> > at
> > > >> >
> > >
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
> > > >> >
> > > >> > This is the error i m getting
> > > >> > On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> > > >> >
> > > >> > > Here is an example
> > > >> > > from
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> > > >> > > :
> > > >> > >
> > > >> > > byte[] suffix =
> > > >> > > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> > > >> > > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> > > >> > > SuffixFilter rowFilter = new SuffixFilter(suffix);
> > > >> > > Filter filter = new FilterList(linkFilter, rowFilter);
> > > >> > >
> > > >> > > You can use the following method from Bytes.java (in
> hbase-common)
> > > to
> > > >> > > obtain byte[] from "12345"
> > > >> > >
> > > >> > > public static byte[] toBytes(String s) {
> > > >> > >
> > > >> > > Cheers
> > > >> > >
> > > >> > > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
> > > >> gangele397@gmail.com
> > > >> > >
> > > >> > > wrote:
> > > >> > >
> > > >> > > > filterRowKey what is these arguments? Can you please explain
> > lets
> > > >> say I
> > > >> > > > have data like abcde_12345 similary way
> > > >> > > > and I want to scan all the records ending with "12345" what
> > > should I
> > > >> > pass
> > > >> > > > to this function?
> > > >> > > >
> > > >> > > >
> > > >> > > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com>
> wrote:
> > > >> > > >
> > > >> > > > > Please take a look
> > > >> > > > > at
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > > >> > > > > in Phoenix repo.
> > > >> > > > >
> > > >> > > > > Processing is done in the following method:
> > > >> > > > >
> > > >> > > > > public boolean filterRowKey(byte[] buffer, int offset, int
> > > >> length)
> > > >> > {
> > > >> > > > >
> > > >> > > > > Note: the suffix is expressed in byte array.
> > > >> > > > >
> > > >> > > > > FYI
> > > >> > > > >
> > > >> > > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> > > >> > > gangele397@gmail.com
> > > >> > > > >
> > > >> > > > > wrote:
> > > >> > > > >
> > > >> > > > > > Thanks for your reply.Ya I am filtering on row-key which
> > ended
> > > >> with
> > > >> > > > > "12567"
> > > >> > > > > >
> > > >> > > > > > I did not understand properly what do you mean by "You can
> > > >> compose
> > > >> > > > > > SuffixFilter which filters row key by comparing suffix."
> > > >> > > > > >
> > > >> > > > > > can you elaborate .
> > > >> > > > > >
> > > >> > > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com>
> > > wrote:
> > > >> > > > > >
> > > >> > > > > > > bq. record key ending with "12567"
> > > >> > > > > > >
> > > >> > > > > > > Can you clarify whether you're filtering by row key ?
> > > >> > > > > > > If so, please take a look at PrefixFilter.
> > > >> > > > > > > You can compose SuffixFilter which filters row key by
> > > >> comparing
> > > >> > > > suffix.
> > > >> > > > > > >
> > > >> > > > > > > Cheers
> > > >> > > > > > >
> > > >> > > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > > >> > > > > gangele397@gmail.com
> > > >> > > > > > >
> > > >> > > > > > > wrote:
> > > >> > > > > > >
> > > >> > > > > > > > Hi All I have get all the records using scan with end
> > with
> > > >> > > > particular
> > > >> > > > > > > > string let
> > > >> > > > > > > > say record key ending with "12567". I need to scan and
> > get
> > > >> all
> > > >> > > such
> > > >> > > > > > > result.
> > > >> > > > > > > >
> > > >> > > > > > > > I am values filter and do the substring there but i
> want
> > > to
> > > >> > avoid
> > > >> > > > > this
> > > >> > > > > > > > because its slow.
> > > >> > > > > > > >
> > > >> > > > > > > > Regards
> > > >> > > > > > > > jeetendra
> > > >> > > > > > > >
> > > >> > > > > > >
> > > >> > > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
This will @ hbase-site.xml?
can I pur my jar containing SuffixFilter class into hbase.rootdir?
On 18 April 2015 at 02:19, Ted Yu <yu...@gmail.com> wrote:
> bq. Hbase 0.98.4 so this feature already should be there?
>
> Yes.
>
> Drop the class containing SuffixFilter class in location specified by
> hbase.dynamic.jars.dir
> config. Then region server should be able to find it.
>
> On Fri, Apr 17, 2015 at 10:22 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
> > I am using Hbase 0.98.4 so this feature already should be there?
> > problem is FilterList class(when we add this filter) not able to find the
> > SuffixFilter
> >
> > On 17 April 2015 at 22:47, Jeetendra Gangele <ga...@gmail.com>
> wrote:
> >
> > > Yes I used inside my project. This project will build the jar that jar
> I
> > > added with classpath when running the job
> > >
> > > On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
> > >
> > >> bq. java.io.IOException: java.lang.ClassNotFoundException:
> > >> com.insideview.yam.HbaseClient.SuffixFilter
> > >>
> > >> I assume you copied SuffixFilter class to your insideview project. How
> > did
> > >> you deploy the jar containing SuffixFilter to hbase cluster ?
> > >> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
> > >> introduced.
> > >>
> > >> Cheers
> > >>
> > >> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <
> > gangele397@gmail.com>
> > >> wrote:
> > >>
> > >> > at java.lang.Thread.run(Thread.java:745)
> > >> > Caused by: java.lang.reflect.InvocationTargetException
> > >> > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown
> > Source)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >> > at java.lang.reflect.Method.invoke(Method.java:606)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> > >> > ... 8 more
> > >> > Caused by:
> > org.apache.hadoop.hbase.exceptions.DeserializationException:
> > >> > java.io.IOException: java.lang.ClassNotFoundException:
> > >> > com.insideview.yam.HbaseClient.SuffixFilter
> > >> > at
> > >> >
> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> > >> > ... 12 more
> > >> > Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> > >> > com.insideview.yam.HbaseClient.SuffixFilter
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> > >> > at
> > >> >
> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
> > >> >
> > >> > This is the error i m getting
> > >> > On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> > >> >
> > >> > > Here is an example
> > >> > > from
> > >> > >
> > >> >
> > >>
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> > >> > > :
> > >> > >
> > >> > > byte[] suffix =
> > >> > > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> > >> > > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> > >> > > SuffixFilter rowFilter = new SuffixFilter(suffix);
> > >> > > Filter filter = new FilterList(linkFilter, rowFilter);
> > >> > >
> > >> > > You can use the following method from Bytes.java (in hbase-common)
> > to
> > >> > > obtain byte[] from "12345"
> > >> > >
> > >> > > public static byte[] toBytes(String s) {
> > >> > >
> > >> > > Cheers
> > >> > >
> > >> > > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
> > >> gangele397@gmail.com
> > >> > >
> > >> > > wrote:
> > >> > >
> > >> > > > filterRowKey what is these arguments? Can you please explain
> lets
> > >> say I
> > >> > > > have data like abcde_12345 similary way
> > >> > > > and I want to scan all the records ending with "12345" what
> > should I
> > >> > pass
> > >> > > > to this function?
> > >> > > >
> > >> > > >
> > >> > > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
> > >> > > >
> > >> > > > > Please take a look
> > >> > > > > at
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > >> > > > > in Phoenix repo.
> > >> > > > >
> > >> > > > > Processing is done in the following method:
> > >> > > > >
> > >> > > > > public boolean filterRowKey(byte[] buffer, int offset, int
> > >> length)
> > >> > {
> > >> > > > >
> > >> > > > > Note: the suffix is expressed in byte array.
> > >> > > > >
> > >> > > > > FYI
> > >> > > > >
> > >> > > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> > >> > > gangele397@gmail.com
> > >> > > > >
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > > Thanks for your reply.Ya I am filtering on row-key which
> ended
> > >> with
> > >> > > > > "12567"
> > >> > > > > >
> > >> > > > > > I did not understand properly what do you mean by "You can
> > >> compose
> > >> > > > > > SuffixFilter which filters row key by comparing suffix."
> > >> > > > > >
> > >> > > > > > can you elaborate .
> > >> > > > > >
> > >> > > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com>
> > wrote:
> > >> > > > > >
> > >> > > > > > > bq. record key ending with "12567"
> > >> > > > > > >
> > >> > > > > > > Can you clarify whether you're filtering by row key ?
> > >> > > > > > > If so, please take a look at PrefixFilter.
> > >> > > > > > > You can compose SuffixFilter which filters row key by
> > >> comparing
> > >> > > > suffix.
> > >> > > > > > >
> > >> > > > > > > Cheers
> > >> > > > > > >
> > >> > > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > >> > > > > gangele397@gmail.com
> > >> > > > > > >
> > >> > > > > > > wrote:
> > >> > > > > > >
> > >> > > > > > > > Hi All I have get all the records using scan with end
> with
> > >> > > > particular
> > >> > > > > > > > string let
> > >> > > > > > > > say record key ending with "12567". I need to scan and
> get
> > >> all
> > >> > > such
> > >> > > > > > > result.
> > >> > > > > > > >
> > >> > > > > > > > I am values filter and do the substring there but i want
> > to
> > >> > avoid
> > >> > > > > this
> > >> > > > > > > > because its slow.
> > >> > > > > > > >
> > >> > > > > > > > Regards
> > >> > > > > > > > jeetendra
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
bq. Hbase 0.98.4 so this feature already should be there?
Yes.
Drop the class containing SuffixFilter class in location specified by
hbase.dynamic.jars.dir
config. Then region server should be able to find it.
On Fri, Apr 17, 2015 at 10:22 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> I am using Hbase 0.98.4 so this feature already should be there?
> problem is FilterList class(when we add this filter) not able to find the
> SuffixFilter
>
> On 17 April 2015 at 22:47, Jeetendra Gangele <ga...@gmail.com> wrote:
>
> > Yes I used inside my project. This project will build the jar that jar I
> > added with classpath when running the job
> >
> > On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
> >
> >> bq. java.io.IOException: java.lang.ClassNotFoundException:
> >> com.insideview.yam.HbaseClient.SuffixFilter
> >>
> >> I assume you copied SuffixFilter class to your insideview project. How
> did
> >> you deploy the jar containing SuffixFilter to hbase cluster ?
> >> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
> >> introduced.
> >>
> >> Cheers
> >>
> >> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <
> gangele397@gmail.com>
> >> wrote:
> >>
> >> > at java.lang.Thread.run(Thread.java:745)
> >> > Caused by: java.lang.reflect.InvocationTargetException
> >> > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown
> Source)
> >> > at
> >> >
> >> >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> > at java.lang.reflect.Method.invoke(Method.java:606)
> >> > at
> >> >
> >> >
> >>
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> >> > ... 8 more
> >> > Caused by:
> org.apache.hadoop.hbase.exceptions.DeserializationException:
> >> > java.io.IOException: java.lang.ClassNotFoundException:
> >> > com.insideview.yam.HbaseClient.SuffixFilter
> >> > at
> >> >
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> >> > ... 12 more
> >> > Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> >> > com.insideview.yam.HbaseClient.SuffixFilter
> >> > at
> >> >
> >> >
> >>
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> >> > at
> >> >
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
> >> >
> >> > This is the error i m getting
> >> > On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> >> >
> >> > > Here is an example
> >> > > from
> >> > >
> >> >
> >>
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> >> > > :
> >> > >
> >> > > byte[] suffix =
> >> > > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> >> > > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> >> > > SuffixFilter rowFilter = new SuffixFilter(suffix);
> >> > > Filter filter = new FilterList(linkFilter, rowFilter);
> >> > >
> >> > > You can use the following method from Bytes.java (in hbase-common)
> to
> >> > > obtain byte[] from "12345"
> >> > >
> >> > > public static byte[] toBytes(String s) {
> >> > >
> >> > > Cheers
> >> > >
> >> > > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
> >> gangele397@gmail.com
> >> > >
> >> > > wrote:
> >> > >
> >> > > > filterRowKey what is these arguments? Can you please explain lets
> >> say I
> >> > > > have data like abcde_12345 similary way
> >> > > > and I want to scan all the records ending with "12345" what
> should I
> >> > pass
> >> > > > to this function?
> >> > > >
> >> > > >
> >> > > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
> >> > > >
> >> > > > > Please take a look
> >> > > > > at
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> >> > > > > in Phoenix repo.
> >> > > > >
> >> > > > > Processing is done in the following method:
> >> > > > >
> >> > > > > public boolean filterRowKey(byte[] buffer, int offset, int
> >> length)
> >> > {
> >> > > > >
> >> > > > > Note: the suffix is expressed in byte array.
> >> > > > >
> >> > > > > FYI
> >> > > > >
> >> > > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> >> > > gangele397@gmail.com
> >> > > > >
> >> > > > > wrote:
> >> > > > >
> >> > > > > > Thanks for your reply.Ya I am filtering on row-key which ended
> >> with
> >> > > > > "12567"
> >> > > > > >
> >> > > > > > I did not understand properly what do you mean by "You can
> >> compose
> >> > > > > > SuffixFilter which filters row key by comparing suffix."
> >> > > > > >
> >> > > > > > can you elaborate .
> >> > > > > >
> >> > > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com>
> wrote:
> >> > > > > >
> >> > > > > > > bq. record key ending with "12567"
> >> > > > > > >
> >> > > > > > > Can you clarify whether you're filtering by row key ?
> >> > > > > > > If so, please take a look at PrefixFilter.
> >> > > > > > > You can compose SuffixFilter which filters row key by
> >> comparing
> >> > > > suffix.
> >> > > > > > >
> >> > > > > > > Cheers
> >> > > > > > >
> >> > > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> >> > > > > gangele397@gmail.com
> >> > > > > > >
> >> > > > > > > wrote:
> >> > > > > > >
> >> > > > > > > > Hi All I have get all the records using scan with end with
> >> > > > particular
> >> > > > > > > > string let
> >> > > > > > > > say record key ending with "12567". I need to scan and get
> >> all
> >> > > such
> >> > > > > > > result.
> >> > > > > > > >
> >> > > > > > > > I am values filter and do the substring there but i want
> to
> >> > avoid
> >> > > > > this
> >> > > > > > > > because its slow.
> >> > > > > > > >
> >> > > > > > > > Regards
> >> > > > > > > > jeetendra
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> >
> >
> >
> >
>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
I am using Hbase 0.98.4 so this feature already should be there?
problem is FilterList class(when we add this filter) not able to find the
SuffixFilter
On 17 April 2015 at 22:47, Jeetendra Gangele <ga...@gmail.com> wrote:
> Yes I used inside my project. This project will build the jar that jar I
> added with classpath when running the job
>
> On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
>
>> bq. java.io.IOException: java.lang.ClassNotFoundException:
>> com.insideview.yam.HbaseClient.SuffixFilter
>>
>> I assume you copied SuffixFilter class to your insideview project. How did
>> you deploy the jar containing SuffixFilter to hbase cluster ?
>> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
>> introduced.
>>
>> Cheers
>>
>> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <ga...@gmail.com>
>> wrote:
>>
>> > at java.lang.Thread.run(Thread.java:745)
>> > Caused by: java.lang.reflect.InvocationTargetException
>> > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
>> > at
>> >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > at java.lang.reflect.Method.invoke(Method.java:606)
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
>> > ... 8 more
>> > Caused by: org.apache.hadoop.hbase.exceptions.DeserializationException:
>> > java.io.IOException: java.lang.ClassNotFoundException:
>> > com.insideview.yam.HbaseClient.SuffixFilter
>> > at
>> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
>> > ... 12 more
>> > Caused by: java.io.IOException: java.lang.ClassNotFoundException:
>> > com.insideview.yam.HbaseClient.SuffixFilter
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
>> > at
>> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
>> >
>> > This is the error i m getting
>> > On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
>> >
>> > > Here is an example
>> > > from
>> > >
>> >
>> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
>> > > :
>> > >
>> > > byte[] suffix =
>> > > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
>> > > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
>> > > SuffixFilter rowFilter = new SuffixFilter(suffix);
>> > > Filter filter = new FilterList(linkFilter, rowFilter);
>> > >
>> > > You can use the following method from Bytes.java (in hbase-common) to
>> > > obtain byte[] from "12345"
>> > >
>> > > public static byte[] toBytes(String s) {
>> > >
>> > > Cheers
>> > >
>> > > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
>> gangele397@gmail.com
>> > >
>> > > wrote:
>> > >
>> > > > filterRowKey what is these arguments? Can you please explain lets
>> say I
>> > > > have data like abcde_12345 similary way
>> > > > and I want to scan all the records ending with "12345" what should I
>> > pass
>> > > > to this function?
>> > > >
>> > > >
>> > > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
>> > > >
>> > > > > Please take a look
>> > > > > at
>> > > > >
>> > > >
>> > >
>> >
>> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
>> > > > > in Phoenix repo.
>> > > > >
>> > > > > Processing is done in the following method:
>> > > > >
>> > > > > public boolean filterRowKey(byte[] buffer, int offset, int
>> length)
>> > {
>> > > > >
>> > > > > Note: the suffix is expressed in byte array.
>> > > > >
>> > > > > FYI
>> > > > >
>> > > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
>> > > gangele397@gmail.com
>> > > > >
>> > > > > wrote:
>> > > > >
>> > > > > > Thanks for your reply.Ya I am filtering on row-key which ended
>> with
>> > > > > "12567"
>> > > > > >
>> > > > > > I did not understand properly what do you mean by "You can
>> compose
>> > > > > > SuffixFilter which filters row key by comparing suffix."
>> > > > > >
>> > > > > > can you elaborate .
>> > > > > >
>> > > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
>> > > > > >
>> > > > > > > bq. record key ending with "12567"
>> > > > > > >
>> > > > > > > Can you clarify whether you're filtering by row key ?
>> > > > > > > If so, please take a look at PrefixFilter.
>> > > > > > > You can compose SuffixFilter which filters row key by
>> comparing
>> > > > suffix.
>> > > > > > >
>> > > > > > > Cheers
>> > > > > > >
>> > > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
>> > > > > gangele397@gmail.com
>> > > > > > >
>> > > > > > > wrote:
>> > > > > > >
>> > > > > > > > Hi All I have get all the records using scan with end with
>> > > > particular
>> > > > > > > > string let
>> > > > > > > > say record key ending with "12567". I need to scan and get
>> all
>> > > such
>> > > > > > > result.
>> > > > > > > >
>> > > > > > > > I am values filter and do the substring there but i want to
>> > avoid
>> > > > > this
>> > > > > > > > because its slow.
>> > > > > > > >
>> > > > > > > > Regards
>> > > > > > > > jeetendra
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>
>
>
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
bq. build the jar
The jar needs to be accessible by each region server.
See HBASE-1936 for details.
On Fri, Apr 17, 2015 at 10:17 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> Yes I used inside my project. This project will build the jar that jar I
> added with classpath when running the job
>
> On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
>
> > bq. java.io.IOException: java.lang.ClassNotFoundException:
> > com.insideview.yam.HbaseClient.SuffixFilter
> >
> > I assume you copied SuffixFilter class to your insideview project. How
> did
> > you deploy the jar containing SuffixFilter to hbase cluster ?
> > See HBASE-1936 for more details where hbase.dynamic.jars.dir was
> > introduced.
> >
> > Cheers
> >
> > On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <gangele397@gmail.com
> >
> > wrote:
> >
> > > at java.lang.Thread.run(Thread.java:745)
> > > Caused by: java.lang.reflect.InvocationTargetException
> > > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
> > > at
> > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > at java.lang.reflect.Method.invoke(Method.java:606)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> > > ... 8 more
> > > Caused by: org.apache.hadoop.hbase.exceptions.DeserializationException:
> > > java.io.IOException: java.lang.ClassNotFoundException:
> > > com.insideview.yam.HbaseClient.SuffixFilter
> > > at
> > >
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> > > ... 12 more
> > > Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> > > com.insideview.yam.HbaseClient.SuffixFilter
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> > > at
> > >
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
> > >
> > > This is the error i m getting
> > > On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > Here is an example
> > > > from
> > > >
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> > > > :
> > > >
> > > > byte[] suffix =
> > > > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> > > > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> > > > SuffixFilter rowFilter = new SuffixFilter(suffix);
> > > > Filter filter = new FilterList(linkFilter, rowFilter);
> > > >
> > > > You can use the following method from Bytes.java (in hbase-common) to
> > > > obtain byte[] from "12345"
> > > >
> > > > public static byte[] toBytes(String s) {
> > > >
> > > > Cheers
> > > >
> > > > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
> > gangele397@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > filterRowKey what is these arguments? Can you please explain lets
> > say I
> > > > > have data like abcde_12345 similary way
> > > > > and I want to scan all the records ending with "12345" what should
> I
> > > pass
> > > > > to this function?
> > > > >
> > > > >
> > > > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
> > > > >
> > > > > > Please take a look
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > > > > > in Phoenix repo.
> > > > > >
> > > > > > Processing is done in the following method:
> > > > > >
> > > > > > public boolean filterRowKey(byte[] buffer, int offset, int
> > length)
> > > {
> > > > > >
> > > > > > Note: the suffix is expressed in byte array.
> > > > > >
> > > > > > FYI
> > > > > >
> > > > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> > > > gangele397@gmail.com
> > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Thanks for your reply.Ya I am filtering on row-key which ended
> > with
> > > > > > "12567"
> > > > > > >
> > > > > > > I did not understand properly what do you mean by "You can
> > compose
> > > > > > > SuffixFilter which filters row key by comparing suffix."
> > > > > > >
> > > > > > > can you elaborate .
> > > > > > >
> > > > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
> > > > > > >
> > > > > > > > bq. record key ending with "12567"
> > > > > > > >
> > > > > > > > Can you clarify whether you're filtering by row key ?
> > > > > > > > If so, please take a look at PrefixFilter.
> > > > > > > > You can compose SuffixFilter which filters row key by
> comparing
> > > > > suffix.
> > > > > > > >
> > > > > > > > Cheers
> > > > > > > >
> > > > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > > > > > gangele397@gmail.com
> > > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi All I have get all the records using scan with end with
> > > > > particular
> > > > > > > > > string let
> > > > > > > > > say record key ending with "12567". I need to scan and get
> > all
> > > > such
> > > > > > > > result.
> > > > > > > > >
> > > > > > > > > I am values filter and do the substring there but i want to
> > > avoid
> > > > > > this
> > > > > > > > > because its slow.
> > > > > > > > >
> > > > > > > > > Regards
> > > > > > > > > jeetendra
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
Yes I used inside my project. This project will build the jar that jar I
added with classpath when running the job
On 17 April 2015 at 22:40, Ted Yu <yu...@gmail.com> wrote:
> bq. java.io.IOException: java.lang.ClassNotFoundException:
> com.insideview.yam.HbaseClient.SuffixFilter
>
> I assume you copied SuffixFilter class to your insideview project. How did
> you deploy the jar containing SuffixFilter to hbase cluster ?
> See HBASE-1936 for more details where hbase.dynamic.jars.dir was
> introduced.
>
> Cheers
>
> On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.reflect.InvocationTargetException
> > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> > ... 8 more
> > Caused by: org.apache.hadoop.hbase.exceptions.DeserializationException:
> > java.io.IOException: java.lang.ClassNotFoundException:
> > com.insideview.yam.HbaseClient.SuffixFilter
> > at
> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> > ... 12 more
> > Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> > com.insideview.yam.HbaseClient.SuffixFilter
> > at
> >
> >
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> > at
> > org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
> >
> > This is the error i m getting
> > On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> >
> > > Here is an example
> > > from
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> > > :
> > >
> > > byte[] suffix =
> > > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> > > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> > > SuffixFilter rowFilter = new SuffixFilter(suffix);
> > > Filter filter = new FilterList(linkFilter, rowFilter);
> > >
> > > You can use the following method from Bytes.java (in hbase-common) to
> > > obtain byte[] from "12345"
> > >
> > > public static byte[] toBytes(String s) {
> > >
> > > Cheers
> > >
> > > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <
> gangele397@gmail.com
> > >
> > > wrote:
> > >
> > > > filterRowKey what is these arguments? Can you please explain lets
> say I
> > > > have data like abcde_12345 similary way
> > > > and I want to scan all the records ending with "12345" what should I
> > pass
> > > > to this function?
> > > >
> > > >
> > > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
> > > >
> > > > > Please take a look
> > > > > at
> > > > >
> > > >
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > > > > in Phoenix repo.
> > > > >
> > > > > Processing is done in the following method:
> > > > >
> > > > > public boolean filterRowKey(byte[] buffer, int offset, int
> length)
> > {
> > > > >
> > > > > Note: the suffix is expressed in byte array.
> > > > >
> > > > > FYI
> > > > >
> > > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> > > gangele397@gmail.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Thanks for your reply.Ya I am filtering on row-key which ended
> with
> > > > > "12567"
> > > > > >
> > > > > > I did not understand properly what do you mean by "You can
> compose
> > > > > > SuffixFilter which filters row key by comparing suffix."
> > > > > >
> > > > > > can you elaborate .
> > > > > >
> > > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
> > > > > >
> > > > > > > bq. record key ending with "12567"
> > > > > > >
> > > > > > > Can you clarify whether you're filtering by row key ?
> > > > > > > If so, please take a look at PrefixFilter.
> > > > > > > You can compose SuffixFilter which filters row key by comparing
> > > > suffix.
> > > > > > >
> > > > > > > Cheers
> > > > > > >
> > > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > > > > gangele397@gmail.com
> > > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi All I have get all the records using scan with end with
> > > > particular
> > > > > > > > string let
> > > > > > > > say record key ending with "12567". I need to scan and get
> all
> > > such
> > > > > > > result.
> > > > > > > >
> > > > > > > > I am values filter and do the substring there but i want to
> > avoid
> > > > > this
> > > > > > > > because its slow.
> > > > > > > >
> > > > > > > > Regards
> > > > > > > > jeetendra
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
bq. java.io.IOException: java.lang.ClassNotFoundException:
com.insideview.yam.HbaseClient.SuffixFilter
I assume you copied SuffixFilter class to your insideview project. How did
you deploy the jar containing SuffixFilter to hbase cluster ?
See HBASE-1936 for more details where hbase.dynamic.jars.dir was introduced.
Cheers
On Fri, Apr 17, 2015 at 9:57 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
> ... 8 more
> Caused by: org.apache.hadoop.hbase.exceptions.DeserializationException:
> java.io.IOException: java.lang.ClassNotFoundException:
> com.insideview.yam.HbaseClient.SuffixFilter
> at
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
> ... 12 more
> Caused by: java.io.IOException: java.lang.ClassNotFoundException:
> com.insideview.yam.HbaseClient.SuffixFilter
> at
>
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
> at
> org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
>
> This is the error i m getting
> On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
>
> > Here is an example
> > from
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> > :
> >
> > byte[] suffix =
> > ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> > SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> > SuffixFilter rowFilter = new SuffixFilter(suffix);
> > Filter filter = new FilterList(linkFilter, rowFilter);
> >
> > You can use the following method from Bytes.java (in hbase-common) to
> > obtain byte[] from "12345"
> >
> > public static byte[] toBytes(String s) {
> >
> > Cheers
> >
> > On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <gangele397@gmail.com
> >
> > wrote:
> >
> > > filterRowKey what is these arguments? Can you please explain lets say I
> > > have data like abcde_12345 similary way
> > > and I want to scan all the records ending with "12345" what should I
> pass
> > > to this function?
> > >
> > >
> > > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > Please take a look
> > > > at
> > > >
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > > > in Phoenix repo.
> > > >
> > > > Processing is done in the following method:
> > > >
> > > > public boolean filterRowKey(byte[] buffer, int offset, int length)
> {
> > > >
> > > > Note: the suffix is expressed in byte array.
> > > >
> > > > FYI
> > > >
> > > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> > gangele397@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > Thanks for your reply.Ya I am filtering on row-key which ended with
> > > > "12567"
> > > > >
> > > > > I did not understand properly what do you mean by "You can compose
> > > > > SuffixFilter which filters row key by comparing suffix."
> > > > >
> > > > > can you elaborate .
> > > > >
> > > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
> > > > >
> > > > > > bq. record key ending with "12567"
> > > > > >
> > > > > > Can you clarify whether you're filtering by row key ?
> > > > > > If so, please take a look at PrefixFilter.
> > > > > > You can compose SuffixFilter which filters row key by comparing
> > > suffix.
> > > > > >
> > > > > > Cheers
> > > > > >
> > > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > > > gangele397@gmail.com
> > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hi All I have get all the records using scan with end with
> > > particular
> > > > > > > string let
> > > > > > > say record key ending with "12567". I need to scan and get all
> > such
> > > > > > result.
> > > > > > >
> > > > > > > I am values filter and do the substring there but i want to
> avoid
> > > > this
> > > > > > > because its slow.
> > > > > > >
> > > > > > > Regards
> > > > > > > jeetendra
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1439)
... 8 more
Caused by: org.apache.hadoop.hbase.exceptions.DeserializationException:
java.io.IOException: java.lang.ClassNotFoundException:
com.insideview.yam.HbaseClient.SuffixFilter
at
org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:406)
... 12 more
Caused by: java.io.IOException: java.lang.ClassNotFoundException:
com.insideview.yam.HbaseClient.SuffixFilter
at
org.apache.hadoop.hbase.protobuf.ProtobufUtil.toFilter(ProtobufUtil.java:1441)
at
org.apache.hadoop.hbase.filter.FilterList.parseFrom(FilterList.java:403)
This is the error i m getting
On 17 April 2015 at 20:32, Ted Yu <yu...@gmail.com> wrote:
> Here is an example
> from
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
> :
>
> byte[] suffix =
> ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
> SchemaUtil.getTableNameAsBytes(schemaName, tableName));
> SuffixFilter rowFilter = new SuffixFilter(suffix);
> Filter filter = new FilterList(linkFilter, rowFilter);
>
> You can use the following method from Bytes.java (in hbase-common) to
> obtain byte[] from "12345"
>
> public static byte[] toBytes(String s) {
>
> Cheers
>
> On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
> > filterRowKey what is these arguments? Can you please explain lets say I
> > have data like abcde_12345 similary way
> > and I want to scan all the records ending with "12345" what should I pass
> > to this function?
> >
> >
> > On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
> >
> > > Please take a look
> > > at
> > >
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > > in Phoenix repo.
> > >
> > > Processing is done in the following method:
> > >
> > > public boolean filterRowKey(byte[] buffer, int offset, int length) {
> > >
> > > Note: the suffix is expressed in byte array.
> > >
> > > FYI
> > >
> > > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <
> gangele397@gmail.com
> > >
> > > wrote:
> > >
> > > > Thanks for your reply.Ya I am filtering on row-key which ended with
> > > "12567"
> > > >
> > > > I did not understand properly what do you mean by "You can compose
> > > > SuffixFilter which filters row key by comparing suffix."
> > > >
> > > > can you elaborate .
> > > >
> > > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
> > > >
> > > > > bq. record key ending with "12567"
> > > > >
> > > > > Can you clarify whether you're filtering by row key ?
> > > > > If so, please take a look at PrefixFilter.
> > > > > You can compose SuffixFilter which filters row key by comparing
> > suffix.
> > > > >
> > > > > Cheers
> > > > >
> > > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > > gangele397@gmail.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Hi All I have get all the records using scan with end with
> > particular
> > > > > > string let
> > > > > > say record key ending with "12567". I need to scan and get all
> such
> > > > > result.
> > > > > >
> > > > > > I am values filter and do the substring there but i want to avoid
> > > this
> > > > > > because its slow.
> > > > > >
> > > > > > Regards
> > > > > > jeetendra
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
Here is an example
from phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
:
byte[] suffix =
ByteUtil.concat(QueryConstants.SEPARATOR_BYTE_ARRAY,
SchemaUtil.getTableNameAsBytes(schemaName, tableName));
SuffixFilter rowFilter = new SuffixFilter(suffix);
Filter filter = new FilterList(linkFilter, rowFilter);
You can use the following method from Bytes.java (in hbase-common) to
obtain byte[] from "12345"
public static byte[] toBytes(String s) {
Cheers
On Fri, Apr 17, 2015 at 7:50 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> filterRowKey what is these arguments? Can you please explain lets say I
> have data like abcde_12345 similary way
> and I want to scan all the records ending with "12345" what should I pass
> to this function?
>
>
> On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
>
> > Please take a look
> > at
> >
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> > in Phoenix repo.
> >
> > Processing is done in the following method:
> >
> > public boolean filterRowKey(byte[] buffer, int offset, int length) {
> >
> > Note: the suffix is expressed in byte array.
> >
> > FYI
> >
> > On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <gangele397@gmail.com
> >
> > wrote:
> >
> > > Thanks for your reply.Ya I am filtering on row-key which ended with
> > "12567"
> > >
> > > I did not understand properly what do you mean by "You can compose
> > > SuffixFilter which filters row key by comparing suffix."
> > >
> > > can you elaborate .
> > >
> > > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > bq. record key ending with "12567"
> > > >
> > > > Can you clarify whether you're filtering by row key ?
> > > > If so, please take a look at PrefixFilter.
> > > > You can compose SuffixFilter which filters row key by comparing
> suffix.
> > > >
> > > > Cheers
> > > >
> > > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> > gangele397@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > Hi All I have get all the records using scan with end with
> particular
> > > > > string let
> > > > > say record key ending with "12567". I need to scan and get all such
> > > > result.
> > > > >
> > > > > I am values filter and do the substring there but i want to avoid
> > this
> > > > > because its slow.
> > > > >
> > > > > Regards
> > > > > jeetendra
> > > > >
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
filterRowKey what is these arguments? Can you please explain lets say I
have data like abcde_12345 similary way
and I want to scan all the records ending with "12345" what should I pass
to this function?
On 16 April 2015 at 20:12, Ted Yu <yu...@gmail.com> wrote:
> Please take a look
> at
> phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
> in Phoenix repo.
>
> Processing is done in the following method:
>
> public boolean filterRowKey(byte[] buffer, int offset, int length) {
>
> Note: the suffix is expressed in byte array.
>
> FYI
>
> On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
> > Thanks for your reply.Ya I am filtering on row-key which ended with
> "12567"
> >
> > I did not understand properly what do you mean by "You can compose
> > SuffixFilter which filters row key by comparing suffix."
> >
> > can you elaborate .
> >
> > On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
> >
> > > bq. record key ending with "12567"
> > >
> > > Can you clarify whether you're filtering by row key ?
> > > If so, please take a look at PrefixFilter.
> > > You can compose SuffixFilter which filters row key by comparing suffix.
> > >
> > > Cheers
> > >
> > > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <
> gangele397@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi All I have get all the records using scan with end with particular
> > > > string let
> > > > say record key ending with "12567". I need to scan and get all such
> > > result.
> > > >
> > > > I am values filter and do the substring there but i want to avoid
> this
> > > > because its slow.
> > > >
> > > > Regards
> > > > jeetendra
> > > >
> > >
> >
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
Please take a look
at phoenix-core/src/main/java/org/apache/phoenix/coprocessor/SuffixFilter.java
in Phoenix repo.
Processing is done in the following method:
public boolean filterRowKey(byte[] buffer, int offset, int length) {
Note: the suffix is expressed in byte array.
FYI
On Thu, Apr 16, 2015 at 7:27 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> Thanks for your reply.Ya I am filtering on row-key which ended with "12567"
>
> I did not understand properly what do you mean by "You can compose
> SuffixFilter which filters row key by comparing suffix."
>
> can you elaborate .
>
> On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
>
> > bq. record key ending with "12567"
> >
> > Can you clarify whether you're filtering by row key ?
> > If so, please take a look at PrefixFilter.
> > You can compose SuffixFilter which filters row key by comparing suffix.
> >
> > Cheers
> >
> > On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <gangele397@gmail.com
> >
> > wrote:
> >
> > > Hi All I have get all the records using scan with end with particular
> > > string let
> > > say record key ending with "12567". I need to scan and get all such
> > result.
> > >
> > > I am values filter and do the substring there but i want to avoid this
> > > because its slow.
> > >
> > > Regards
> > > jeetendra
> > >
> >
>
Re: Need hlep in substring filter
Posted by Jeetendra Gangele <ga...@gmail.com>.
Thanks for your reply.Ya I am filtering on row-key which ended with "12567"
I did not understand properly what do you mean by "You can compose
SuffixFilter which filters row key by comparing suffix."
can you elaborate .
On 16 April 2015 at 19:49, Ted Yu <yu...@gmail.com> wrote:
> bq. record key ending with "12567"
>
> Can you clarify whether you're filtering by row key ?
> If so, please take a look at PrefixFilter.
> You can compose SuffixFilter which filters row key by comparing suffix.
>
> Cheers
>
> On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
> > Hi All I have get all the records using scan with end with particular
> > string let
> > say record key ending with "12567". I need to scan and get all such
> result.
> >
> > I am values filter and do the substring there but i want to avoid this
> > because its slow.
> >
> > Regards
> > jeetendra
> >
>
Re: Need hlep in substring filter
Posted by Ted Yu <yu...@gmail.com>.
bq. record key ending with "12567"
Can you clarify whether you're filtering by row key ?
If so, please take a look at PrefixFilter.
You can compose SuffixFilter which filters row key by comparing suffix.
Cheers
On Thu, Apr 16, 2015 at 7:06 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> Hi All I have get all the records using scan with end with particular
> string let
> say record key ending with "12567". I need to scan and get all such result.
>
> I am values filter and do the substring there but i want to avoid this
> because its slow.
>
> Regards
> jeetendra
>