You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by "F. T." <bi...@hotmail.fr> on 2017/05/12 14:59:27 UTC

HBASE and MOB

Hi all,

I'd like to use MOB in HBase to store PDF files. I'm using Hbase 1.2.3 but I'get this error creating a table with MOB column : NameError: uninitialized constant IS_MOB.

A lot of web sites (including Apache official web site) talk about the patch 11339 or HBase 2.0.0, but, I don't find any explanation about the way to install this patch and

I can't find the 2.0.0 version anywhere. So I'm completly lost. Could you help me please ?


Re: HBASE and MOB

Posted by Ashish Singhi <as...@apache.org>.
OK. Agree for not back porting it to branch-1 considering the above fair
comments.
Thanks for the comments.

Regards,
Ashish

On Tue, May 16, 2017 at 2:20 AM, Huaxiang Sun <hs...@cloudera.com> wrote:

> +1, not a trivial effort.
>
> > On May 15, 2017, at 1:31 PM, Mikhail Antonov <ol...@gmail.com>
> wrote:
> >
> > +1 for not trying to backport massive new features to branch-1.
> >
> > IMO Branch-1 release lines should be continuing the path towards
> > maintenance mode only.
> >
> > -Mikhail
> >
> > On Mon, May 15, 2017 at 1:21 PM, Ted Yu <yu...@gmail.com> wrote:
> >
> >> bq. concentrate on getting MOB out the door in 2.0.
> >>
> >> +1
> >>
> >>
> >> On Mon, May 15, 2017 at 1:11 PM, Sean Busbey <bu...@apache.org> wrote:
> >>
> >>> -user@hbase to bcc (I encourage folks interest to subscribe to
> dev@hbase
> >> )
> >>>
> >>> Personally, I'd rather see us concentrate on getting MOB out the door
> in
> >>> 2.0.
> >>>
> >>> branch-1 is now over 2 years old; I'd want some rigorous proof that
> we're
> >>> not setting our downstream users up for surprises by making major
> changes
> >>> to the critical path.
> >>>
> >>> On May 15, 2017 06:45, "ashish singhi" <as...@huawei.com>
> wrote:
> >>>
> >>>> Hi.
> >>>>
> >>>> Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to
> >>>> branch-1 ?
> >>>>
> >>>> Even we have customers using this feature and it requires lots of
> >> effort
> >>>> to backport MOB patches from master branch to the released versions as
> >>> the
> >>>> code base has lots of differences.
> >>>>
> >>>> Regards,
> >>>> Ashish
> >>>>
> >>>> -----Original Message-----
> >>>> From: Ted Yu [mailto:yuzhihong@gmail.com]
> >>>> Sent: 12 May 2017 22:25
> >>>> To: user@hbase.apache.org
> >>>> Subject: Re: HBASE and MOB
> >>>>
> >>>> MOB is also backported in HDP 2.5.x
> >>>>
> >>>> FYI
> >>>>
> >>>> On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com>
> >>> wrote:
> >>>>
> >>>>> Backporting MOB wont be a trivial task.
> >>>>> AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
> >>>>> apache HBase1.x branch yet). It might be easier to just use CDH for
> >>> MOB.
> >>>>>
> >>>>> On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
> >>>>> jean-marc@spaggiari.org> wrote:
> >>>>>
> >>>>>> Thanks for those details.
> >>>>>>
> >>>>>> How big are you PDF? Are they all small size? If they are not above
> >>>>>> 1MB, MOBs will not really be 100% mandatory. Even if few of them
> >> are
> >>>> above.
> >>>>>>
> >>>>>> If you want to apply the patch on another branch,this is what is
> >>>>>> called a back port (like Ted said before) and will require a pretty
> >>>>>> good amount of work. You can jump on that, but if you are not used
> >>>>>> to the HBase code, it might be a pretty big challenge...
> >>>>>>
> >>>>>> Another way is to look for an HBase distribution that already
> >>>>>> includes
> >>>>> the
> >>>>>> MOB code already.
> >>>>>>
> >>>>>> JMS
> >>>>>>
> >>>>>> 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> >>>>>>
> >>>>>>> Hi Jean Marc
> >>>>>>>
> >>>>>>> I'm using a 1.2.3 version. I downloaded a "bin" version from
> >>>>>>> Apache official web site. Maybe I've to install it from the "src"
> >>>>>>> option with
> >>>>>> mvn ?
> >>>>>>>
> >>>>>>> I would like index PDF into Hbase and use it in a Solr
> >> collection.
> >>>>>>>
> >>>>>>> In fact I would like reproduce this process :
> >>>>>>> http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> >>>>>>> pdfs-at-scale-using-fewer-than-50-lines-of-code/
> >>>>>>>
> >>>>>>>
> >>>>>>> But maybe is there another solution to reproduce it .
> >>>>>>>
> >>>>>>> Fred
> >>>>>>>
> >>>>>>>
> >>>>>>> ________________________________
> >>>>>>> De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé :
> >>>>>>> vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
> >>>>>>>
> >>>>>>> Hi Fred,
> >>>>>>>
> >>>>>>> Can you please confirm the following information?
> >>>>>>>
> >>>>>>> 1) What exact version of HBase are you using? From a
> >> distribution,
> >>>>> build
> >>>>>> by
> >>>>>>> yourself, from the JARs, etc.
> >>>>>>> 2) Why do you think you need the MOB feature
> >>>>>>> 3) Is an upgrade an option for you or not really.
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>>
> >>>>>>> JMS
> >>>>>>>
> >>>>>>>
> >>>>>>> 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> >>>>>>>
> >>>>>>>> It is defined here in
> >>>>>>>> hbase-client/src/main/java/org/apache/hadoop/hbase/
> >>>>>>> HColumnDescriptor.java:
> >>>>>>>>  public static final String IS_MOB = "IS_MOB";
> >>>>>>>>
> >>>>>>>> MOB feature hasn't been backported to branch-1 (or earlier
> >>>> releases).
> >>>>>>>>
> >>>>>>>> Looks like you're using a vendor's release.
> >>>>>>>>
> >>>>>>>> Consider contacting the corresponding mailing list if you are
> >>>> stuck.
> >>>>>>>>
> >>>>>>>> On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr>
> >>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi all,
> >>>>>>>>>
> >>>>>>>>> I'd like to use MOB in HBase to store PDF files. I'm using
> >>>>>>>>> Hbase
> >>>>>> 1.2.3
> >>>>>>>> but
> >>>>>>>>> I'get this error creating a table with MOB column :
> >> NameError:
> >>>>>>>>> uninitialized constant IS_MOB.
> >>>>>>>>>
> >>>>>>>>> A lot of web sites (including Apache official web site) talk
> >>>>>>>>> about
> >>>>>> the
> >>>>>>>>> patch 11339 or HBase 2.0.0, but, I don't find any explanation
> >>>>>>>>> about
> >>>>>> the
> >>>>>>>> way
> >>>>>>>>> to install this patch and
> >>>>>>>>>
> >>>>>>>>> I can't find the 2.0.0 version anywhere. So I'm completly
> >> lost.
> >>>>> Could
> >>>>>>> you
> >>>>>>>>> help me please ?
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> Thanks & Regards,
> >>>>> Anil Gupta
> >>>>>
> >>>>
> >>>
> >>
> >
> >
> >
> > --
> > Thanks,
> > Michael Antonov
>
>

Re: HBASE and MOB

Posted by Huaxiang Sun <hs...@cloudera.com>.
+1, not a trivial effort.

> On May 15, 2017, at 1:31 PM, Mikhail Antonov <ol...@gmail.com> wrote:
> 
> +1 for not trying to backport massive new features to branch-1.
> 
> IMO Branch-1 release lines should be continuing the path towards
> maintenance mode only.
> 
> -Mikhail
> 
> On Mon, May 15, 2017 at 1:21 PM, Ted Yu <yu...@gmail.com> wrote:
> 
>> bq. concentrate on getting MOB out the door in 2.0.
>> 
>> +1
>> 
>> 
>> On Mon, May 15, 2017 at 1:11 PM, Sean Busbey <bu...@apache.org> wrote:
>> 
>>> -user@hbase to bcc (I encourage folks interest to subscribe to dev@hbase
>> )
>>> 
>>> Personally, I'd rather see us concentrate on getting MOB out the door in
>>> 2.0.
>>> 
>>> branch-1 is now over 2 years old; I'd want some rigorous proof that we're
>>> not setting our downstream users up for surprises by making major changes
>>> to the critical path.
>>> 
>>> On May 15, 2017 06:45, "ashish singhi" <as...@huawei.com> wrote:
>>> 
>>>> Hi.
>>>> 
>>>> Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to
>>>> branch-1 ?
>>>> 
>>>> Even we have customers using this feature and it requires lots of
>> effort
>>>> to backport MOB patches from master branch to the released versions as
>>> the
>>>> code base has lots of differences.
>>>> 
>>>> Regards,
>>>> Ashish
>>>> 
>>>> -----Original Message-----
>>>> From: Ted Yu [mailto:yuzhihong@gmail.com]
>>>> Sent: 12 May 2017 22:25
>>>> To: user@hbase.apache.org
>>>> Subject: Re: HBASE and MOB
>>>> 
>>>> MOB is also backported in HDP 2.5.x
>>>> 
>>>> FYI
>>>> 
>>>> On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com>
>>> wrote:
>>>> 
>>>>> Backporting MOB wont be a trivial task.
>>>>> AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
>>>>> apache HBase1.x branch yet). It might be easier to just use CDH for
>>> MOB.
>>>>> 
>>>>> On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
>>>>> jean-marc@spaggiari.org> wrote:
>>>>> 
>>>>>> Thanks for those details.
>>>>>> 
>>>>>> How big are you PDF? Are they all small size? If they are not above
>>>>>> 1MB, MOBs will not really be 100% mandatory. Even if few of them
>> are
>>>> above.
>>>>>> 
>>>>>> If you want to apply the patch on another branch,this is what is
>>>>>> called a back port (like Ted said before) and will require a pretty
>>>>>> good amount of work. You can jump on that, but if you are not used
>>>>>> to the HBase code, it might be a pretty big challenge...
>>>>>> 
>>>>>> Another way is to look for an HBase distribution that already
>>>>>> includes
>>>>> the
>>>>>> MOB code already.
>>>>>> 
>>>>>> JMS
>>>>>> 
>>>>>> 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
>>>>>> 
>>>>>>> Hi Jean Marc
>>>>>>> 
>>>>>>> I'm using a 1.2.3 version. I downloaded a "bin" version from
>>>>>>> Apache official web site. Maybe I've to install it from the "src"
>>>>>>> option with
>>>>>> mvn ?
>>>>>>> 
>>>>>>> I would like index PDF into Hbase and use it in a Solr
>> collection.
>>>>>>> 
>>>>>>> In fact I would like reproduce this process :
>>>>>>> http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
>>>>>>> pdfs-at-scale-using-fewer-than-50-lines-of-code/
>>>>>>> 
>>>>>>> 
>>>>>>> But maybe is there another solution to reproduce it .
>>>>>>> 
>>>>>>> Fred
>>>>>>> 
>>>>>>> 
>>>>>>> ________________________________
>>>>>>> De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé :
>>>>>>> vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
>>>>>>> 
>>>>>>> Hi Fred,
>>>>>>> 
>>>>>>> Can you please confirm the following information?
>>>>>>> 
>>>>>>> 1) What exact version of HBase are you using? From a
>> distribution,
>>>>> build
>>>>>> by
>>>>>>> yourself, from the JARs, etc.
>>>>>>> 2) Why do you think you need the MOB feature
>>>>>>> 3) Is an upgrade an option for you or not really.
>>>>>>> 
>>>>>>> Thanks,
>>>>>>> 
>>>>>>> JMS
>>>>>>> 
>>>>>>> 
>>>>>>> 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
>>>>>>> 
>>>>>>>> It is defined here in
>>>>>>>> hbase-client/src/main/java/org/apache/hadoop/hbase/
>>>>>>> HColumnDescriptor.java:
>>>>>>>>  public static final String IS_MOB = "IS_MOB";
>>>>>>>> 
>>>>>>>> MOB feature hasn't been backported to branch-1 (or earlier
>>>> releases).
>>>>>>>> 
>>>>>>>> Looks like you're using a vendor's release.
>>>>>>>> 
>>>>>>>> Consider contacting the corresponding mailing list if you are
>>>> stuck.
>>>>>>>> 
>>>>>>>> On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr>
>>> wrote:
>>>>>>>> 
>>>>>>>>> Hi all,
>>>>>>>>> 
>>>>>>>>> I'd like to use MOB in HBase to store PDF files. I'm using
>>>>>>>>> Hbase
>>>>>> 1.2.3
>>>>>>>> but
>>>>>>>>> I'get this error creating a table with MOB column :
>> NameError:
>>>>>>>>> uninitialized constant IS_MOB.
>>>>>>>>> 
>>>>>>>>> A lot of web sites (including Apache official web site) talk
>>>>>>>>> about
>>>>>> the
>>>>>>>>> patch 11339 or HBase 2.0.0, but, I don't find any explanation
>>>>>>>>> about
>>>>>> the
>>>>>>>> way
>>>>>>>>> to install this patch and
>>>>>>>>> 
>>>>>>>>> I can't find the 2.0.0 version anywhere. So I'm completly
>> lost.
>>>>> Could
>>>>>>> you
>>>>>>>>> help me please ?
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> Thanks & Regards,
>>>>> Anil Gupta
>>>>> 
>>>> 
>>> 
>> 
> 
> 
> 
> -- 
> Thanks,
> Michael Antonov


Re: HBASE and MOB

Posted by Mikhail Antonov <ol...@gmail.com>.
+1 for not trying to backport massive new features to branch-1.

IMO Branch-1 release lines should be continuing the path towards
maintenance mode only.

-Mikhail

On Mon, May 15, 2017 at 1:21 PM, Ted Yu <yu...@gmail.com> wrote:

> bq. concentrate on getting MOB out the door in 2.0.
>
> +1
>
>
> On Mon, May 15, 2017 at 1:11 PM, Sean Busbey <bu...@apache.org> wrote:
>
> > -user@hbase to bcc (I encourage folks interest to subscribe to dev@hbase
> )
> >
> > Personally, I'd rather see us concentrate on getting MOB out the door in
> > 2.0.
> >
> > branch-1 is now over 2 years old; I'd want some rigorous proof that we're
> > not setting our downstream users up for surprises by making major changes
> > to the critical path.
> >
> > On May 15, 2017 06:45, "ashish singhi" <as...@huawei.com> wrote:
> >
> > > Hi.
> > >
> > > Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to
> > > branch-1 ?
> > >
> > > Even we have customers using this feature and it requires lots of
> effort
> > > to backport MOB patches from master branch to the released versions as
> > the
> > > code base has lots of differences.
> > >
> > > Regards,
> > > Ashish
> > >
> > > -----Original Message-----
> > > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > > Sent: 12 May 2017 22:25
> > > To: user@hbase.apache.org
> > > Subject: Re: HBASE and MOB
> > >
> > > MOB is also backported in HDP 2.5.x
> > >
> > > FYI
> > >
> > > On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com>
> > wrote:
> > >
> > > > Backporting MOB wont be a trivial task.
> > > > AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
> > > > apache HBase1.x branch yet). It might be easier to just use CDH for
> > MOB.
> > > >
> > > > On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
> > > > jean-marc@spaggiari.org> wrote:
> > > >
> > > > > Thanks for those details.
> > > > >
> > > > > How big are you PDF? Are they all small size? If they are not above
> > > > > 1MB, MOBs will not really be 100% mandatory. Even if few of them
> are
> > > above.
> > > > >
> > > > > If you want to apply the patch on another branch,this is what is
> > > > > called a back port (like Ted said before) and will require a pretty
> > > > > good amount of work. You can jump on that, but if you are not used
> > > > > to the HBase code, it might be a pretty big challenge...
> > > > >
> > > > > Another way is to look for an HBase distribution that already
> > > > > includes
> > > > the
> > > > > MOB code already.
> > > > >
> > > > > JMS
> > > > >
> > > > > 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> > > > >
> > > > > > Hi Jean Marc
> > > > > >
> > > > > > I'm using a 1.2.3 version. I downloaded a "bin" version from
> > > > > > Apache official web site. Maybe I've to install it from the "src"
> > > > > > option with
> > > > > mvn ?
> > > > > >
> > > > > > I would like index PDF into Hbase and use it in a Solr
> collection.
> > > > > >
> > > > > > In fact I would like reproduce this process :
> > > > > > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > > > > > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> > > > > >
> > > > > >
> > > > > > But maybe is there another solution to reproduce it .
> > > > > >
> > > > > > Fred
> > > > > >
> > > > > >
> > > > > > ________________________________
> > > > > > De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé :
> > > > > > vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
> > > > > >
> > > > > > Hi Fred,
> > > > > >
> > > > > > Can you please confirm the following information?
> > > > > >
> > > > > > 1) What exact version of HBase are you using? From a
> distribution,
> > > > build
> > > > > by
> > > > > > yourself, from the JARs, etc.
> > > > > > 2) Why do you think you need the MOB feature
> > > > > > 3) Is an upgrade an option for you or not really.
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > JMS
> > > > > >
> > > > > >
> > > > > > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > > > >
> > > > > > > It is defined here in
> > > > > > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > > > > > HColumnDescriptor.java:
> > > > > > >   public static final String IS_MOB = "IS_MOB";
> > > > > > >
> > > > > > > MOB feature hasn't been backported to branch-1 (or earlier
> > > releases).
> > > > > > >
> > > > > > > Looks like you're using a vendor's release.
> > > > > > >
> > > > > > > Consider contacting the corresponding mailing list if you are
> > > stuck.
> > > > > > >
> > > > > > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr>
> > wrote:
> > > > > > >
> > > > > > > > Hi all,
> > > > > > > >
> > > > > > > > I'd like to use MOB in HBase to store PDF files. I'm using
> > > > > > > > Hbase
> > > > > 1.2.3
> > > > > > > but
> > > > > > > > I'get this error creating a table with MOB column :
> NameError:
> > > > > > > > uninitialized constant IS_MOB.
> > > > > > > >
> > > > > > > > A lot of web sites (including Apache official web site) talk
> > > > > > > > about
> > > > > the
> > > > > > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation
> > > > > > > > about
> > > > > the
> > > > > > > way
> > > > > > > > to install this patch and
> > > > > > > >
> > > > > > > > I can't find the 2.0.0 version anywhere. So I'm completly
> lost.
> > > > Could
> > > > > > you
> > > > > > > > help me please ?
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Gupta
> > > >
> > >
> >
>



-- 
Thanks,
Michael Antonov

Re: HBASE and MOB

Posted by Ted Yu <yu...@gmail.com>.
bq. concentrate on getting MOB out the door in 2.0.

+1


On Mon, May 15, 2017 at 1:11 PM, Sean Busbey <bu...@apache.org> wrote:

> -user@hbase to bcc (I encourage folks interest to subscribe to dev@hbase)
>
> Personally, I'd rather see us concentrate on getting MOB out the door in
> 2.0.
>
> branch-1 is now over 2 years old; I'd want some rigorous proof that we're
> not setting our downstream users up for surprises by making major changes
> to the critical path.
>
> On May 15, 2017 06:45, "ashish singhi" <as...@huawei.com> wrote:
>
> > Hi.
> >
> > Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to
> > branch-1 ?
> >
> > Even we have customers using this feature and it requires lots of effort
> > to backport MOB patches from master branch to the released versions as
> the
> > code base has lots of differences.
> >
> > Regards,
> > Ashish
> >
> > -----Original Message-----
> > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > Sent: 12 May 2017 22:25
> > To: user@hbase.apache.org
> > Subject: Re: HBASE and MOB
> >
> > MOB is also backported in HDP 2.5.x
> >
> > FYI
> >
> > On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com>
> wrote:
> >
> > > Backporting MOB wont be a trivial task.
> > > AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
> > > apache HBase1.x branch yet). It might be easier to just use CDH for
> MOB.
> > >
> > > On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
> > > jean-marc@spaggiari.org> wrote:
> > >
> > > > Thanks for those details.
> > > >
> > > > How big are you PDF? Are they all small size? If they are not above
> > > > 1MB, MOBs will not really be 100% mandatory. Even if few of them are
> > above.
> > > >
> > > > If you want to apply the patch on another branch,this is what is
> > > > called a back port (like Ted said before) and will require a pretty
> > > > good amount of work. You can jump on that, but if you are not used
> > > > to the HBase code, it might be a pretty big challenge...
> > > >
> > > > Another way is to look for an HBase distribution that already
> > > > includes
> > > the
> > > > MOB code already.
> > > >
> > > > JMS
> > > >
> > > > 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> > > >
> > > > > Hi Jean Marc
> > > > >
> > > > > I'm using a 1.2.3 version. I downloaded a "bin" version from
> > > > > Apache official web site. Maybe I've to install it from the "src"
> > > > > option with
> > > > mvn ?
> > > > >
> > > > > I would like index PDF into Hbase and use it in a Solr collection.
> > > > >
> > > > > In fact I would like reproduce this process :
> > > > > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > > > > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> > > > >
> > > > >
> > > > > But maybe is there another solution to reproduce it .
> > > > >
> > > > > Fred
> > > > >
> > > > >
> > > > > ________________________________
> > > > > De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé :
> > > > > vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
> > > > >
> > > > > Hi Fred,
> > > > >
> > > > > Can you please confirm the following information?
> > > > >
> > > > > 1) What exact version of HBase are you using? From a distribution,
> > > build
> > > > by
> > > > > yourself, from the JARs, etc.
> > > > > 2) Why do you think you need the MOB feature
> > > > > 3) Is an upgrade an option for you or not really.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > JMS
> > > > >
> > > > >
> > > > > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > > >
> > > > > > It is defined here in
> > > > > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > > > > HColumnDescriptor.java:
> > > > > >   public static final String IS_MOB = "IS_MOB";
> > > > > >
> > > > > > MOB feature hasn't been backported to branch-1 (or earlier
> > releases).
> > > > > >
> > > > > > Looks like you're using a vendor's release.
> > > > > >
> > > > > > Consider contacting the corresponding mailing list if you are
> > stuck.
> > > > > >
> > > > > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr>
> wrote:
> > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > I'd like to use MOB in HBase to store PDF files. I'm using
> > > > > > > Hbase
> > > > 1.2.3
> > > > > > but
> > > > > > > I'get this error creating a table with MOB column : NameError:
> > > > > > > uninitialized constant IS_MOB.
> > > > > > >
> > > > > > > A lot of web sites (including Apache official web site) talk
> > > > > > > about
> > > > the
> > > > > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation
> > > > > > > about
> > > > the
> > > > > > way
> > > > > > > to install this patch and
> > > > > > >
> > > > > > > I can't find the 2.0.0 version anywhere. So I'm completly lost.
> > > Could
> > > > > you
> > > > > > > help me please ?
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Gupta
> > >
> >
>

RE: HBASE and MOB

Posted by Sean Busbey <bu...@apache.org>.
-user@hbase to bcc (I encourage folks interest to subscribe to dev@hbase)

Personally, I'd rather see us concentrate on getting MOB out the door in
2.0.

branch-1 is now over 2 years old; I'd want some rigorous proof that we're
not setting our downstream users up for surprises by making major changes
to the critical path.

On May 15, 2017 06:45, "ashish singhi" <as...@huawei.com> wrote:

> Hi.
>
> Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to
> branch-1 ?
>
> Even we have customers using this feature and it requires lots of effort
> to backport MOB patches from master branch to the released versions as the
> code base has lots of differences.
>
> Regards,
> Ashish
>
> -----Original Message-----
> From: Ted Yu [mailto:yuzhihong@gmail.com]
> Sent: 12 May 2017 22:25
> To: user@hbase.apache.org
> Subject: Re: HBASE and MOB
>
> MOB is also backported in HDP 2.5.x
>
> FYI
>
> On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com> wrote:
>
> > Backporting MOB wont be a trivial task.
> > AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
> > apache HBase1.x branch yet). It might be easier to just use CDH for MOB.
> >
> > On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > Thanks for those details.
> > >
> > > How big are you PDF? Are they all small size? If they are not above
> > > 1MB, MOBs will not really be 100% mandatory. Even if few of them are
> above.
> > >
> > > If you want to apply the patch on another branch,this is what is
> > > called a back port (like Ted said before) and will require a pretty
> > > good amount of work. You can jump on that, but if you are not used
> > > to the HBase code, it might be a pretty big challenge...
> > >
> > > Another way is to look for an HBase distribution that already
> > > includes
> > the
> > > MOB code already.
> > >
> > > JMS
> > >
> > > 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> > >
> > > > Hi Jean Marc
> > > >
> > > > I'm using a 1.2.3 version. I downloaded a "bin" version from
> > > > Apache official web site. Maybe I've to install it from the "src"
> > > > option with
> > > mvn ?
> > > >
> > > > I would like index PDF into Hbase and use it in a Solr collection.
> > > >
> > > > In fact I would like reproduce this process :
> > > > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > > > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> > > >
> > > >
> > > > But maybe is there another solution to reproduce it .
> > > >
> > > > Fred
> > > >
> > > >
> > > > ________________________________
> > > > De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé :
> > > > vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
> > > >
> > > > Hi Fred,
> > > >
> > > > Can you please confirm the following information?
> > > >
> > > > 1) What exact version of HBase are you using? From a distribution,
> > build
> > > by
> > > > yourself, from the JARs, etc.
> > > > 2) Why do you think you need the MOB feature
> > > > 3) Is an upgrade an option for you or not really.
> > > >
> > > > Thanks,
> > > >
> > > > JMS
> > > >
> > > >
> > > > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > >
> > > > > It is defined here in
> > > > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > > > HColumnDescriptor.java:
> > > > >   public static final String IS_MOB = "IS_MOB";
> > > > >
> > > > > MOB feature hasn't been backported to branch-1 (or earlier
> releases).
> > > > >
> > > > > Looks like you're using a vendor's release.
> > > > >
> > > > > Consider contacting the corresponding mailing list if you are
> stuck.
> > > > >
> > > > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
> > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > I'd like to use MOB in HBase to store PDF files. I'm using
> > > > > > Hbase
> > > 1.2.3
> > > > > but
> > > > > > I'get this error creating a table with MOB column : NameError:
> > > > > > uninitialized constant IS_MOB.
> > > > > >
> > > > > > A lot of web sites (including Apache official web site) talk
> > > > > > about
> > > the
> > > > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation
> > > > > > about
> > > the
> > > > > way
> > > > > > to install this patch and
> > > > > >
> > > > > > I can't find the 2.0.0 version anywhere. So I'm completly lost.
> > Could
> > > > you
> > > > > > help me please ?
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
>

RE: HBASE and MOB

Posted by Sean Busbey <bu...@apache.org>.
-user@hbase to bcc (I encourage folks interest to subscribe to dev@hbase)

Personally, I'd rather see us concentrate on getting MOB out the door in
2.0.

branch-1 is now over 2 years old; I'd want some rigorous proof that we're
not setting our downstream users up for surprises by making major changes
to the critical path.

On May 15, 2017 06:45, "ashish singhi" <as...@huawei.com> wrote:

> Hi.
>
> Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to
> branch-1 ?
>
> Even we have customers using this feature and it requires lots of effort
> to backport MOB patches from master branch to the released versions as the
> code base has lots of differences.
>
> Regards,
> Ashish
>
> -----Original Message-----
> From: Ted Yu [mailto:yuzhihong@gmail.com]
> Sent: 12 May 2017 22:25
> To: user@hbase.apache.org
> Subject: Re: HBASE and MOB
>
> MOB is also backported in HDP 2.5.x
>
> FYI
>
> On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com> wrote:
>
> > Backporting MOB wont be a trivial task.
> > AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
> > apache HBase1.x branch yet). It might be easier to just use CDH for MOB.
> >
> > On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > Thanks for those details.
> > >
> > > How big are you PDF? Are they all small size? If they are not above
> > > 1MB, MOBs will not really be 100% mandatory. Even if few of them are
> above.
> > >
> > > If you want to apply the patch on another branch,this is what is
> > > called a back port (like Ted said before) and will require a pretty
> > > good amount of work. You can jump on that, but if you are not used
> > > to the HBase code, it might be a pretty big challenge...
> > >
> > > Another way is to look for an HBase distribution that already
> > > includes
> > the
> > > MOB code already.
> > >
> > > JMS
> > >
> > > 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> > >
> > > > Hi Jean Marc
> > > >
> > > > I'm using a 1.2.3 version. I downloaded a "bin" version from
> > > > Apache official web site. Maybe I've to install it from the "src"
> > > > option with
> > > mvn ?
> > > >
> > > > I would like index PDF into Hbase and use it in a Solr collection.
> > > >
> > > > In fact I would like reproduce this process :
> > > > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > > > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> > > >
> > > >
> > > > But maybe is there another solution to reproduce it .
> > > >
> > > > Fred
> > > >
> > > >
> > > > ________________________________
> > > > De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé :
> > > > vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
> > > >
> > > > Hi Fred,
> > > >
> > > > Can you please confirm the following information?
> > > >
> > > > 1) What exact version of HBase are you using? From a distribution,
> > build
> > > by
> > > > yourself, from the JARs, etc.
> > > > 2) Why do you think you need the MOB feature
> > > > 3) Is an upgrade an option for you or not really.
> > > >
> > > > Thanks,
> > > >
> > > > JMS
> > > >
> > > >
> > > > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > >
> > > > > It is defined here in
> > > > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > > > HColumnDescriptor.java:
> > > > >   public static final String IS_MOB = "IS_MOB";
> > > > >
> > > > > MOB feature hasn't been backported to branch-1 (or earlier
> releases).
> > > > >
> > > > > Looks like you're using a vendor's release.
> > > > >
> > > > > Consider contacting the corresponding mailing list if you are
> stuck.
> > > > >
> > > > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
> > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > I'd like to use MOB in HBase to store PDF files. I'm using
> > > > > > Hbase
> > > 1.2.3
> > > > > but
> > > > > > I'get this error creating a table with MOB column : NameError:
> > > > > > uninitialized constant IS_MOB.
> > > > > >
> > > > > > A lot of web sites (including Apache official web site) talk
> > > > > > about
> > > the
> > > > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation
> > > > > > about
> > > the
> > > > > way
> > > > > > to install this patch and
> > > > > >
> > > > > > I can't find the 2.0.0 version anywhere. So I'm completly lost.
> > Could
> > > > you
> > > > > > help me please ?
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
>

RE: HBASE and MOB

Posted by ashish singhi <as...@huawei.com>.
Hi.

Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to branch-1 ?

Even we have customers using this feature and it requires lots of effort to backport MOB patches from master branch to the released versions as the code base has lots of differences.

Regards,
Ashish

-----Original Message-----
From: Ted Yu [mailto:yuzhihong@gmail.com] 
Sent: 12 May 2017 22:25
To: user@hbase.apache.org
Subject: Re: HBASE and MOB

MOB is also backported in HDP 2.5.x

FYI

On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com> wrote:

> Backporting MOB wont be a trivial task.
> AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in 
> apache HBase1.x branch yet). It might be easier to just use CDH for MOB.
>
> On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari < 
> jean-marc@spaggiari.org> wrote:
>
> > Thanks for those details.
> >
> > How big are you PDF? Are they all small size? If they are not above 
> > 1MB, MOBs will not really be 100% mandatory. Even if few of them are above.
> >
> > If you want to apply the patch on another branch,this is what is 
> > called a back port (like Ted said before) and will require a pretty 
> > good amount of work. You can jump on that, but if you are not used 
> > to the HBase code, it might be a pretty big challenge...
> >
> > Another way is to look for an HBase distribution that already 
> > includes
> the
> > MOB code already.
> >
> > JMS
> >
> > 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> >
> > > Hi Jean Marc
> > >
> > > I'm using a 1.2.3 version. I downloaded a "bin" version from 
> > > Apache official web site. Maybe I've to install it from the "src" 
> > > option with
> > mvn ?
> > >
> > > I would like index PDF into Hbase and use it in a Solr collection.
> > >
> > > In fact I would like reproduce this process :
> > > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> > >
> > >
> > > But maybe is there another solution to reproduce it .
> > >
> > > Fred
> > >
> > >
> > > ________________________________
> > > De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé : 
> > > vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
> > >
> > > Hi Fred,
> > >
> > > Can you please confirm the following information?
> > >
> > > 1) What exact version of HBase are you using? From a distribution,
> build
> > by
> > > yourself, from the JARs, etc.
> > > 2) Why do you think you need the MOB feature
> > > 3) Is an upgrade an option for you or not really.
> > >
> > > Thanks,
> > >
> > > JMS
> > >
> > >
> > > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > >
> > > > It is defined here in
> > > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > > HColumnDescriptor.java:
> > > >   public static final String IS_MOB = "IS_MOB";
> > > >
> > > > MOB feature hasn't been backported to branch-1 (or earlier releases).
> > > >
> > > > Looks like you're using a vendor's release.
> > > >
> > > > Consider contacting the corresponding mailing list if you are stuck.
> > > >
> > > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > I'd like to use MOB in HBase to store PDF files. I'm using 
> > > > > Hbase
> > 1.2.3
> > > > but
> > > > > I'get this error creating a table with MOB column : NameError:
> > > > > uninitialized constant IS_MOB.
> > > > >
> > > > > A lot of web sites (including Apache official web site) talk 
> > > > > about
> > the
> > > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation 
> > > > > about
> > the
> > > > way
> > > > > to install this patch and
> > > > >
> > > > > I can't find the 2.0.0 version anywhere. So I'm completly lost.
> Could
> > > you
> > > > > help me please ?
> > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>

RE: HBASE and MOB

Posted by ashish singhi <as...@huawei.com>.
Hi.

Can we revive HBASE-15370: Backport Moderate Object Storage (MOB) to branch-1 ?

Even we have customers using this feature and it requires lots of effort to backport MOB patches from master branch to the released versions as the code base has lots of differences.

Regards,
Ashish

-----Original Message-----
From: Ted Yu [mailto:yuzhihong@gmail.com] 
Sent: 12 May 2017 22:25
To: user@hbase.apache.org
Subject: Re: HBASE and MOB

MOB is also backported in HDP 2.5.x

FYI

On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com> wrote:

> Backporting MOB wont be a trivial task.
> AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in 
> apache HBase1.x branch yet). It might be easier to just use CDH for MOB.
>
> On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari < 
> jean-marc@spaggiari.org> wrote:
>
> > Thanks for those details.
> >
> > How big are you PDF? Are they all small size? If they are not above 
> > 1MB, MOBs will not really be 100% mandatory. Even if few of them are above.
> >
> > If you want to apply the patch on another branch,this is what is 
> > called a back port (like Ted said before) and will require a pretty 
> > good amount of work. You can jump on that, but if you are not used 
> > to the HBase code, it might be a pretty big challenge...
> >
> > Another way is to look for an HBase distribution that already 
> > includes
> the
> > MOB code already.
> >
> > JMS
> >
> > 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> >
> > > Hi Jean Marc
> > >
> > > I'm using a 1.2.3 version. I downloaded a "bin" version from 
> > > Apache official web site. Maybe I've to install it from the "src" 
> > > option with
> > mvn ?
> > >
> > > I would like index PDF into Hbase and use it in a Solr collection.
> > >
> > > In fact I would like reproduce this process :
> > > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> > >
> > >
> > > But maybe is there another solution to reproduce it .
> > >
> > > Fred
> > >
> > >
> > > ________________________________
> > > De : Jean-Marc Spaggiari <je...@spaggiari.org> Envoyé : 
> > > vendredi 12 mai 2017 17:06 À : user Objet : Re: HBASE and MOB
> > >
> > > Hi Fred,
> > >
> > > Can you please confirm the following information?
> > >
> > > 1) What exact version of HBase are you using? From a distribution,
> build
> > by
> > > yourself, from the JARs, etc.
> > > 2) Why do you think you need the MOB feature
> > > 3) Is an upgrade an option for you or not really.
> > >
> > > Thanks,
> > >
> > > JMS
> > >
> > >
> > > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > >
> > > > It is defined here in
> > > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > > HColumnDescriptor.java:
> > > >   public static final String IS_MOB = "IS_MOB";
> > > >
> > > > MOB feature hasn't been backported to branch-1 (or earlier releases).
> > > >
> > > > Looks like you're using a vendor's release.
> > > >
> > > > Consider contacting the corresponding mailing list if you are stuck.
> > > >
> > > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > I'd like to use MOB in HBase to store PDF files. I'm using 
> > > > > Hbase
> > 1.2.3
> > > > but
> > > > > I'get this error creating a table with MOB column : NameError:
> > > > > uninitialized constant IS_MOB.
> > > > >
> > > > > A lot of web sites (including Apache official web site) talk 
> > > > > about
> > the
> > > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation 
> > > > > about
> > the
> > > > way
> > > > > to install this patch and
> > > > >
> > > > > I can't find the 2.0.0 version anywhere. So I'm completly lost.
> Could
> > > you
> > > > > help me please ?
> > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>

Re: HBASE and MOB

Posted by Ted Yu <yu...@gmail.com>.
MOB is also backported in HDP 2.5.x

FYI

On Fri, May 12, 2017 at 9:51 AM, anil gupta <an...@gmail.com> wrote:

> Backporting MOB wont be a trivial task.
> AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
> apache HBase1.x branch yet). It might be easier to just use CDH for MOB.
>
> On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Thanks for those details.
> >
> > How big are you PDF? Are they all small size? If they are not above 1MB,
> > MOBs will not really be 100% mandatory. Even if few of them are above.
> >
> > If you want to apply the patch on another branch,this is what is called a
> > back port (like Ted said before) and will require a pretty good amount of
> > work. You can jump on that, but if you are not used to the HBase code, it
> > might be a pretty big challenge...
> >
> > Another way is to look for an HBase distribution that already includes
> the
> > MOB code already.
> >
> > JMS
> >
> > 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
> >
> > > Hi Jean Marc
> > >
> > > I'm using a 1.2.3 version. I downloaded a "bin" version from Apache
> > > official web site. Maybe I've to install it from the "src" option with
> > mvn ?
> > >
> > > I would like index PDF into Hbase and use it in a Solr collection.
> > >
> > > In fact I would like reproduce this process :
> > > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> > >
> > >
> > > But maybe is there another solution to reproduce it .
> > >
> > > Fred
> > >
> > >
> > > ________________________________
> > > De : Jean-Marc Spaggiari <je...@spaggiari.org>
> > > Envoyé : vendredi 12 mai 2017 17:06
> > > À : user
> > > Objet : Re: HBASE and MOB
> > >
> > > Hi Fred,
> > >
> > > Can you please confirm the following information?
> > >
> > > 1) What exact version of HBase are you using? From a distribution,
> build
> > by
> > > yourself, from the JARs, etc.
> > > 2) Why do you think you need the MOB feature
> > > 3) Is an upgrade an option for you or not really.
> > >
> > > Thanks,
> > >
> > > JMS
> > >
> > >
> > > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > >
> > > > It is defined here in
> > > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > > HColumnDescriptor.java:
> > > >   public static final String IS_MOB = "IS_MOB";
> > > >
> > > > MOB feature hasn't been backported to branch-1 (or earlier releases).
> > > >
> > > > Looks like you're using a vendor's release.
> > > >
> > > > Consider contacting the corresponding mailing list if you are stuck.
> > > >
> > > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > I'd like to use MOB in HBase to store PDF files. I'm using Hbase
> > 1.2.3
> > > > but
> > > > > I'get this error creating a table with MOB column : NameError:
> > > > > uninitialized constant IS_MOB.
> > > > >
> > > > > A lot of web sites (including Apache official web site) talk about
> > the
> > > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation about
> > the
> > > > way
> > > > > to install this patch and
> > > > >
> > > > > I can't find the 2.0.0 version anywhere. So I'm completly lost.
> Could
> > > you
> > > > > help me please ?
> > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Thanks & Regards,
> Anil Gupta
>

Re: HBASE and MOB

Posted by anil gupta <an...@gmail.com>.
Backporting MOB wont be a trivial task.
AFAIK, Cloudera backported MOB to HBase1.x  branch for CDH(its not in
apache HBase1.x branch yet). It might be easier to just use CDH for MOB.

On Fri, May 12, 2017 at 8:51 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Thanks for those details.
>
> How big are you PDF? Are they all small size? If they are not above 1MB,
> MOBs will not really be 100% mandatory. Even if few of them are above.
>
> If you want to apply the patch on another branch,this is what is called a
> back port (like Ted said before) and will require a pretty good amount of
> work. You can jump on that, but if you are not used to the HBase code, it
> might be a pretty big challenge...
>
> Another way is to look for an HBase distribution that already includes the
> MOB code already.
>
> JMS
>
> 2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:
>
> > Hi Jean Marc
> >
> > I'm using a 1.2.3 version. I downloaded a "bin" version from Apache
> > official web site. Maybe I've to install it from the "src" option with
> mvn ?
> >
> > I would like index PDF into Hbase and use it in a Solr collection.
> >
> > In fact I would like reproduce this process :
> > http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> > pdfs-at-scale-using-fewer-than-50-lines-of-code/
> >
> >
> > But maybe is there another solution to reproduce it .
> >
> > Fred
> >
> >
> > ________________________________
> > De : Jean-Marc Spaggiari <je...@spaggiari.org>
> > Envoyé : vendredi 12 mai 2017 17:06
> > À : user
> > Objet : Re: HBASE and MOB
> >
> > Hi Fred,
> >
> > Can you please confirm the following information?
> >
> > 1) What exact version of HBase are you using? From a distribution, build
> by
> > yourself, from the JARs, etc.
> > 2) Why do you think you need the MOB feature
> > 3) Is an upgrade an option for you or not really.
> >
> > Thanks,
> >
> > JMS
> >
> >
> > 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
> >
> > > It is defined here in
> > > hbase-client/src/main/java/org/apache/hadoop/hbase/
> > HColumnDescriptor.java:
> > >   public static final String IS_MOB = "IS_MOB";
> > >
> > > MOB feature hasn't been backported to branch-1 (or earlier releases).
> > >
> > > Looks like you're using a vendor's release.
> > >
> > > Consider contacting the corresponding mailing list if you are stuck.
> > >
> > > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
> > >
> > > > Hi all,
> > > >
> > > > I'd like to use MOB in HBase to store PDF files. I'm using Hbase
> 1.2.3
> > > but
> > > > I'get this error creating a table with MOB column : NameError:
> > > > uninitialized constant IS_MOB.
> > > >
> > > > A lot of web sites (including Apache official web site) talk about
> the
> > > > patch 11339 or HBase 2.0.0, but, I don't find any explanation about
> the
> > > way
> > > > to install this patch and
> > > >
> > > > I can't find the 2.0.0 version anywhere. So I'm completly lost. Could
> > you
> > > > help me please ?
> > > >
> > > >
> > >
> >
>



-- 
Thanks & Regards,
Anil Gupta

Re: HBASE and MOB

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Thanks for those details.

How big are you PDF? Are they all small size? If they are not above 1MB,
MOBs will not really be 100% mandatory. Even if few of them are above.

If you want to apply the patch on another branch,this is what is called a
back port (like Ted said before) and will require a pretty good amount of
work. You can jump on that, but if you are not used to the HBase code, it
might be a pretty big challenge...

Another way is to look for an HBase distribution that already includes the
MOB code already.

JMS

2017-05-12 11:21 GMT-04:00 F. T. <bi...@hotmail.fr>:

> Hi Jean Marc
>
> I'm using a 1.2.3 version. I downloaded a "bin" version from Apache
> official web site. Maybe I've to install it from the "src" option with mvn ?
>
> I would like index PDF into Hbase and use it in a Solr collection.
>
> In fact I would like reproduce this process :
> http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-
> pdfs-at-scale-using-fewer-than-50-lines-of-code/
>
>
> But maybe is there another solution to reproduce it .
>
> Fred
>
>
> ________________________________
> De : Jean-Marc Spaggiari <je...@spaggiari.org>
> Envoyé : vendredi 12 mai 2017 17:06
> À : user
> Objet : Re: HBASE and MOB
>
> Hi Fred,
>
> Can you please confirm the following information?
>
> 1) What exact version of HBase are you using? From a distribution, build by
> yourself, from the JARs, etc.
> 2) Why do you think you need the MOB feature
> 3) Is an upgrade an option for you or not really.
>
> Thanks,
>
> JMS
>
>
> 2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:
>
> > It is defined here in
> > hbase-client/src/main/java/org/apache/hadoop/hbase/
> HColumnDescriptor.java:
> >   public static final String IS_MOB = "IS_MOB";
> >
> > MOB feature hasn't been backported to branch-1 (or earlier releases).
> >
> > Looks like you're using a vendor's release.
> >
> > Consider contacting the corresponding mailing list if you are stuck.
> >
> > On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
> >
> > > Hi all,
> > >
> > > I'd like to use MOB in HBase to store PDF files. I'm using Hbase 1.2.3
> > but
> > > I'get this error creating a table with MOB column : NameError:
> > > uninitialized constant IS_MOB.
> > >
> > > A lot of web sites (including Apache official web site) talk about the
> > > patch 11339 or HBase 2.0.0, but, I don't find any explanation about the
> > way
> > > to install this patch and
> > >
> > > I can't find the 2.0.0 version anywhere. So I'm completly lost. Could
> you
> > > help me please ?
> > >
> > >
> >
>

RE: HBASE and MOB

Posted by "F. T." <bi...@hotmail.fr>.
Hi Jean Marc

I'm using a 1.2.3 version. I downloaded a "bin" version from Apache official web site. Maybe I've to install it from the "src" option with mvn ?

I would like index PDF into Hbase and use it in a Solr collection.

In fact I would like reproduce this process : http://blog.cloudera.com/blog/2015/10/how-to-index-scanned-pdfs-at-scale-using-fewer-than-50-lines-of-code/


But maybe is there another solution to reproduce it .

Fred


________________________________
De : Jean-Marc Spaggiari <je...@spaggiari.org>
Envoyé : vendredi 12 mai 2017 17:06
À : user
Objet : Re: HBASE and MOB

Hi Fred,

Can you please confirm the following information?

1) What exact version of HBase are you using? From a distribution, build by
yourself, from the JARs, etc.
2) Why do you think you need the MOB feature
3) Is an upgrade an option for you or not really.

Thanks,

JMS


2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:

> It is defined here in
> hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java:
>   public static final String IS_MOB = "IS_MOB";
>
> MOB feature hasn't been backported to branch-1 (or earlier releases).
>
> Looks like you're using a vendor's release.
>
> Consider contacting the corresponding mailing list if you are stuck.
>
> On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
>
> > Hi all,
> >
> > I'd like to use MOB in HBase to store PDF files. I'm using Hbase 1.2.3
> but
> > I'get this error creating a table with MOB column : NameError:
> > uninitialized constant IS_MOB.
> >
> > A lot of web sites (including Apache official web site) talk about the
> > patch 11339 or HBase 2.0.0, but, I don't find any explanation about the
> way
> > to install this patch and
> >
> > I can't find the 2.0.0 version anywhere. So I'm completly lost. Could you
> > help me please ?
> >
> >
>

Re: HBASE and MOB

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Fred,

Can you please confirm the following information?

1) What exact version of HBase are you using? From a distribution, build by
yourself, from the JARs, etc.
2) Why do you think you need the MOB feature
3) Is an upgrade an option for you or not really.

Thanks,

JMS


2017-05-12 11:02 GMT-04:00 Ted Yu <yu...@gmail.com>:

> It is defined here in
> hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java:
>   public static final String IS_MOB = "IS_MOB";
>
> MOB feature hasn't been backported to branch-1 (or earlier releases).
>
> Looks like you're using a vendor's release.
>
> Consider contacting the corresponding mailing list if you are stuck.
>
> On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:
>
> > Hi all,
> >
> > I'd like to use MOB in HBase to store PDF files. I'm using Hbase 1.2.3
> but
> > I'get this error creating a table with MOB column : NameError:
> > uninitialized constant IS_MOB.
> >
> > A lot of web sites (including Apache official web site) talk about the
> > patch 11339 or HBase 2.0.0, but, I don't find any explanation about the
> way
> > to install this patch and
> >
> > I can't find the 2.0.0 version anywhere. So I'm completly lost. Could you
> > help me please ?
> >
> >
>

Re: HBASE and MOB

Posted by Ted Yu <yu...@gmail.com>.
It is defined here in
hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java:
  public static final String IS_MOB = "IS_MOB";

MOB feature hasn't been backported to branch-1 (or earlier releases).

Looks like you're using a vendor's release.

Consider contacting the corresponding mailing list if you are stuck.

On Fri, May 12, 2017 at 7:59 AM, F. T. <bi...@hotmail.fr> wrote:

> Hi all,
>
> I'd like to use MOB in HBase to store PDF files. I'm using Hbase 1.2.3 but
> I'get this error creating a table with MOB column : NameError:
> uninitialized constant IS_MOB.
>
> A lot of web sites (including Apache official web site) talk about the
> patch 11339 or HBase 2.0.0, but, I don't find any explanation about the way
> to install this patch and
>
> I can't find the 2.0.0 version anywhere. So I'm completly lost. Could you
> help me please ?
>
>