You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Vidhyashankar Venkataraman <vi...@yahoo-inc.com> on 2010/08/18 04:39:39 UTC
Hbase 0.89-hadoop version mismatch errors..
I seem to have gotten into some version mismatch issues..
When I try to start HBAse 0.89 along with Hadoop 0.20.100, Hbase fails to start up with these errors in the namenode whioch leads to exceptions in master and regionservers..
Errors in namenode of this form:
WARN org.apache.hadoop.ipc.Server: Incorrect header or version mismatch from 67.195.58.183:41454 got version 3 expected version 4
The only place where I saw a hbase dependency on hadoop configs was while setting HADOOP_CLASSPATH which has been set to the right jar file now after which I restarted Hadoop.. Are there any other places I may have to change the dependency?
Thank you in advance,
Vidhya
Re: Hbase 0.89-hadoop version mismatch errors..
Posted by Stack <st...@duboce.net>.
On Tue, Aug 17, 2010 at 7:39 PM, Vidhyashankar Venkataraman
<vi...@yahoo-inc.com> wrote:
> I seem to have gotten into some version mismatch issues..
>
> When I try to start HBAse 0.89 along with Hadoop 0.20.100, Hbase fails to start up with these errors in the namenode whioch leads to exceptions in master and regionservers..
>
Did you put the hadoop jar you are using under $HBASE_HOME/lib? Maybe
thats the issue?
St.Ack
Re: Hbase 0.89-hadoop version mismatch errors..
Posted by Stack <st...@duboce.net>.
On Sat, Aug 21, 2010 at 6:44 PM, Vidhyashankar Venkataraman
<vi...@yahoo-inc.com> wrote:
> ....: I am actually testing the db on 700 nodes (gulp)..
>
Wheeee!!!!!
St.Ack
Re: Hbase 0.89-hadoop version mismatch errors..
Posted by Vidhyashankar Venkataraman <vi...@yahoo-inc.com>.
Thank you guys! I proceeded to use a lower version of Hadoop for my tests: I am actually testing the db on 700 nodes (gulp)..
V
On 8/21/10 9:13 AM, "Todd Lipcon" <to...@cloudera.com> wrote:
On Fri, Aug 20, 2010 at 8:48 PM, Alexey Kovyrin <al...@kovyrin.net> wrote:
> Any ETA on b3?
>
>
Not sure I'm allowed to say the date, but in the next couple months :) Lots
of work still to be done to add and test security support across all the
different components.
-Todd
> On Fri, Aug 20, 2010 at 9:51 PM, Todd Lipcon <to...@cloudera.com> wrote:
> > Hey Vidhya,
> >
> > Also, YDH 0.20.100 doesn't include the Hadoop patch series from
> > branch-0.20-append that Cloudera and Facebook developed together to add
> > durability to HBase. Without these patches there are a lot of failure
> > scenarios that can cause a cluster to become inconsistent or lose some
> data.
> >
> > Our next beta of CDH will have all of the append-related patches for
> HBase
> > plus all of the YDH changes for security, MR improvements, etc, merged
> > together.
> >
> > Thanks
> > -Todd
> >
> > On Tue, Aug 17, 2010 at 10:36 PM, Gary Helmling <gh...@gmail.com>
> wrote:
> >
> >> On Tue, Aug 17, 2010 at 7:39 PM, Vidhyashankar Venkataraman <
> >> vidhyash@yahoo-inc.com> wrote:
> >>
> >> > When I try to start HBAse 0.89 along with Hadoop 0.20.100, Hbase fails
> to
> >> > start up with these errors in the namenode whioch leads to exceptions
> in
> >> > master and regionservers..
> >> >
> >> >
> >> When you say Hadoop 0.20.100, do you mean the yahoo-0.20.100 github
> branch,
> >> with backported security features?
> >>
> >> If so, HBase 0.89 will not currently run on it due to incompatible
> changes
> >> to security related classes (UserGroupInformation interface changes,
> >> removal
> >> of UnixUserGroupInformation class) that were also used in HBase.
> >>
> >> I have a work-in-progress branch on github that ports over some of the
> >> security changes here:
> >> http://github.com/ghelmling/hbase/tree/security
> >>
> >> What's there is experimental, and not fully tested, though. And it
> still
> >> needs work before being proposed for actual inclusion. But it should
> work
> >> for testing, depending on your needs.
> >>
> >> --gh
> >>
> >
> >
> >
> > --
> > Todd Lipcon
> > Software Engineer, Cloudera
> >
>
>
>
> --
> Alexey Kovyrin
> http://kovyrin.net/
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: Hbase 0.89-hadoop version mismatch errors..
Posted by Todd Lipcon <to...@cloudera.com>.
On Fri, Aug 20, 2010 at 8:48 PM, Alexey Kovyrin <al...@kovyrin.net> wrote:
> Any ETA on b3?
>
>
Not sure I'm allowed to say the date, but in the next couple months :) Lots
of work still to be done to add and test security support across all the
different components.
-Todd
> On Fri, Aug 20, 2010 at 9:51 PM, Todd Lipcon <to...@cloudera.com> wrote:
> > Hey Vidhya,
> >
> > Also, YDH 0.20.100 doesn't include the Hadoop patch series from
> > branch-0.20-append that Cloudera and Facebook developed together to add
> > durability to HBase. Without these patches there are a lot of failure
> > scenarios that can cause a cluster to become inconsistent or lose some
> data.
> >
> > Our next beta of CDH will have all of the append-related patches for
> HBase
> > plus all of the YDH changes for security, MR improvements, etc, merged
> > together.
> >
> > Thanks
> > -Todd
> >
> > On Tue, Aug 17, 2010 at 10:36 PM, Gary Helmling <gh...@gmail.com>
> wrote:
> >
> >> On Tue, Aug 17, 2010 at 7:39 PM, Vidhyashankar Venkataraman <
> >> vidhyash@yahoo-inc.com> wrote:
> >>
> >> > When I try to start HBAse 0.89 along with Hadoop 0.20.100, Hbase fails
> to
> >> > start up with these errors in the namenode whioch leads to exceptions
> in
> >> > master and regionservers..
> >> >
> >> >
> >> When you say Hadoop 0.20.100, do you mean the yahoo-0.20.100 github
> branch,
> >> with backported security features?
> >>
> >> If so, HBase 0.89 will not currently run on it due to incompatible
> changes
> >> to security related classes (UserGroupInformation interface changes,
> >> removal
> >> of UnixUserGroupInformation class) that were also used in HBase.
> >>
> >> I have a work-in-progress branch on github that ports over some of the
> >> security changes here:
> >> http://github.com/ghelmling/hbase/tree/security
> >>
> >> What's there is experimental, and not fully tested, though. And it
> still
> >> needs work before being proposed for actual inclusion. But it should
> work
> >> for testing, depending on your needs.
> >>
> >> --gh
> >>
> >
> >
> >
> > --
> > Todd Lipcon
> > Software Engineer, Cloudera
> >
>
>
>
> --
> Alexey Kovyrin
> http://kovyrin.net/
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: Hbase 0.89-hadoop version mismatch errors..
Posted by Alexey Kovyrin <al...@kovyrin.net>.
Any ETA on b3?
On Fri, Aug 20, 2010 at 9:51 PM, Todd Lipcon <to...@cloudera.com> wrote:
> Hey Vidhya,
>
> Also, YDH 0.20.100 doesn't include the Hadoop patch series from
> branch-0.20-append that Cloudera and Facebook developed together to add
> durability to HBase. Without these patches there are a lot of failure
> scenarios that can cause a cluster to become inconsistent or lose some data.
>
> Our next beta of CDH will have all of the append-related patches for HBase
> plus all of the YDH changes for security, MR improvements, etc, merged
> together.
>
> Thanks
> -Todd
>
> On Tue, Aug 17, 2010 at 10:36 PM, Gary Helmling <gh...@gmail.com> wrote:
>
>> On Tue, Aug 17, 2010 at 7:39 PM, Vidhyashankar Venkataraman <
>> vidhyash@yahoo-inc.com> wrote:
>>
>> > When I try to start HBAse 0.89 along with Hadoop 0.20.100, Hbase fails to
>> > start up with these errors in the namenode whioch leads to exceptions in
>> > master and regionservers..
>> >
>> >
>> When you say Hadoop 0.20.100, do you mean the yahoo-0.20.100 github branch,
>> with backported security features?
>>
>> If so, HBase 0.89 will not currently run on it due to incompatible changes
>> to security related classes (UserGroupInformation interface changes,
>> removal
>> of UnixUserGroupInformation class) that were also used in HBase.
>>
>> I have a work-in-progress branch on github that ports over some of the
>> security changes here:
>> http://github.com/ghelmling/hbase/tree/security
>>
>> What's there is experimental, and not fully tested, though. And it still
>> needs work before being proposed for actual inclusion. But it should work
>> for testing, depending on your needs.
>>
>> --gh
>>
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
>
--
Alexey Kovyrin
http://kovyrin.net/
Re: Hbase 0.89-hadoop version mismatch errors..
Posted by Todd Lipcon <to...@cloudera.com>.
Hey Vidhya,
Also, YDH 0.20.100 doesn't include the Hadoop patch series from
branch-0.20-append that Cloudera and Facebook developed together to add
durability to HBase. Without these patches there are a lot of failure
scenarios that can cause a cluster to become inconsistent or lose some data.
Our next beta of CDH will have all of the append-related patches for HBase
plus all of the YDH changes for security, MR improvements, etc, merged
together.
Thanks
-Todd
On Tue, Aug 17, 2010 at 10:36 PM, Gary Helmling <gh...@gmail.com> wrote:
> On Tue, Aug 17, 2010 at 7:39 PM, Vidhyashankar Venkataraman <
> vidhyash@yahoo-inc.com> wrote:
>
> > When I try to start HBAse 0.89 along with Hadoop 0.20.100, Hbase fails to
> > start up with these errors in the namenode whioch leads to exceptions in
> > master and regionservers..
> >
> >
> When you say Hadoop 0.20.100, do you mean the yahoo-0.20.100 github branch,
> with backported security features?
>
> If so, HBase 0.89 will not currently run on it due to incompatible changes
> to security related classes (UserGroupInformation interface changes,
> removal
> of UnixUserGroupInformation class) that were also used in HBase.
>
> I have a work-in-progress branch on github that ports over some of the
> security changes here:
> http://github.com/ghelmling/hbase/tree/security
>
> What's there is experimental, and not fully tested, though. And it still
> needs work before being proposed for actual inclusion. But it should work
> for testing, depending on your needs.
>
> --gh
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: Hbase 0.89-hadoop version mismatch errors..
Posted by Gary Helmling <gh...@gmail.com>.
On Tue, Aug 17, 2010 at 7:39 PM, Vidhyashankar Venkataraman <
vidhyash@yahoo-inc.com> wrote:
> When I try to start HBAse 0.89 along with Hadoop 0.20.100, Hbase fails to
> start up with these errors in the namenode whioch leads to exceptions in
> master and regionservers..
>
>
When you say Hadoop 0.20.100, do you mean the yahoo-0.20.100 github branch,
with backported security features?
If so, HBase 0.89 will not currently run on it due to incompatible changes
to security related classes (UserGroupInformation interface changes, removal
of UnixUserGroupInformation class) that were also used in HBase.
I have a work-in-progress branch on github that ports over some of the
security changes here:
http://github.com/ghelmling/hbase/tree/security
What's there is experimental, and not fully tested, though. And it still
needs work before being proposed for actual inclusion. But it should work
for testing, depending on your needs.
--gh