You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Andrew Purtell <ap...@apache.org> on 2014/01/25 20:32:36 UTC
[VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
Binary API compatibility is not a criteria for 0.98 release, as mentioned
prominently in both RC announcements. In fact, we accepted patches that
specifically break it with that in mind.
On Mon, Feb 3, 2014 at 2:22 PM, Aleksandr Shulman <al...@cloudera.com>wrote:
> Sorry to join the party a little late. I have two pieces of feedback for
> the RC. Because of 2.1 and 2.2, I am also -1 on this RC.
>
> 1. Smoke tests - I ran the standard internal smoke tests - they all passed.
> 2. Binary/API incompatibilities:
> 1. Scan.setSmall(boolean) return type changed, which will cause a binary
> incompatibility between 0.96 and 0.98
> 2. HTableDescriptor.isDeferredLogFlush was removed, which will cause a
> binary incompatibility between 0.96 and 0.98. We should add it back with
> default response of 'true'
> 3. KeyValue constructors removed (known issue, but we should make sure to
> document)
> 4. ServerName constructors removed (known issue, but we should make sure
> to document)
>
> For 2.1 and 2.2:
>
>
> Exception from testScanMeta: -> java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.Scan.setSmall(Z)V
>
>
> Exception from testIsDeferredLogFlush: ->
> java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.HTableDescriptor.isDeferredLogFlush()Z
>
>
> The full report of Public API diffs can be found here:
>
> http://people.apache.org/~jmhsieh/hbase_jdiff_report-p-0.96-c-0.98/changes.html
> I will continue examining the report and I'd encourage folks to do the
> same.
>
>
>
> On Tue, Jan 28, 2014 at 9:59 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > On Mon, Jan 27, 2014 at 7:04 PM, tsuna <ts...@gmail.com> wrote:
> >
> > > Sorry I didn't mean to sink the RC just for this.
> >
> >
> > Well I think we should not be obnoxious in that way even if unintended.
> > However, HBASE-10433 would also have sunk the RC if it makes you feel
> > better. :-)
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
>
>
> --
> Best Regards,
>
> Aleks Shulman
> 847.814.5804
> Cloudera
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Ted Yu <yu...@gmail.com>.
For #2.1, I logged HBASE-10460 and attached a patch there.
Thanks, Alex.
On Mon, Feb 3, 2014 at 2:22 PM, Aleksandr Shulman <al...@cloudera.com>wrote:
> Sorry to join the party a little late. I have two pieces of feedback for
> the RC. Because of 2.1 and 2.2, I am also -1 on this RC.
>
> 1. Smoke tests - I ran the standard internal smoke tests - they all passed.
> 2. Binary/API incompatibilities:
> 1. Scan.setSmall(boolean) return type changed, which will cause a binary
> incompatibility between 0.96 and 0.98
> 2. HTableDescriptor.isDeferredLogFlush was removed, which will cause a
> binary incompatibility between 0.96 and 0.98. We should add it back with
> default response of 'true'
> 3. KeyValue constructors removed (known issue, but we should make sure to
> document)
> 4. ServerName constructors removed (known issue, but we should make sure
> to document)
>
> For 2.1 and 2.2:
>
>
> Exception from testScanMeta: -> java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.Scan.setSmall(Z)V
>
>
> Exception from testIsDeferredLogFlush: ->
> java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.HTableDescriptor.isDeferredLogFlush()Z
>
>
> The full report of Public API diffs can be found here:
>
> http://people.apache.org/~jmhsieh/hbase_jdiff_report-p-0.96-c-0.98/changes.html
> I will continue examining the report and I'd encourage folks to do the
> same.
>
>
>
> On Tue, Jan 28, 2014 at 9:59 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > On Mon, Jan 27, 2014 at 7:04 PM, tsuna <ts...@gmail.com> wrote:
> >
> > > Sorry I didn't mean to sink the RC just for this.
> >
> >
> > Well I think we should not be obnoxious in that way even if unintended.
> > However, HBASE-10433 would also have sunk the RC if it makes you feel
> > better. :-)
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
>
>
> --
> Best Regards,
>
> Aleks Shulman
> 847.814.5804
> Cloudera
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Aleksandr Shulman <al...@cloudera.com>.
Sorry to join the party a little late. I have two pieces of feedback for
the RC. Because of 2.1 and 2.2, I am also -1 on this RC.
1. Smoke tests - I ran the standard internal smoke tests - they all passed.
2. Binary/API incompatibilities:
1. Scan.setSmall(boolean) return type changed, which will cause a binary
incompatibility between 0.96 and 0.98
2. HTableDescriptor.isDeferredLogFlush was removed, which will cause a
binary incompatibility between 0.96 and 0.98. We should add it back with
default response of 'true'
3. KeyValue constructors removed (known issue, but we should make sure to
document)
4. ServerName constructors removed (known issue, but we should make sure
to document)
For 2.1 and 2.2:
Exception from testScanMeta: -> java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.Scan.setSmall(Z)V
Exception from testIsDeferredLogFlush: ->
java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.HTableDescriptor.isDeferredLogFlush()Z
The full report of Public API diffs can be found here:
http://people.apache.org/~jmhsieh/hbase_jdiff_report-p-0.96-c-0.98/changes.html
I will continue examining the report and I'd encourage folks to do the same.
On Tue, Jan 28, 2014 at 9:59 AM, Andrew Purtell <ap...@apache.org> wrote:
> On Mon, Jan 27, 2014 at 7:04 PM, tsuna <ts...@gmail.com> wrote:
>
> > Sorry I didn't mean to sink the RC just for this.
>
>
> Well I think we should not be obnoxious in that way even if unintended.
> However, HBASE-10433 would also have sunk the RC if it makes you feel
> better. :-)
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
--
Best Regards,
Aleks Shulman
847.814.5804
Cloudera
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
On Mon, Jan 27, 2014 at 7:04 PM, tsuna <ts...@gmail.com> wrote:
> Sorry I didn't mean to sink the RC just for this.
Well I think we should not be obnoxious in that way even if unintended.
However, HBASE-10433 would also have sunk the RC if it makes you feel
better. :-)
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by tsuna <ts...@gmail.com>.
On Mon, Jan 27, 2014 at 10:16 AM, Andrew Purtell <ap...@apache.org> wrote:
> Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
Sorry I didn't mean to sink the RC just for this. Just thought that
I'd mention it because generally somebody else will come with a
real / good reason why to sink the first RC of any new major release. :P
--
Benoit "tsuna" Sigoure
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
On Mon, Jan 27, 2014 at 5:05 PM, Andrew Purtell <ap...@apache.org> wrote:
> On Mon, Jan 27, 2014 at 4:16 PM, Stack <st...@duboce.net> wrote:
>
> > I brought a up 0.98 regionserver on a 0.96.1.1. cluster that was under
> > load. It just slotted in and cluster kept going.
> >
> > I then brought up a 0.98.0 master instead of the 0.96.1.1. master and
> that
> > was fine to.
> >
>
> That is f*cking awesome.
>
>
>
That it works? Yes.
Take a look at the hbase2 doc when you get a chance.
St.Ack
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
On Mon, Jan 27, 2014 at 4:16 PM, Stack <st...@duboce.net> wrote:
> I brought a up 0.98 regionserver on a 0.96.1.1. cluster that was under
> load. It just slotted in and cluster kept going.
>
> I then brought up a 0.98.0 master instead of the 0.96.1.1. master and that
> was fine to.
>
That is f*cking awesome.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
On Mon, Jan 27, 2014 at 5:05 PM, Andrew Purtell <ap...@apache.org> wrote:
> On Mon, Jan 27, 2014 at 4:16 PM, Stack <st...@duboce.net> wrote:
>
> > Logging could do w/ an edit -- too profuse. We need to make INFO level
> > work before 1.0.0.
> >
>
> Anything specific stand out? We can get in a INFO -> DEBUG reduction in
> before RC1 cuts.
>
>
I think it too big an effort for 0.98 moving to INFO as default (We should
set it so in trunk now -- fellas will soon start moving up the logs they
need). The spew about log archiving and other emissions that do nothing
but announce a code point has been passed out come to mind. Not important
to sink an RC.
St.Ack
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
On Mon, Jan 27, 2014 at 4:16 PM, Stack <st...@duboce.net> wrote:
> Logging could do w/ an edit -- too profuse. We need to make INFO level
> work before 1.0.0.
>
Anything specific stand out? We can get in a INFO -> DEBUG reduction in
before RC1 cuts.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
I am done Andrew.
Doc and layout looks good.
Should make it so javadoc and xref docs are 0.98.0 rather than
0.98.0-hadoop1 and 0.98.0-hadoop2 (but that is not you).
Logging could do w/ an edit -- too profuse. We need to make INFO level
work before 1.0.0.
I brought a up 0.98 regionserver on a 0.96.1.1. cluster that was under
load. It just slotted in and cluster kept going.
I then brought up a 0.98.0 master instead of the 0.96.1.1. master and that
was fine to.
Studying logs it looks 'normal'.
So, put up a RC1 and it looks like it is +1-able.... its in the ballpark at
least.
St.Ack
On Mon, Jan 27, 2014 at 10:25 AM, Andrew Purtell <ap...@apache.org>wrote:
> Ok, I will tag RC1 tomorrow.
>
>
> On Mon, Jan 27, 2014 at 10:21 AM, Stack <st...@duboce.net> wrote:
>
> > Maybe spin it tomorrow. I was going to take a look at 0.98 today. Let
> me
> > see if I can turn up something else?
> > St.Ack
> >
> >
> > On Mon, Jan 27, 2014 at 10:16 AM, Andrew Purtell <apurtell@apache.org
> > >wrote:
> >
> > > Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
> > >
> > > I will spin a new RC today.
> > >
> > >
> > > On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <apurtell@apache.org
> > > >wrote:
> > >
> > > > The 1st HBase 0.98.0 release candidate (RC0) is available for
> download
> > at
> > > > http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts
> are
> > > > also available in the temporary repository
> > > >
> > https://repository.apache.org/content/repositories/orgapachehbase-1001/
> > > >
> > > > Signed with my code signing key D5365CCD.
> > > >
> > > > HBase 0.98.0 is the next major release after HBase 0.96. It is
> expected
> > > to
> > > > be wire compatible with HBase 0.96, so clients and servers mixed
> > between
> > > > these versions will seamlessly interoperate, provided new features
> > > > available in 0.98 are not enabled. However, the HBase 0.98.0 release
> is
> > > not
> > > > intended to be binary compatible at the Java API level with any HBase
> > > 0.96
> > > > release or earlier. You may need to recompile applications which
> > > reference
> > > > the HBase JARs. Users of HBase 0.94 will have to perform an offline
> > data
> > > > migration procedure during upgrade. Consult the HBase Online Manual
> for
> > > > more information. It is not necessary to migrate data from 0.94 to
> 0.98
> > > > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > > > following the same procedure for upgrading from 0.94 to 0.96.
> > > >
> > > > This release includes several new security features like per-cell
> > > > visibility labels, per-cell ACLs, transparent encryption, and related
> > > > changes to the coprocessor framework. Please see the Security section
> > of
> > > > the HBase Online Manual for more information. There are also
> > significant
> > > > improvements, such as a change to the write ahead log (WAL) threading
> > > model
> > > > that provides higher transaction throughput under high load. The list
> > of
> > > > changes in this release can be found here:
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> > > >
> > > >
> > > > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > > > (00:00 -0800 GMT) on February 1 on whether or not we should release
> > this
> > > as
> > > > 0.98.0.
> > > >
> > > > --
> > > > Best regards,
> > > >
> > > > - Andy
> > > >
> > > > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein
> > > > (via Tom White)
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
Ok, I will tag RC1 tomorrow.
On Mon, Jan 27, 2014 at 10:21 AM, Stack <st...@duboce.net> wrote:
> Maybe spin it tomorrow. I was going to take a look at 0.98 today. Let me
> see if I can turn up something else?
> St.Ack
>
>
> On Mon, Jan 27, 2014 at 10:16 AM, Andrew Purtell <apurtell@apache.org
> >wrote:
>
> > Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
> >
> > I will spin a new RC today.
> >
> >
> > On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <apurtell@apache.org
> > >wrote:
> >
> > > The 1st HBase 0.98.0 release candidate (RC0) is available for download
> at
> > > http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are
> > > also available in the temporary repository
> > >
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
> > >
> > > Signed with my code signing key D5365CCD.
> > >
> > > HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> > to
> > > be wire compatible with HBase 0.96, so clients and servers mixed
> between
> > > these versions will seamlessly interoperate, provided new features
> > > available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> > not
> > > intended to be binary compatible at the Java API level with any HBase
> > 0.96
> > > release or earlier. You may need to recompile applications which
> > reference
> > > the HBase JARs. Users of HBase 0.94 will have to perform an offline
> data
> > > migration procedure during upgrade. Consult the HBase Online Manual for
> > > more information. It is not necessary to migrate data from 0.94 to 0.98
> > > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > > following the same procedure for upgrading from 0.94 to 0.96.
> > >
> > > This release includes several new security features like per-cell
> > > visibility labels, per-cell ACLs, transparent encryption, and related
> > > changes to the coprocessor framework. Please see the Security section
> of
> > > the HBase Online Manual for more information. There are also
> significant
> > > improvements, such as a change to the write ahead log (WAL) threading
> > model
> > > that provides higher transaction throughput under high load. The list
> of
> > > changes in this release can be found here:
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> > >
> > >
> > > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > > (00:00 -0800 GMT) on February 1 on whether or not we should release
> this
> > as
> > > 0.98.0.
> > >
> > > --
> > > Best regards,
> > >
> > > - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
Maybe spin it tomorrow. I was going to take a look at 0.98 today. Let me
see if I can turn up something else?
St.Ack
On Mon, Jan 27, 2014 at 10:16 AM, Andrew Purtell <ap...@apache.org>wrote:
> Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
>
> I will spin a new RC today.
>
>
> On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <apurtell@apache.org
> >wrote:
>
> > The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> > http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are
> > also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1001/
> >
> > Signed with my code signing key D5365CCD.
> >
> > HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> to
> > be wire compatible with HBase 0.96, so clients and servers mixed between
> > these versions will seamlessly interoperate, provided new features
> > available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> not
> > intended to be binary compatible at the Java API level with any HBase
> 0.96
> > release or earlier. You may need to recompile applications which
> reference
> > the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> > migration procedure during upgrade. Consult the HBase Online Manual for
> > more information. It is not necessary to migrate data from 0.94 to 0.98
> > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > following the same procedure for upgrading from 0.94 to 0.96.
> >
> > This release includes several new security features like per-cell
> > visibility labels, per-cell ACLs, transparent encryption, and related
> > changes to the coprocessor framework. Please see the Security section of
> > the HBase Online Manual for more information. There are also significant
> > improvements, such as a change to the write ahead log (WAL) threading
> model
> > that provides higher transaction throughput under high load. The list of
> > changes in this release can be found here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> >
> >
> > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > (00:00 -0800 GMT) on February 1 on whether or not we should release this
> as
> > 0.98.0.
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
Maybe spin it tomorrow. I was going to take a look at 0.98 today. Let me
see if I can turn up something else?
St.Ack
On Mon, Jan 27, 2014 at 10:16 AM, Andrew Purtell <ap...@apache.org>wrote:
> Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
>
> I will spin a new RC today.
>
>
> On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <apurtell@apache.org
> >wrote:
>
> > The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> > http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are
> > also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1001/
> >
> > Signed with my code signing key D5365CCD.
> >
> > HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> to
> > be wire compatible with HBase 0.96, so clients and servers mixed between
> > these versions will seamlessly interoperate, provided new features
> > available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> not
> > intended to be binary compatible at the Java API level with any HBase
> 0.96
> > release or earlier. You may need to recompile applications which
> reference
> > the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> > migration procedure during upgrade. Consult the HBase Online Manual for
> > more information. It is not necessary to migrate data from 0.94 to 0.98
> > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > following the same procedure for upgrading from 0.94 to 0.96.
> >
> > This release includes several new security features like per-cell
> > visibility labels, per-cell ACLs, transparent encryption, and related
> > changes to the coprocessor framework. Please see the Security section of
> > the HBase Online Manual for more information. There are also significant
> > improvements, such as a change to the write ahead log (WAL) threading
> model
> > that provides higher transaction throughput under high load. The list of
> > changes in this release can be found here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> >
> >
> > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > (00:00 -0800 GMT) on February 1 on whether or not we should release this
> as
> > 0.98.0.
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by tsuna <ts...@gmail.com>.
On Mon, Jan 27, 2014 at 10:16 AM, Andrew Purtell <ap...@apache.org> wrote:
> Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
Sorry I didn't mean to sink the RC just for this. Just thought that
I'd mention it because generally somebody else will come with a
real / good reason why to sink the first RC of any new major release. :P
--
Benoit "tsuna" Sigoure
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
I will spin a new RC today.
On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <ap...@apache.org>wrote:
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are
> also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00 -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
This was obnoxious, sorry about that Benoit. I will sink this RC and spin
another one today.
On Sun, Jan 26, 2014 at 6:37 PM, tsuna <ts...@gmail.com> wrote:
> If this RC sinks, can you please include this one in 0.98.0:
> https://issues.apache.org/jira/browse/HBASE-10422
>
> --
> Benoit "tsuna" Sigoure
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
This was obnoxious, sorry about that Benoit. I will sink this RC and spin
another one today.
On Sun, Jan 26, 2014 at 6:37 PM, tsuna <ts...@gmail.com> wrote:
> If this RC sinks, can you please include this one in 0.98.0:
> https://issues.apache.org/jira/browse/HBASE-10422
>
> --
> Benoit "tsuna" Sigoure
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
I committed your patch on all branches Benoit. It'll make the next RC and
any releases from here on out.
St.Ack
On Sun, Jan 26, 2014 at 6:37 PM, tsuna <ts...@gmail.com> wrote:
> If this RC sinks, can you please include this one in 0.98.0:
> https://issues.apache.org/jira/browse/HBASE-10422
>
> --
> Benoit "tsuna" Sigoure
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
I committed your patch on all branches Benoit. It'll make the next RC and
any releases from here on out.
St.Ack
On Sun, Jan 26, 2014 at 6:37 PM, tsuna <ts...@gmail.com> wrote:
> If this RC sinks, can you please include this one in 0.98.0:
> https://issues.apache.org/jira/browse/HBASE-10422
>
> --
> Benoit "tsuna" Sigoure
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by tsuna <ts...@gmail.com>.
If this RC sinks, can you please include this one in 0.98.0:
https://issues.apache.org/jira/browse/HBASE-10422
--
Benoit "tsuna" Sigoure
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by tsuna <ts...@gmail.com>.
If this RC sinks, can you please include this one in 0.98.0:
https://issues.apache.org/jira/browse/HBASE-10422
--
Benoit "tsuna" Sigoure
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
I think this is expected. It's the first time I tested this in 0.96 or later.
Still +1 here.
I'll do the same test in 0.96 next week. I'd expect it'll be similar to 0.98.
With "pure" scan performance I mostly mean the internal "friction". I.e. everything in the blockcache and all KVs filtered at the server with a filter.
But as you said, this is not a discussion thread.
We can tackle performance improvements later in the cycle.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "user@hbase.apache.org" <us...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Cc: "dev@hbase.apache.org" <de...@hbase.apache.org>
Sent: Saturday, January 25, 2014 3:13 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
On Sat, Jan 25, 2014 at 2:35 PM, lars hofhansl <la...@apache.org> wrote:
Raw scanning is about 30% slower than 0.94 in pure scan performance.
My initial reaction to that is -0, but I don't think it holds up .0, just charts out work needed for .1. When developing on trunk we looked at the deltas between trunk and trunk+changes, not between releases. How different is this from 0.96 I wonder.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
I think this is expected. It's the first time I tested this in 0.96 or later.
Still +1 here.
I'll do the same test in 0.96 next week. I'd expect it'll be similar to 0.98.
With "pure" scan performance I mostly mean the internal "friction". I.e. everything in the blockcache and all KVs filtered at the server with a filter.
But as you said, this is not a discussion thread.
We can tackle performance improvements later in the cycle.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "user@hbase.apache.org" <us...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Cc: "dev@hbase.apache.org" <de...@hbase.apache.org>
Sent: Saturday, January 25, 2014 3:13 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
On Sat, Jan 25, 2014 at 2:35 PM, lars hofhansl <la...@apache.org> wrote:
Raw scanning is about 30% slower than 0.94 in pure scan performance.
My initial reaction to that is -0, but I don't think it holds up .0, just charts out work needed for .1. When developing on trunk we looked at the deltas between trunk and trunk+changes, not between releases. How different is this from 0.96 I wonder.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
On Sat, Jan 25, 2014 at 2:35 PM, lars hofhansl <la...@apache.org> wrote:
> Raw scanning is about 30% slower than 0.94 in pure scan performance.
My initial reaction to that is -0, but I don't think it holds up .0, just
charts out work needed for .1. When developing on trunk we looked at the
deltas between trunk and trunk+changes, not between releases. How different
is this from 0.96 I wonder.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
On Sat, Jan 25, 2014 at 2:35 PM, lars hofhansl <la...@apache.org> wrote:
> Raw scanning is about 30% slower than 0.94 in pure scan performance.
My initial reaction to that is -0, but I don't think it holds up .0, just
charts out work needed for .1. When developing on trunk we looked at the
deltas between trunk and trunk+changes, not between releases. How different
is this from 0.96 I wonder.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
+1, Based on the following:
- Checked tarball, documentation, etc
- Installed with Hadoop 2.2
- Went through the upgrade process from 0.94
- Loaded 50m rows
- scanned, flushed, scanned again, compacted, scanned again
- ran my scan client test
Observations:
- The error message could be a bit more desriptive ("Did you run upgrade", instead of "run 'hbase hbck -fixVersionFile'")
- Raw scanning is about 30% slower than 0.94 in pure scan performance.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Stack <st...@duboce.net>.
I 'closed' it for you Andrew and it looks good now (I tested with
https://github.com/saintstack/hbase-downstreamer). That you have to
'close' is in the doc but the releasing section is long and tricky [1] and
likely a little stale too.
St.Ack
1. "..While in this 'open' state you can check out what you've published to
make sure all is good. To do this, login at repository.apache.org using
your apache id. Find your artifacts in the staging repository. Browse the
content. Make sure all artifacts made it up and that the poms look
generally good. If it checks out, 'close' the repo. This will make the
artifacts publically available...."
http://hbase.apache.org/book.html#releasing
On Mon, Jan 27, 2014 at 8:56 AM, Ted Yu <yu...@gmail.com> wrote:
> Andy:
> I tried to view
> https://repository.apache.org/content/repositories/orgapachehbase-1001 but
> the browser gave me:
>
> 404 - ItemNotFoundException
>
> Repository "orgapachehbase-1001 (staging: open)" [id=orgapachehbase-1001]
> exists but is not exposed.
>
> org.sonatype.nexus.proxy.ItemNotFoundException: Repository
> "orgapachehbase-1001 (staging: open)" [id=orgapachehbase-1001] exists but
> is not exposed.
> at
>
> org.sonatype.nexus.proxy.router.DefaultRepositoryRouter.getRequestRouteForRequest(DefaultRepositoryRouter.java:450)
>
> FYI
>
>
> On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <apurtell@apache.org
> >wrote:
>
> > The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> > http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are
> also
> > available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1001/
> >
> > Signed with my code signing key D5365CCD.
> >
> > HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> to
> > be wire compatible with HBase 0.96, so clients and servers mixed between
> > these versions will seamlessly interoperate, provided new features
> > available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> not
> > intended to be binary compatible at the Java API level with any HBase
> 0.96
> > release or earlier. You may need to recompile applications which
> reference
> > the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> > migration procedure during upgrade. Consult the HBase Online Manual for
> > more information. It is not necessary to migrate data from 0.94 to 0.98
> > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > following the same procedure for upgrading from 0.94 to 0.96.
> >
> > This release includes several new security features like per-cell
> > visibility labels, per-cell ACLs, transparent encryption, and related
> > changes to the coprocessor framework. Please see the Security section of
> > the HBase Online Manual for more information. There are also significant
> > improvements, such as a change to the write ahead log (WAL) threading
> model
> > that provides higher transaction throughput under high load. The list of
> > changes in this release can be found here:
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> >
> >
> > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00
> > -0800 GMT) on February 1 on whether or not we should release this as
> > 0.98.0.
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Ted Yu <yu...@gmail.com>.
Andy:
I tried to view
https://repository.apache.org/content/repositories/orgapachehbase-1001 but
the browser gave me:
404 - ItemNotFoundException
Repository "orgapachehbase-1001 (staging: open)" [id=orgapachehbase-1001]
exists but is not exposed.
org.sonatype.nexus.proxy.ItemNotFoundException: Repository
"orgapachehbase-1001 (staging: open)" [id=orgapachehbase-1001] exists but
is not exposed.
at
org.sonatype.nexus.proxy.router.DefaultRepositoryRouter.getRequestRouteForRequest(DefaultRepositoryRouter.java:450)
FYI
On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <ap...@apache.org>wrote:
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
> available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
No I didn't. Sorry. Never mind me.
________________________________
From: Andrew Purtell <an...@gmail.com>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>; "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Sent: Saturday, January 25, 2014 2:10 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Did you follow the migration process in the manual? There is an offline upgrade utility you have to run.
> On Jan 25, 2014, at 1:45 PM, lars hofhansl <la...@apache.org> wrote:
>
> Tried from scratch again. HMaster goes straight into:
>
>
> 2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
> exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
> at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
> at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
> at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
> at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
> at java.lang.Thread.run(Thread.java:744)
>
>
> So this is definitely broken.
> Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
> Or does one need to upgrade to 0.96 first and then to 0.98?
>
>
> -- Lars
>
>
>
> ________________________________
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:28 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> I "fixed" that by deleting hbase.version, then a correct one is generated.
> Now the master fails with:
> master.HMaster: Unhandled exception. Starting shutdown.
> java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
>
>
> It seems there is some general work needed for the upgrade path.
>
> -- Lars
>
>
>
> ________________________________
>
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:22 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> Probably not related to this RC specifically.
>
> I tried to upgrade my HBase 0.94 data to 0.98.
> The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
>
> The problem is that on each subsequent start the master dies with:
>
> master.HMaster: Unhandled exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
>
> The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
> It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
>
>
> -- Lars
>
>
> ________________________________
>
> From: Andrew Purtell <ap...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 11:32 AM
> Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
> available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
No I didn't. Sorry. Never mind me.
________________________________
From: Andrew Purtell <an...@gmail.com>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>; "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Sent: Saturday, January 25, 2014 2:10 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Did you follow the migration process in the manual? There is an offline upgrade utility you have to run.
> On Jan 25, 2014, at 1:45 PM, lars hofhansl <la...@apache.org> wrote:
>
> Tried from scratch again. HMaster goes straight into:
>
>
> 2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
> exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
> at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
> at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
> at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
> at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
> at java.lang.Thread.run(Thread.java:744)
>
>
> So this is definitely broken.
> Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
> Or does one need to upgrade to 0.96 first and then to 0.98?
>
>
> -- Lars
>
>
>
> ________________________________
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:28 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> I "fixed" that by deleting hbase.version, then a correct one is generated.
> Now the master fails with:
> master.HMaster: Unhandled exception. Starting shutdown.
> java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
>
>
> It seems there is some general work needed for the upgrade path.
>
> -- Lars
>
>
>
> ________________________________
>
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:22 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> Probably not related to this RC specifically.
>
> I tried to upgrade my HBase 0.94 data to 0.98.
> The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
>
> The problem is that on each subsequent start the master dies with:
>
> master.HMaster: Unhandled exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
>
> The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
> It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
>
>
> -- Lars
>
>
> ________________________________
>
> From: Andrew Purtell <ap...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 11:32 AM
> Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
> available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <an...@gmail.com>.
Did you follow the migration process in the manual? There is an offline upgrade utility you have to run.
> On Jan 25, 2014, at 1:45 PM, lars hofhansl <la...@apache.org> wrote:
>
> Tried from scratch again. HMaster goes straight into:
>
>
> 2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
> exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
> at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
> at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
> at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
> at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
> at java.lang.Thread.run(Thread.java:744)
>
>
> So this is definitely broken.
> Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
> Or does one need to upgrade to 0.96 first and then to 0.98?
>
>
> -- Lars
>
>
>
> ________________________________
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:28 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> I "fixed" that by deleting hbase.version, then a correct one is generated.
> Now the master fails with:
> master.HMaster: Unhandled exception. Starting shutdown.
> java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
>
>
> It seems there is some general work needed for the upgrade path.
>
> -- Lars
>
>
>
> ________________________________
>
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:22 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> Probably not related to this RC specifically.
>
> I tried to upgrade my HBase 0.94 data to 0.98.
> The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
>
> The problem is that on each subsequent start the master dies with:
>
> master.HMaster: Unhandled exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
>
> The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
> It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
>
>
> -- Lars
>
>
> ________________________________
>
> From: Andrew Purtell <ap...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 11:32 AM
> Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
> available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <an...@gmail.com>.
Did you follow the migration process in the manual? There is an offline upgrade utility you have to run.
> On Jan 25, 2014, at 1:45 PM, lars hofhansl <la...@apache.org> wrote:
>
> Tried from scratch again. HMaster goes straight into:
>
>
> 2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
> exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
> at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
> at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
> at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
> at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
> at java.lang.Thread.run(Thread.java:744)
>
>
> So this is definitely broken.
> Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
> Or does one need to upgrade to 0.96 first and then to 0.98?
>
>
> -- Lars
>
>
>
> ________________________________
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:28 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> I "fixed" that by deleting hbase.version, then a correct one is generated.
> Now the master fails with:
> master.HMaster: Unhandled exception. Starting shutdown.
> java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
>
>
> It seems there is some general work needed for the upgrade path.
>
> -- Lars
>
>
>
> ________________________________
>
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:22 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> Probably not related to this RC specifically.
>
> I tried to upgrade my HBase 0.94 data to 0.98.
> The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
>
> The problem is that on each subsequent start the master dies with:
>
> master.HMaster: Unhandled exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
>
> The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
> It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
>
>
> -- Lars
>
>
> ________________________________
>
> From: Andrew Purtell <ap...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 11:32 AM
> Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
> available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <an...@gmail.com>.
This is a vote thread not a discussion thread, please start new threads for discussion.
> On Jan 25, 2014, at 1:45 PM, lars hofhansl <la...@apache.org> wrote:
>
> Tried from scratch again. HMaster goes straight into:
>
>
> 2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
> exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
> at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
> at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
> at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
> at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
> at java.lang.Thread.run(Thread.java:744)
>
>
> So this is definitely broken.
> Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
> Or does one need to upgrade to 0.96 first and then to 0.98?
>
>
> -- Lars
>
>
>
> ________________________________
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:28 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> I "fixed" that by deleting hbase.version, then a correct one is generated.
> Now the master fails with:
> master.HMaster: Unhandled exception. Starting shutdown.
> java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
>
>
> It seems there is some general work needed for the upgrade path.
>
> -- Lars
>
>
>
> ________________________________
>
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:22 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> Probably not related to this RC specifically.
>
> I tried to upgrade my HBase 0.94 data to 0.98.
> The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
>
> The problem is that on each subsequent start the master dies with:
>
> master.HMaster: Unhandled exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
>
> The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
> It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
>
>
> -- Lars
>
>
> ________________________________
>
> From: Andrew Purtell <ap...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 11:32 AM
> Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
> available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <an...@gmail.com>.
This is a vote thread not a discussion thread, please start new threads for discussion.
> On Jan 25, 2014, at 1:45 PM, lars hofhansl <la...@apache.org> wrote:
>
> Tried from scratch again. HMaster goes straight into:
>
>
> 2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
> exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
> at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
> at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
> at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
> at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
> at java.lang.Thread.run(Thread.java:744)
>
>
> So this is definitely broken.
> Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
> Or does one need to upgrade to 0.96 first and then to 0.98?
>
>
> -- Lars
>
>
>
> ________________________________
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:28 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> I "fixed" that by deleting hbase.version, then a correct one is generated.
> Now the master fails with:
> master.HMaster: Unhandled exception. Starting shutdown.
> java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
>
>
> It seems there is some general work needed for the upgrade path.
>
> -- Lars
>
>
>
> ________________________________
>
> From: lars hofhansl <la...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 1:22 PM
> Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> Probably not related to this RC specifically.
>
> I tried to upgrade my HBase 0.94 data to 0.98.
> The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
>
> The problem is that on each subsequent start the master dies with:
>
> master.HMaster: Unhandled exception. Starting shutdown.
> org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
>
> The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
> It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
>
>
> -- Lars
>
>
> ________________________________
>
> From: Andrew Purtell <ap...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
> Sent: Saturday, January 25, 2014 11:32 AM
> Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
>
>
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
> available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Tried from scratch again. HMaster goes straight into:
2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
at java.lang.Thread.run(Thread.java:744)
So this is definitely broken.
Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
Or does one need to upgrade to 0.96 first and then to 0.98?
-- Lars
________________________________
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 1:28 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
I "fixed" that by deleting hbase.version, then a correct one is generated.
Now the master fails with:
master.HMaster: Unhandled exception. Starting shutdown.
java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
It seems there is some general work needed for the upgrade path.
-- Lars
________________________________
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 1:22 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Probably not related to this RC specifically.
I tried to upgrade my HBase 0.94 data to 0.98.
The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
The problem is that on each subsequent start the master dies with:
master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Tried from scratch again. HMaster goes straight into:
2014-01-25 13:41:28,422 FATAL [master:myhost:60000] master.HMaster: Unhandled
exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'.
at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:588)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:789)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:606)
at java.lang.Thread.run(Thread.java:744)
So this is definitely broken.
Are we supporting upgrading from 0.94 to 0.98? If so this should sink the RC.
Or does one need to upgrade to 0.96 first and then to 0.98?
-- Lars
________________________________
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 1:28 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
I "fixed" that by deleting hbase.version, then a correct one is generated.
Now the master fails with:
master.HMaster: Unhandled exception. Starting shutdown.
java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
It seems there is some general work needed for the upgrade path.
-- Lars
________________________________
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 1:22 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Probably not related to this RC specifically.
I tried to upgrade my HBase 0.94 data to 0.98.
The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
The problem is that on each subsequent start the master dies with:
master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
I "fixed" that by deleting hbase.version, then a correct one is generated.
Now the master fails with:
master.HMaster: Unhandled exception. Starting shutdown.
java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
It seems there is some general work needed for the upgrade path.
-- Lars
________________________________
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 1:22 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Probably not related to this RC specifically.
I tried to upgrade my HBase 0.94 data to 0.98.
The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
The problem is that on each subsequent start the master dies with:
master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
I "fixed" that by deleting hbase.version, then a correct one is generated.
Now the master fails with:
master.HMaster: Unhandled exception. Starting shutdown.
java.lang.IllegalArgumentException: .META. no longer exists. The table has been renamed to hbase:meta
It seems there is some general work needed for the upgrade path.
-- Lars
________________________________
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 1:22 PM
Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Probably not related to this RC specifically.
I tried to upgrade my HBase 0.94 data to 0.98.
The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
The problem is that on each subsequent start the master dies with:
master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Probably not related to this RC specifically.
I tried to upgrade my HBase 0.94 data to 0.98.
The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
The problem is that on each subsequent start the master dies with:
master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
+1, Based on the following:
- Checked tarball, documentation, etc
- Installed with Hadoop 2.2
- Went through the upgrade process from 0.94
- Loaded 50m rows
- scanned, flushed, scanned again, compacted, scanned again
- ran my scan client test
Observations:
- The error message could be a bit more desriptive ("Did you run upgrade", instead of "run 'hbase hbck -fixVersionFile'")
- Raw scanning is about 30% slower than 0.94 in pure scan performance.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Probably not related to this RC specifically.
I tried to upgrade my HBase 0.94 data to 0.98.
The first time I started HBase the master died, because I did not confiure short circuit reads correctly.
The problem is that on each subsequent start the master dies with:
master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version 7 and I want version 8. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'
The problem is that I cannot run hbck, since it fails to contact the master, but the master does not start, because of this issue, and hence there is no easy way to fix.
It seems one gets one chance to upgrade the HBase metadata, and if that fails it won't be attempted again.
-- Lars
________________________________
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: "user@hbase.apache.org" <us...@hbase.apache.org>
Sent: Saturday, January 25, 2014 11:32 AM
Subject: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
The 1st HBase 0.98.0 release candidate (RC0) is available for download at
http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are also
available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1001/
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are also significant
improvements, such as a change to the write ahead log (WAL) threading model
that provides higher transaction throughput under high load. The list of
changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 1 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
Let me vote -1 on 0.98.0RC0 on account of HBASE-10422.
I will spin a new RC today.
On Sat, Jan 25, 2014 at 11:32 AM, Andrew Purtell <ap...@apache.org>wrote:
> The 1st HBase 0.98.0 release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC0/ and Maven artifacts are
> also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1001/
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are also significant
> improvements, such as a change to the write ahead log (WAL) threading model
> that provides higher transaction throughput under high load. The list of
> changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00 -0800 GMT) on February 1 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)