You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Andrew Purtell <ap...@apache.org> on 2014/02/07 03:14:39 UTC
The 3rd HBase 0.98.0 release candidate (RC2) is available for download
The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
http://people.apache.org/~apurtell/0.98.0RC2/<http://people.apache.org/~apurtell/0.98.0RC1/>
and
Maven artifacts are also available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1005<https://repository.apache.org/content/repositories/orgapachehbase-1003>
Signed with my code signing key D5365CCD.
HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
be wire compatible with HBase 0.96, so clients and servers mixed between
these versions will seamlessly interoperate, provided new features
available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
intended to be binary compatible at the Java API level with any HBase 0.96
release or earlier. You may need to recompile applications which reference
the HBase JARs. Users of HBase 0.94 will have to perform an offline data
migration procedure during upgrade. Consult the HBase Online Manual for
more information. It is not necessary to migrate data from 0.94 to 0.98
through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
following the same procedure for upgrading from 0.94 to 0.96.
This release includes several new security features like per-cell
visibility labels, per-cell ACLs, transparent encryption, and related
changes to the coprocessor framework. Please see the Security section of
the HBase Online Manual for more information. There are significant
performance improvements, such as a change to the write ahead log (WAL)
threading model that provides higher transaction throughput under high
load, reverse scanners, MapReduce over snapshot files, and striped
compaction. The list of changes in this release can be found here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
-0800 GMT) on February 13 on whether or not we should release this as
0.98.0.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Ted Yu <yu...@gmail.com>.
+1 based on the following:
- verified md5
- compiles
- run unit test suite which passed
- run LoadTestTool in a 4 node cluster
Cheers
On Thu, Feb 6, 2014 at 10:24 PM, Andrew Purtell <ap...@apache.org> wrote:
> I am informed that the link to RC2 sent in the announcement is actually a
> link to RC1 displaying as "...RC2". Try the below link instead:
>
> http://people.apache.org/~apurtell/0.98.0RC2/
>
>
> On Thursday, February 6, 2014, Andrew Purtell <ap...@apache.org> wrote:
>
> > The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> > http://people.apache.org/~apurtell/0.98.0RC2/<
> http://people.apache.org/~apurtell/0.98.0RC1/> and
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1005<
> https://repository.apache.org/content/repositories/orgapachehbase-1003>
> >
> >
> > Signed with my code signing key D5365CCD.
> >
> > HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> to
> > be wire compatible with HBase 0.96, so clients and servers mixed between
> > these versions will seamlessly interoperate, provided new features
> > available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> not
> > intended to be binary compatible at the Java API level with any HBase
> 0.96
> > release or earlier. You may need to recompile applications which
> reference
> > the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> > migration procedure during upgrade. Consult the HBase Online Manual for
> > more information. It is not necessary to migrate data from 0.94 to 0.98
> > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > following the same procedure for upgrading from 0.94 to 0.96.
> >
> > This release includes several new security features like per-cell
> > visibility labels, per-cell ACLs, transparent encryption, and related
> > changes to the coprocessor framework. Please see the Security section of
> > the HBase Online Manual for more information. There are significant
> > performance improvements, such as a change to the write ahead log (WAL)
> > threading model that provides higher transaction throughput under high
> > load, reverse scanners, MapReduce over snapshot files, and striped
> > compaction. The list of changes in this release can be found here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> >
> >
> > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > (00:00 -0800 GMT) on February 13 on whether or not we should release this
> > as 0.98.0.
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Andrew Purtell <ap...@apache.org>.
I am informed that the link to RC2 sent in the announcement is actually a
link to RC1 displaying as "...RC2". Try the below link instead:
http://people.apache.org/~apurtell/0.98.0RC2/
On Thursday, February 6, 2014, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<http://people.apache.org/~apurtell/0.98.0RC1/> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00 -0800 GMT) on February 13 on whether or not we should release this
> as 0.98.0.
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Nick Dimiduk <nd...@gmail.com>.
On Wed, Feb 12, 2014 at 2:43 PM, Jean-Daniel Cryans <jd...@apache.org>wrote:
> everything looks good except for the annoying "Failed to retrieve
> nio.BufferPool direct MemoryUsed" debug line...
>
That was introduced on HBASE-10116. It only impacts JDK6, as that version
of the JDK doesn't export this bean. I can look into suppressing the
warning when JDK6 is detected if you'd like (though I thought this version
was a dying breed); certainly shouldn't sink the RC. Maybe a cleanup for
1.0? If it bothers you greatly, please file a ticket, assign to me.
-n
On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org> wrote:
>
> > The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> > http://people.apache.org/~apurtell/0.98.0RC2/<
> > http://people.apache.org/~apurtell/0.98.0RC1/>
> > and
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1005<
> > https://repository.apache.org/content/repositories/orgapachehbase-1003>
> >
> >
> > Signed with my code signing key D5365CCD.
> >
> > HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> to
> > be wire compatible with HBase 0.96, so clients and servers mixed between
> > these versions will seamlessly interoperate, provided new features
> > available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> not
> > intended to be binary compatible at the Java API level with any HBase
> 0.96
> > release or earlier. You may need to recompile applications which
> reference
> > the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> > migration procedure during upgrade. Consult the HBase Online Manual for
> > more information. It is not necessary to migrate data from 0.94 to 0.98
> > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > following the same procedure for upgrading from 0.94 to 0.96.
> >
> > This release includes several new security features like per-cell
> > visibility labels, per-cell ACLs, transparent encryption, and related
> > changes to the coprocessor framework. Please see the Security section of
> > the HBase Online Manual for more information. There are significant
> > performance improvements, such as a change to the write ahead log (WAL)
> > threading model that provides higher transaction throughput under high
> > load, reverse scanners, MapReduce over snapshot files, and striped
> > compaction. The list of changes in this release can be found here:
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> >
> >
> > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00
> > -0800 GMT) on February 13 on whether or not we should release this as
> > 0.98.0.
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Aleksandr Shulman <al...@cloudera.com>.
+1 from me.
I ran Integration Tests against an 11-node cluster and they passed.
I also ran our smoke tests against it. That was fine as well.
Finally, we ran a JDiff report and there were no incompatibilities outside
of the ones we discussed in previous RCs.
On Wed, Feb 12, 2014 at 8:46 PM, ramkrishna vasudevan <
ramkrishna.s.vasudevan@gmail.com> wrote:
> +1 from me.
> Downloaded the RC, ran in a 5 RS + 1 Master cluster.
> Tested performance between 0.96 and 0.98 without tags. Not much difference,
> looks the same overall.
> Tested various encoders, looks good.
>
> Tested with visibility labels/ACLs, no exceptions in logs, looks good.
>
> Restart from 0.96.1.1 to 0.98 also looks good.
>
> Regards
> Ram
>
>
> On Thu, Feb 13, 2014 at 9:49 AM, Anoop John <an...@gmail.com> wrote:
>
> > +1
> >
> > Downloaded and verified signatures for hadoop1 and hadoop2.
> >
> > Done feature testing using hadoop2. Tested visibility labels, WAL
> > encryption and cell ACL.
> > Tested tags/visibility labels along with distributed log replay ON. All
> > looks good.
> >
> > Done upgrade test from 96.1.1 to 98. All looks good.
> > Integrations tests run with hadoop1 and hadoop2 . Looks good.
> >
> >
> > -Anoop-
> >
> > On Thu, Feb 13, 2014 at 4:21 AM, Andrew Purtell <ap...@apache.org>
> > wrote:
> >
> > > On Wed, Feb 12, 2014 at 2:43 PM, Jean-Daniel Cryans <
> jdcryans@apache.org
> > > >wrote:
> > >
> > > > everything looks good except
> > > > for the annoying "Failed to retrieve nio.BufferPool direct
> MemoryUsed"
> > > > debug line...
> > > >
> > >
> > > We have a JIRA for that?
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>
--
Best Regards,
Aleks Shulman
847.814.5804
Cloudera
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by ramkrishna vasudevan <ra...@gmail.com>.
+1 from me.
Downloaded the RC, ran in a 5 RS + 1 Master cluster.
Tested performance between 0.96 and 0.98 without tags. Not much difference,
looks the same overall.
Tested various encoders, looks good.
Tested with visibility labels/ACLs, no exceptions in logs, looks good.
Restart from 0.96.1.1 to 0.98 also looks good.
Regards
Ram
On Thu, Feb 13, 2014 at 9:49 AM, Anoop John <an...@gmail.com> wrote:
> +1
>
> Downloaded and verified signatures for hadoop1 and hadoop2.
>
> Done feature testing using hadoop2. Tested visibility labels, WAL
> encryption and cell ACL.
> Tested tags/visibility labels along with distributed log replay ON. All
> looks good.
>
> Done upgrade test from 96.1.1 to 98. All looks good.
> Integrations tests run with hadoop1 and hadoop2 . Looks good.
>
>
> -Anoop-
>
> On Thu, Feb 13, 2014 at 4:21 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > On Wed, Feb 12, 2014 at 2:43 PM, Jean-Daniel Cryans <jdcryans@apache.org
> > >wrote:
> >
> > > everything looks good except
> > > for the annoying "Failed to retrieve nio.BufferPool direct MemoryUsed"
> > > debug line...
> > >
> >
> > We have a JIRA for that?
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Anoop John <an...@gmail.com>.
+1
Downloaded and verified signatures for hadoop1 and hadoop2.
Done feature testing using hadoop2. Tested visibility labels, WAL
encryption and cell ACL.
Tested tags/visibility labels along with distributed log replay ON. All
looks good.
Done upgrade test from 96.1.1 to 98. All looks good.
Integrations tests run with hadoop1 and hadoop2 . Looks good.
-Anoop-
On Thu, Feb 13, 2014 at 4:21 AM, Andrew Purtell <ap...@apache.org> wrote:
> On Wed, Feb 12, 2014 at 2:43 PM, Jean-Daniel Cryans <jdcryans@apache.org
> >wrote:
>
> > everything looks good except
> > for the annoying "Failed to retrieve nio.BufferPool direct MemoryUsed"
> > debug line...
> >
>
> We have a JIRA for that?
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Andrew Purtell <ap...@apache.org>.
On Wed, Feb 12, 2014 at 2:43 PM, Jean-Daniel Cryans <jd...@apache.org>wrote:
> everything looks good except
> for the annoying "Failed to retrieve nio.BufferPool direct MemoryUsed"
> debug line...
>
We have a JIRA for that?
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Jean-Daniel Cryans <jd...@apache.org>.
+1
Downloaded the hadoop2 tarball, ran some PE, everything looks good except
for the annoying "Failed to retrieve nio.BufferPool direct MemoryUsed"
debug line...
J-D
On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<
> http://people.apache.org/~apurtell/0.98.0RC1/>
> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<
> https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 13 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Andrew Purtell <ap...@apache.org>.
+1
I checked signatures and tarballs while making the RC.
I have also done some testing of 0.98.0RC2 with Hadoop 2.3.0-SNAPSHOT, and
things seem good. Ran LoadTestTool against a small cluster, mixed
read/write load, and latencies and operation/sec measurements were within
the range I would expect. No errors or unexpected messages in the logs. I
then repeated this with HFile V3, HFile encryption enabled, WAL encryption
enabled, with all of the security coprocessors installed (AccessController,
TokenProvider, and VisibilityController), with encryption specified in the
schema, with encryption and compression specified in the schema. Nothing
strange seen.
On Wed, Feb 12, 2014 at 12:29 PM, Stack <st...@duboce.net> wrote:
> +1 (again).
>
> Ran RC on the hadoop 2.3.0 RC under a load. Seems fine (The httpserver
> stuff is all good).
>
> Ran asychbase test suite against the candidate. It found a change in
> semantics from 0.96 -- see tail of HBASE-10252 -- but I think we just doc
> the new behavior and move on.
>
> TSDB 2.0 seems to work fine too. We just need to get hbase 0.96 reporting
> hooked up again since 'new metrics' went in.
>
> St.Ack
>
>
> On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> > http://people.apache.org/~apurtell/0.98.0RC2/<
> > http://people.apache.org/~apurtell/0.98.0RC1/>
> > and
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1005<
> > https://repository.apache.org/content/repositories/orgapachehbase-1003>
> >
> >
> > Signed with my code signing key D5365CCD.
> >
> > HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> to
> > be wire compatible with HBase 0.96, so clients and servers mixed between
> > these versions will seamlessly interoperate, provided new features
> > available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> not
> > intended to be binary compatible at the Java API level with any HBase
> 0.96
> > release or earlier. You may need to recompile applications which
> reference
> > the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> > migration procedure during upgrade. Consult the HBase Online Manual for
> > more information. It is not necessary to migrate data from 0.94 to 0.98
> > through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > following the same procedure for upgrading from 0.94 to 0.96.
> >
> > This release includes several new security features like per-cell
> > visibility labels, per-cell ACLs, transparent encryption, and related
> > changes to the coprocessor framework. Please see the Security section of
> > the HBase Online Manual for more information. There are significant
> > performance improvements, such as a change to the write ahead log (WAL)
> > threading model that provides higher transaction throughput under high
> > load, reverse scanners, MapReduce over snapshot files, and striped
> > compaction. The list of changes in this release can be found here:
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> >
> >
> > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00
> > -0800 GMT) on February 13 on whether or not we should release this as
> > 0.98.0.
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Stack <st...@duboce.net>.
+1 (again).
Ran RC on the hadoop 2.3.0 RC under a load. Seems fine (The httpserver
stuff is all good).
Ran asychbase test suite against the candidate. It found a change in
semantics from 0.96 -- see tail of HBASE-10252 -- but I think we just doc
the new behavior and move on.
TSDB 2.0 seems to work fine too. We just need to get hbase 0.96 reporting
hooked up again since 'new metrics' went in.
St.Ack
On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<
> http://people.apache.org/~apurtell/0.98.0RC1/>
> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<
> https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 13 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Enis Söztutar <en...@apache.org>.
+1
- Downloaded artifacts for -hadoop1-bin -hadoop2-bin and -src
- Verified checksums for the artifacts
- Verified signatures
- Checked out documentation
- Checked out layouts for artifacts
- Verified hadoop versions
- Run local cluster
- Build source artifact with hadoop1 and hadoop2
- bin/hbase org.apache.hadoop.hbase.util.LoadTestTool -write 10:10:100
-num_keys 1000000 -read 100:30
Enis
On Sat, Feb 8, 2014 at 1:37 AM, ramkrishna vasudevan <
ramkrishna.s.vasudevan@gmail.com> wrote:
> Hi All
>
> Thanks to all those who given a try on this RC.
> Just a small suggestion. May be when you try out the RC it would be great
> if you can try with HFile Version 3.
>
> Regards
> Ram
>
>
>
> On Sat, Feb 8, 2014 at 7:40 AM, Stack <st...@duboce.net> wrote:
>
> > Let me retract for the moment. I want to make sure opentsdb works smooth
> > before I +1'ing. I'll be back.
> > St.Ack
> >
> >
> > On Fri, Feb 7, 2014 at 3:06 PM, Stack <st...@duboce.net> wrote:
> >
> > > +1
> > >
> > > I added a 0.98.0RC2 RS and M to a 6-node 0.96.x cluster under load.
> All
> > > kept going and all looks good digging in logs. Its been running for
> the
> > > last few hours.
> > >
> > > I checked the md5.
> > >
> > > Poked around the untar and it looks right. Docs have right labels and
> > > links basically work.
> > >
> > > St.Ack
> > >
> > >
> > >
> > >
> > >
> > > On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <apurtell@apache.org
> > >wrote:
> > >
> > >> The 3rd HBase 0.98.0 release candidate (RC2) is available for download
> > at
> > >> http://people.apache.org/~apurtell/0.98.0RC2/<
> > >> http://people.apache.org/~apurtell/0.98.0RC1/>
> > >> and
> > >> Maven artifacts are also available in the temporary repository
> > >>
> https://repository.apache.org/content/repositories/orgapachehbase-1005<
> > >>
> https://repository.apache.org/content/repositories/orgapachehbase-1003>
> > >>
> > >>
> > >> Signed with my code signing key D5365CCD.
> > >>
> > >> HBase 0.98.0 is the next major release after HBase 0.96. It is
> expected
> > to
> > >> be wire compatible with HBase 0.96, so clients and servers mixed
> between
> > >> these versions will seamlessly interoperate, provided new features
> > >> available in 0.98 are not enabled. However, the HBase 0.98.0 release
> is
> > >> not
> > >> intended to be binary compatible at the Java API level with any HBase
> > 0.96
> > >> release or earlier. You may need to recompile applications which
> > reference
> > >> the HBase JARs. Users of HBase 0.94 will have to perform an offline
> data
> > >> migration procedure during upgrade. Consult the HBase Online Manual
> for
> > >> more information. It is not necessary to migrate data from 0.94 to
> 0.98
> > >> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> > >> following the same procedure for upgrading from 0.94 to 0.96.
> > >>
> > >> This release includes several new security features like per-cell
> > >> visibility labels, per-cell ACLs, transparent encryption, and related
> > >> changes to the coprocessor framework. Please see the Security section
> of
> > >> the HBase Online Manual for more information. There are significant
> > >> performance improvements, such as a change to the write ahead log
> (WAL)
> > >> threading model that provides higher transaction throughput under high
> > >> load, reverse scanners, MapReduce over snapshot files, and striped
> > >> compaction. The list of changes in this release can be found here:
> > >>
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> > >>
> > >>
> > >> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > >> (00:00
> > >> -0800 GMT) on February 13 on whether or not we should release this as
> > >> 0.98.0.
> > >>
> > >> --
> > >> Best regards,
> > >>
> > >> - Andy
> > >>
> > >> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > >> (via Tom White)
> > >>
> > >
> > >
> >
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by ramkrishna vasudevan <ra...@gmail.com>.
Hi All
Thanks to all those who given a try on this RC.
Just a small suggestion. May be when you try out the RC it would be great
if you can try with HFile Version 3.
Regards
Ram
On Sat, Feb 8, 2014 at 7:40 AM, Stack <st...@duboce.net> wrote:
> Let me retract for the moment. I want to make sure opentsdb works smooth
> before I +1'ing. I'll be back.
> St.Ack
>
>
> On Fri, Feb 7, 2014 at 3:06 PM, Stack <st...@duboce.net> wrote:
>
> > +1
> >
> > I added a 0.98.0RC2 RS and M to a 6-node 0.96.x cluster under load. All
> > kept going and all looks good digging in logs. Its been running for the
> > last few hours.
> >
> > I checked the md5.
> >
> > Poked around the untar and it looks right. Docs have right labels and
> > links basically work.
> >
> > St.Ack
> >
> >
> >
> >
> >
> > On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <apurtell@apache.org
> >wrote:
> >
> >> The 3rd HBase 0.98.0 release candidate (RC2) is available for download
> at
> >> http://people.apache.org/~apurtell/0.98.0RC2/<
> >> http://people.apache.org/~apurtell/0.98.0RC1/>
> >> and
> >> Maven artifacts are also available in the temporary repository
> >> https://repository.apache.org/content/repositories/orgapachehbase-1005<
> >> https://repository.apache.org/content/repositories/orgapachehbase-1003>
> >>
> >>
> >> Signed with my code signing key D5365CCD.
> >>
> >> HBase 0.98.0 is the next major release after HBase 0.96. It is expected
> to
> >> be wire compatible with HBase 0.96, so clients and servers mixed between
> >> these versions will seamlessly interoperate, provided new features
> >> available in 0.98 are not enabled. However, the HBase 0.98.0 release is
> >> not
> >> intended to be binary compatible at the Java API level with any HBase
> 0.96
> >> release or earlier. You may need to recompile applications which
> reference
> >> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> >> migration procedure during upgrade. Consult the HBase Online Manual for
> >> more information. It is not necessary to migrate data from 0.94 to 0.98
> >> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> >> following the same procedure for upgrading from 0.94 to 0.96.
> >>
> >> This release includes several new security features like per-cell
> >> visibility labels, per-cell ACLs, transparent encryption, and related
> >> changes to the coprocessor framework. Please see the Security section of
> >> the HBase Online Manual for more information. There are significant
> >> performance improvements, such as a change to the write ahead log (WAL)
> >> threading model that provides higher transaction throughput under high
> >> load, reverse scanners, MapReduce over snapshot files, and striped
> >> compaction. The list of changes in this release can be found here:
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
> >>
> >>
> >> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> >> (00:00
> >> -0800 GMT) on February 13 on whether or not we should release this as
> >> 0.98.0.
> >>
> >> --
> >> Best regards,
> >>
> >> - Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> >> (via Tom White)
> >>
> >
> >
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Stack <st...@duboce.net>.
Let me retract for the moment. I want to make sure opentsdb works smooth
before I +1'ing. I'll be back.
St.Ack
On Fri, Feb 7, 2014 at 3:06 PM, Stack <st...@duboce.net> wrote:
> +1
>
> I added a 0.98.0RC2 RS and M to a 6-node 0.96.x cluster under load. All
> kept going and all looks good digging in logs. Its been running for the
> last few hours.
>
> I checked the md5.
>
> Poked around the untar and it looks right. Docs have right labels and
> links basically work.
>
> St.Ack
>
>
>
>
>
> On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org>wrote:
>
>> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
>> http://people.apache.org/~apurtell/0.98.0RC2/<
>> http://people.apache.org/~apurtell/0.98.0RC1/>
>> and
>> Maven artifacts are also available in the temporary repository
>> https://repository.apache.org/content/repositories/orgapachehbase-1005<
>> https://repository.apache.org/content/repositories/orgapachehbase-1003>
>>
>>
>> Signed with my code signing key D5365CCD.
>>
>> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
>> be wire compatible with HBase 0.96, so clients and servers mixed between
>> these versions will seamlessly interoperate, provided new features
>> available in 0.98 are not enabled. However, the HBase 0.98.0 release is
>> not
>> intended to be binary compatible at the Java API level with any HBase 0.96
>> release or earlier. You may need to recompile applications which reference
>> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
>> migration procedure during upgrade. Consult the HBase Online Manual for
>> more information. It is not necessary to migrate data from 0.94 to 0.98
>> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
>> following the same procedure for upgrading from 0.94 to 0.96.
>>
>> This release includes several new security features like per-cell
>> visibility labels, per-cell ACLs, transparent encryption, and related
>> changes to the coprocessor framework. Please see the Security section of
>> the HBase Online Manual for more information. There are significant
>> performance improvements, such as a change to the write ahead log (WAL)
>> threading model that provides higher transaction throughput under high
>> load, reverse scanners, MapReduce over snapshot files, and striped
>> compaction. The list of changes in this release can be found here:
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>>
>>
>> Please try out the candidate and vote +1/-1 by midnight Pacific Time
>> (00:00
>> -0800 GMT) on February 13 on whether or not we should release this as
>> 0.98.0.
>>
>> --
>> Best regards,
>>
>> - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
>>
>
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Stack <st...@duboce.net>.
+1
I added a 0.98.0RC2 RS and M to a 6-node 0.96.x cluster under load. All
kept going and all looks good digging in logs. Its been running for the
last few hours.
I checked the md5.
Poked around the untar and it looks right. Docs have right labels and
links basically work.
St.Ack
On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<
> http://people.apache.org/~apurtell/0.98.0RC1/>
> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<
> https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 13 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Stack <st...@duboce.net>.
+1 (again).
Ran RC on the hadoop 2.3.0 RC under a load. Seems fine (The httpserver
stuff is all good).
Ran asychbase test suite against the candidate. It found a change in
semantics from 0.96 -- see tail of HBASE-10252 -- but I think we just doc
the new behavior and move on.
TSDB 2.0 seems to work fine too. We just need to get hbase 0.96 reporting
hooked up again since 'new metrics' went in.
St.Ack
On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<
> http://people.apache.org/~apurtell/0.98.0RC1/>
> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<
> https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time (00:00
> -0800 GMT) on February 13 on whether or not we should release this as
> 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Andrew Purtell <ap...@apache.org>.
With 8 +1 votes (6 binding), no +/- 0 votes, and no -1 votes, this vote
carries. RC2 is Apache HBase 0.98.0. Let me work on getting the release
bits into place.
A big thank you to all contributors to and testers of this release!
On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<http://people.apache.org/~apurtell/0.98.0RC1/> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00 -0800 GMT) on February 13 on whether or not we should release this
> as 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Andrew Purtell <ap...@apache.org>.
With 8 +1 votes (6 binding), no +/- 0 votes, and no -1 votes, this vote
carries. RC2 is Apache HBase 0.98.0. Let me work on getting the release
bits into place.
A big thank you to all contributors to and testers of this release!
On Thu, Feb 6, 2014 at 6:14 PM, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<http://people.apache.org/~apurtell/0.98.0RC1/> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00 -0800 GMT) on February 13 on whether or not we should release this
> as 0.98.0.
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: The 3rd HBase 0.98.0 release candidate (RC2) is available for download
Posted by Andrew Purtell <ap...@apache.org>.
I am informed that the link to RC2 sent in the announcement is actually a
link to RC1 displaying as "...RC2". Try the below link instead:
http://people.apache.org/~apurtell/0.98.0RC2/
On Thursday, February 6, 2014, Andrew Purtell <ap...@apache.org> wrote:
> The 3rd HBase 0.98.0 release candidate (RC2) is available for download at
> http://people.apache.org/~apurtell/0.98.0RC2/<http://people.apache.org/~apurtell/0.98.0RC1/> and
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1005<https://repository.apache.org/content/repositories/orgapachehbase-1003>
>
>
> Signed with my code signing key D5365CCD.
>
> HBase 0.98.0 is the next major release after HBase 0.96. It is expected to
> be wire compatible with HBase 0.96, so clients and servers mixed between
> these versions will seamlessly interoperate, provided new features
> available in 0.98 are not enabled. However, the HBase 0.98.0 release is not
> intended to be binary compatible at the Java API level with any HBase 0.96
> release or earlier. You may need to recompile applications which reference
> the HBase JARs. Users of HBase 0.94 will have to perform an offline data
> migration procedure during upgrade. Consult the HBase Online Manual for
> more information. It is not necessary to migrate data from 0.94 to 0.98
> through 0.96, you can upgrade from 0.94 to 0.98 directly if desired
> following the same procedure for upgrading from 0.94 to 0.96.
>
> This release includes several new security features like per-cell
> visibility labels, per-cell ACLs, transparent encryption, and related
> changes to the coprocessor framework. Please see the Security section of
> the HBase Online Manual for more information. There are significant
> performance improvements, such as a change to the write ahead log (WAL)
> threading model that provides higher transaction throughput under high
> load, reverse scanners, MapReduce over snapshot files, and striped
> compaction. The list of changes in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12323143
>
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00 -0800 GMT) on February 13 on whether or not we should release this
> as 0.98.0.
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)