You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by lars hofhansl <la...@apache.org> on 2013/09/11 22:15:14 UTC

[VOTE] The 1st hbase 0.94.12 release candidate is available for download

The 1st 0.94.12 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.12-rc0/
Signed with my code signing key: C7CFE328

As before 0.94.12 is mostly a bug fix release and has 33 issues resolved against it:
    [HBASE-9277] - REST should use listTableNames to list tables
    [HBASE-9279] - Thrift should use listTableNames to list tables
    [HBASE-7709] - Infinite loop possible in Master/Master replication
    [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid extra sleep
    [HBASE-8760] - possible loss of data in snapshot taken after region split
    [HBASE-8930] - Filter evaluates KVs outside requested columns
    [HBASE-9167] - ServerCallable retries just once if timeout is not integer.max
    [HBASE-9182] - Allow non-admin users to list all table names
    [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
    [HBASE-9207] - An Offline SplitParent Region can be assigned breaking split references
    [HBASE-9231] - Multipage book is generated to the wrong location
    [HBASE-9233] - isTableAvailable() may be stuck if an offline parent was never assigned
    [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be deprecated in 0.94
    [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
    [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is synchronous
    [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't update if the slave regionserver is stalled
    [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
    [HBASE-9303] - Snapshot restore of table which splits after snapshot was taken encounters 'Region is not online'
    [HBASE-9326] - ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address. Revert HBASE-8640
    [HBASE-9329] - SnapshotManager should check for directory existance before throwing a warning.
    [HBASE-9344] - RegionServer not shutting down upon KeeperException in open region
    [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared incorrectly
    [HBASE-9397] - Snapshots with the same name are allowed to proceed concurrently
    [HBASE-9415] - In rpcServer, replicationQueue is initialized with the max queue size instead of the max queue lenght
    [HBASE-9428] - Regex filters are at least an order of magnitude slower since 0.94.3
    [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration conf,byte[] tablename,boolean offlined) method
    [HBASE-9432] - Backport HBASE-8781 to 0.94
    [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if talking to older servers
    [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7' to 0.94
    [HBASE-9243] - Add more useful statistics in the HFile tool
    [HBASE-9314] - Dropping a table always prints a TableInfoMissingException in the master log
    [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at large scale"
    [HBASE-9287] - TestCatalogTracker depends on the execution order

The list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790

Here're the jenkins runs for this RC: https://builds.apache.org/job/HBase-0.94.12/4/ and https://builds.apache.org/job/HBase-0.94.12-security/5/

Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by September 18th on whether we should release this as 0.94.12.

Thanks.

-- Lars

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by James Taylor <jt...@salesforce.com>.
Looks good, Lars. I tried creating tables, upserting values, and querying
against Phoenix 1.2.1, Phoenix 2.0.1, and Phoenix 2.1.0-SNAPSHOT, and
everything worked great.

Thanks,
James


On Thu, Sep 12, 2013 at 3:00 PM, lars hofhansl <la...@apache.org> wrote:

> Thanks, JM!
>
>
>
> ________________________________
>  From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Sent: Thursday, September 12, 2013 12:19 PM
> Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available
> for download
>
>
> Downloaded, checked the signature of the 2 versions, uncompressed, checked
> changes.txt and documentation => Fine.
> Passed the test suite successfully.
> Logs, WebUI, HBCK all fine.
> Manually created one table, put, scan, drop. => Fine
> Running performance evaluation. In progress. So far FilteredScanTest
> results are similar to previous version. Will publish the other results
> when available.
> Deployed on 8 physical nodes. Rolling restart RS then Master, checked UI
> and logs => Fine.
> Changed balancer to default, stopped, mass merged a table into a single
> region, re-start, major_compact to get it splitted back => Fine.
> Restored customed balancer, stop/start again, got everything moved over the
> nodes correctly.
> Ran 2 MR jobs. One row count and a home made one, all fine again.
> Performances over MR jobs seems to be aligned to previous version.
> Ran LoadTestTools, IntegrationTestLoadAndVerify and
> IntegrationTestBigLinkedList => Fine
>
> +1 for me.
>
>
> 2013/9/11 lars hofhansl <la...@apache.org>
>
> > The 1st 0.94.12 RC is available for download at
> > http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> > Signed with my code signing key: C7CFE328
> >
> > As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
> > against it:
> >     [HBASE-9277] - REST should use listTableNames to list tables
> >     [HBASE-9279] - Thrift should use listTableNames to list tables
> >     [HBASE-7709] - Infinite loop possible in Master/Master replication
> >     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> > extra sleep
> >     [HBASE-8760] - possible loss of data in snapshot taken after region
> > split
> >     [HBASE-8930] - Filter evaluates KVs outside requested columns
> >     [HBASE-9167] - ServerCallable retries just once if timeout is not
> > integer.max
> >     [HBASE-9182] - Allow non-admin users to list all table names
> >     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
> >     [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
> > split references
> >     [HBASE-9231] - Multipage book is generated to the wrong location
> >     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> > was never assigned
> >     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> > deprecated in 0.94
> >     [HBASE-9256] - HBaseClient#setupIOStreams should handle all
> exceptions
> >     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> > synchronous
> >     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> > update if the slave regionserver is stalled
> >     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
> >     [HBASE-9303] - Snapshot restore of table which splits after snapshot
> > was taken encounters 'Region is not online'
> >     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> > breaks binding to the wildcard address. Revert HBASE-8640
> >     [HBASE-9329] - SnapshotManager should check for directory existance
> > before throwing a warning.
> >     [HBASE-9344] - RegionServer not shutting down upon KeeperException in
> > open region
> >     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> > incorrectly
> >     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> > concurrently
> >     [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
> > max queue size instead of the max queue lenght
> >     [HBASE-9428] - Regex filters are at least an order of magnitude
> slower
> > since 0.94.3
> >     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> > conf,byte[] tablename,boolean offlined) method
> >     [HBASE-9432] - Backport HBASE-8781 to 0.94
> >     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> > talking to older servers
> >     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
> > to 0.94
> >     [HBASE-9243] - Add more useful statistics in the HFile tool
> >     [HBASE-9314] - Dropping a table always prints a
> > TableInfoMissingException in the master log
> >     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> > large scale"
> >     [HBASE-9287] - TestCatalogTracker depends on the execution order
> >
> > The list of changes is also available here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
> >
> > Here're the jenkins runs for this RC:
> > https://builds.apache.org/job/HBase-0.94.12/4/ and
> > https://builds.apache.org/job/HBase-0.94.12-security/5/
> >
> > Please try out the RC, check out the doc, take it for a spin, etc, and
> > vote +1/-1 by September 18th on whether we should release this as
> 0.94.12.
> >
> > Thanks.
> >
> > -- Lars
>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Thanks, JM!



________________________________
 From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org>; lars hofhansl <la...@apache.org> 
Sent: Thursday, September 12, 2013 12:19 PM
Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download
 

Downloaded, checked the signature of the 2 versions, uncompressed, checked
changes.txt and documentation => Fine.
Passed the test suite successfully.
Logs, WebUI, HBCK all fine.
Manually created one table, put, scan, drop. => Fine
Running performance evaluation. In progress. So far FilteredScanTest
results are similar to previous version. Will publish the other results
when available.
Deployed on 8 physical nodes. Rolling restart RS then Master, checked UI
and logs => Fine.
Changed balancer to default, stopped, mass merged a table into a single
region, re-start, major_compact to get it splitted back => Fine.
Restored customed balancer, stop/start again, got everything moved over the
nodes correctly.
Ran 2 MR jobs. One row count and a home made one, all fine again.
Performances over MR jobs seems to be aligned to previous version.
Ran LoadTestTools, IntegrationTestLoadAndVerify and
IntegrationTestBigLinkedList => Fine

+1 for me.


2013/9/11 lars hofhansl <la...@apache.org>

> The 1st 0.94.12 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> Signed with my code signing key: C7CFE328
>
> As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
> against it:
>     [HBASE-9277] - REST should use listTableNames to list tables
>     [HBASE-9279] - Thrift should use listTableNames to list tables
>     [HBASE-7709] - Infinite loop possible in Master/Master replication
>     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> extra sleep
>     [HBASE-8760] - possible loss of data in snapshot taken after region
> split
>     [HBASE-8930] - Filter evaluates KVs outside requested columns
>     [HBASE-9167] - ServerCallable retries just once if timeout is not
> integer.max
>     [HBASE-9182] - Allow non-admin users to list all table names
>     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>     [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
> split references
>     [HBASE-9231] - Multipage book is generated to the wrong location
>     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> was never assigned
>     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> deprecated in 0.94
>     [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
>     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> synchronous
>     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> update if the slave regionserver is stalled
>     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>     [HBASE-9303] - Snapshot restore of table which splits after snapshot
> was taken encounters 'Region is not online'
>     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> breaks binding to the wildcard address. Revert HBASE-8640
>     [HBASE-9329] - SnapshotManager should check for directory existance
> before throwing a warning.
>     [HBASE-9344] - RegionServer not shutting down upon KeeperException in
> open region
>     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> incorrectly
>     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> concurrently
>     [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
> max queue size instead of the max queue lenght
>     [HBASE-9428] - Regex filters are at least an order of magnitude slower
> since 0.94.3
>     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> conf,byte[] tablename,boolean offlined) method
>     [HBASE-9432] - Backport HBASE-8781 to 0.94
>     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> talking to older servers
>     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
> to 0.94
>     [HBASE-9243] - Add more useful statistics in the HFile tool
>     [HBASE-9314] - Dropping a table always prints a
> TableInfoMissingException in the master log
>     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> large scale"
>     [HBASE-9287] - TestCatalogTracker depends on the execution order
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.12/4/ and
> https://builds.apache.org/job/HBase-0.94.12-security/5/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by September 18th on whether we should release this as 0.94.12.
>
> Thanks.
>
> -- Lars

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Downloaded, checked the signature of the 2 versions, uncompressed, checked
changes.txt and documentation => Fine.
Passed the test suite successfully.
Logs, WebUI, HBCK all fine.
Manually created one table, put, scan, drop. => Fine
Running performance evaluation. In progress. So far FilteredScanTest
results are similar to previous version. Will publish the other results
when available.
Deployed on 8 physical nodes. Rolling restart RS then Master, checked UI
and logs => Fine.
Changed balancer to default, stopped, mass merged a table into a single
region, re-start, major_compact to get it splitted back => Fine.
Restored customed balancer, stop/start again, got everything moved over the
nodes correctly.
Ran 2 MR jobs. One row count and a home made one, all fine again.
Performances over MR jobs seems to be aligned to previous version.
Ran LoadTestTools, IntegrationTestLoadAndVerify and
IntegrationTestBigLinkedList => Fine

+1 for me.


2013/9/11 lars hofhansl <la...@apache.org>

> The 1st 0.94.12 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> Signed with my code signing key: C7CFE328
>
> As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
> against it:
>     [HBASE-9277] - REST should use listTableNames to list tables
>     [HBASE-9279] - Thrift should use listTableNames to list tables
>     [HBASE-7709] - Infinite loop possible in Master/Master replication
>     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> extra sleep
>     [HBASE-8760] - possible loss of data in snapshot taken after region
> split
>     [HBASE-8930] - Filter evaluates KVs outside requested columns
>     [HBASE-9167] - ServerCallable retries just once if timeout is not
> integer.max
>     [HBASE-9182] - Allow non-admin users to list all table names
>     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>     [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
> split references
>     [HBASE-9231] - Multipage book is generated to the wrong location
>     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> was never assigned
>     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> deprecated in 0.94
>     [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
>     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> synchronous
>     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> update if the slave regionserver is stalled
>     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>     [HBASE-9303] - Snapshot restore of table which splits after snapshot
> was taken encounters 'Region is not online'
>     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> breaks binding to the wildcard address. Revert HBASE-8640
>     [HBASE-9329] - SnapshotManager should check for directory existance
> before throwing a warning.
>     [HBASE-9344] - RegionServer not shutting down upon KeeperException in
> open region
>     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> incorrectly
>     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> concurrently
>     [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
> max queue size instead of the max queue lenght
>     [HBASE-9428] - Regex filters are at least an order of magnitude slower
> since 0.94.3
>     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> conf,byte[] tablename,boolean offlined) method
>     [HBASE-9432] - Backport HBASE-8781 to 0.94
>     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> talking to older servers
>     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
> to 0.94
>     [HBASE-9243] - Add more useful statistics in the HFile tool
>     [HBASE-9314] - Dropping a table always prints a
> TableInfoMissingException in the master log
>     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> large scale"
>     [HBASE-9287] - TestCatalogTracker depends on the execution order
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.12/4/ and
> https://builds.apache.org/job/HBase-0.94.12-security/5/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by September 18th on whether we should release this as 0.94.12.
>
> Thanks.
>
> -- Lars

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by Nick Dimiduk <nd...@gmail.com>.
I believe the change in interface also breaks NGDATA's hbase-indexer.


On Tue, Sep 17, 2013 at 3:58 PM, Jesse Yates <je...@gmail.com>wrote:

> -1 WALEdit interface got changed, which broke Phoenix mutable indexing (we
> implement our own WALEdit to read them back in with our special KeyValue
> type).
>
> Looks like getScopes/setScopes interface changed to
> getFromScope/putIntoScope. We could do a shim layer... but that's really
> really ugly for managing between versions of 0.94. I'd rather add those
> methods back and keep the new ones for the circular replication fix for
> which they were added.
>
> -------------------
> Jesse Yates
> @jesse_yates
> jyates.github.com
>
>
> On Tue, Sep 17, 2013 at 12:45 PM, lars hofhansl <la...@apache.org> wrote:
>
> > Thanks Stack.
> >
> > 2 binding, 3 non binding +1's.
> > Going to release later today.
> >
> > -- Lars
> >
> >
> >
> > ________________________________
> >  From: Stack <st...@duboce.net>
> > To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <
> larsh@apache.org
> > >
> > Sent: Tuesday, September 17, 2013 11:58 AM
> > Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available
> > for download
> >
> >
> > +1
> >
> > Checked md5 and signature.
> >
> > Checked out doc, UI, and unbundled layout.
> >
> > Ran a bulk load and confirmed all made it there in standalone mode.
> >
> > Checked logs.  Nothing untoward.
> >
> > St.Ack
> >
> >
> > On Wed, Sep 11, 2013 at 1:15 PM, lars hofhansl <la...@apache.org> wrote:
> >
> > > The 1st 0.94.12 RC is available for download at
> > > http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> > > Signed with my code signing key: C7CFE328
> > >
> > > As before 0.94.12 is mostly a bug fix release and has 33 issues
> resolved
> > > against it:
> > >     [HBASE-9277] - REST should use listTableNames to list tables
> > >     [HBASE-9279] - Thrift should use listTableNames to list tables
> > >     [HBASE-7709] - Infinite loop possible in Master/Master replication
> > >     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> > > extra sleep
> > >     [HBASE-8760] - possible loss of data in snapshot taken after region
> > > split
> > >     [HBASE-8930] - Filter evaluates KVs outside requested columns
> > >     [HBASE-9167] - ServerCallable retries just once if timeout is not
> > > integer.max
> > >     [HBASE-9182] - Allow non-admin users to list all table names
> > >     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
> > >     [HBASE-9207] - An Offline SplitParent Region can be assigned
> breaking
> > > split references
> > >     [HBASE-9231] - Multipage book is generated to the wrong location
> > >     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> > > was never assigned
> > >     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> > > deprecated in 0.94
> > >     [HBASE-9256] - HBaseClient#setupIOStreams should handle all
> > exceptions
> > >     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> > > synchronous
> > >     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> > > update if the slave regionserver is stalled
> > >     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
> > >     [HBASE-9303] - Snapshot restore of table which splits after
> snapshot
> > > was taken encounters 'Region is not online'
> > >     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> > > breaks binding to the wildcard address. Revert HBASE-8640
> > >     [HBASE-9329] - SnapshotManager should check for directory existance
> > > before throwing a warning.
> > >     [HBASE-9344] - RegionServer not shutting down upon KeeperException
> in
> > > open region
> > >     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> > > incorrectly
> > >     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> > > concurrently
> > >     [HBASE-9415] - In rpcServer, replicationQueue is initialized with
> the
> > > max queue size instead of the max queue lenght
> > >     [HBASE-9428] - Regex filters are at least an order of magnitude
> > slower
> > > since 0.94.3
> > >     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> > > conf,byte[] tablename,boolean offlined) method
> > >     [HBASE-9432] - Backport HBASE-8781 to 0.94
> > >     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> > > talking to older servers
> > >     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with
> jdk1.7'
> > > to 0.94
> > >     [HBASE-9243] - Add more useful statistics in the HFile tool
> > >     [HBASE-9314] - Dropping a table always prints a
> > > TableInfoMissingException in the master log
> > >     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> > > large scale"
> > >     [HBASE-9287] - TestCatalogTracker depends on the execution order
> > >
> > > The list of changes is also available here:
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
> > >
> > > Here're the jenkins runs for this RC:
> > > https://builds.apache.org/job/HBase-0.94.12/4/ and
> > > https://builds.apache.org/job/HBase-0.94.12-security/5/
> > >
> > > Please try out the RC, check out the doc, take it for a spin, etc, and
> > > vote +1/-1 by September 18th on whether we should release this as
> > 0.94.12.
> > >
> > > Thanks.
> > >
> > > -- Lars
> >
>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Next RC tagged. Waiting for jenkins now. Expect a new RC soon.



________________________________
 From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org> 
Sent: Tuesday, September 17, 2013 6:03 PM
Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download
 

Consider it sunk.
New RC coming tonight. (If HBASE-9566 is fixed)


-- Lars



________________________________
From: Jesse Yates <je...@gmail.com>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org> 
Sent: Tuesday, September 17, 2013 4:26 PM
Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download


Filed HBASE-9566 <https://issues.apache.org/jira/browse/HBASE-9566> (and
added patch).

-------------------
Jesse Yates
@jesse_yates
jyates.github.com


On Tue, Sep 17, 2013 at 3:58 PM, Jesse Yates <je...@gmail.com>wrote:

> -1 WALEdit interface got changed, which broke Phoenix mutable indexing (we
> implement our own WALEdit to read them back in with our special KeyValue
> type).
>
> Looks like getScopes/setScopes interface changed to
> getFromScope/putIntoScope. We could do a shim layer... but that's really
> really ugly for managing between versions of 0.94. I'd rather add those
> methods back and keep the new ones for the circular replication fix for
> which they were added.
>
> -------------------
> Jesse Yates
> @jesse_yates
> jyates.github.com
>
>
> On Tue, Sep 17, 2013 at 12:45 PM, lars hofhansl <la...@apache.org> wrote:
>
>> Thanks Stack.
>>
>> 2 binding, 3 non binding +1's.
>> Going to release later today.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Stack <st...@duboce.net>
>> To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <
>> larsh@apache.org>
>> Sent: Tuesday, September 17, 2013 11:58 AM
>> Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available
>> for download
>>
>>
>> +1
>>
>> Checked md5 and signature.
>>
>> Checked out doc, UI, and unbundled layout.
>>
>> Ran a bulk load and confirmed all made it there in standalone mode.
>>
>> Checked logs.  Nothing untoward.
>>
>> St.Ack
>>
>>
>> On Wed, Sep 11, 2013 at 1:15 PM, lars hofhansl <la...@apache.org> wrote:
>>
>> > The 1st 0.94.12 RC is available for download at
>> > http://people.apache.org/~larsh/hbase-0.94.12-rc0/
>> > Signed with my code signing key: C7CFE328
>> >
>> > As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
>> > against it:
>> >     [HBASE-9277] - REST should use listTableNames to list tables
>> >     [HBASE-9279] - Thrift should use listTableNames to list tables
>> >     [HBASE-7709] - Infinite loop possible in Master/Master replication
>> >     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
>> > extra sleep
>> >     [HBASE-8760] - possible loss of data in snapshot taken after region
>> > split
>> >     [HBASE-8930] - Filter evaluates KVs outside requested columns
>> >     [HBASE-9167] - ServerCallable retries just once if timeout is not
>> > integer.max
>> >     [HBASE-9182] - Allow non-admin users to list all table names
>> >     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>> >     [HBASE-9207] - An Offline SplitParent Region can be assigned
>> breaking
>> > split references
>> >     [HBASE-9231] - Multipage book is generated to the wrong location
>> >     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
>> > was never assigned
>> >     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
>> > deprecated in 0.94
>> >     [HBASE-9256] - HBaseClient#setupIOStreams should handle all
>> exceptions
>> >     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
>> > synchronous
>> >     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
>> > update if the slave regionserver is stalled
>> >     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>> >     [HBASE-9303] - Snapshot restore of table which splits after snapshot
>> > was taken encounters 'Region is not online'
>> >     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
>> > breaks binding to the wildcard address. Revert HBASE-8640
>> >     [HBASE-9329] - SnapshotManager should check for directory existance
>> > before throwing a warning.
>> >     [HBASE-9344] - RegionServer not shutting down upon KeeperException
>> in
>> > open region
>> >     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
>> > incorrectly
>> >     [HBASE-9397] - Snapshots with the same name are allowed to proceed
>> > concurrently
>> >     [HBASE-9415] - In rpcServer, replicationQueue is initialized with
>> the
>> > max queue size instead of the max queue lenght
>> >     [HBASE-9428] - Regex filters are at least an order of magnitude
>> slower
>> > since 0.94.3
>> >     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
>> > conf,byte[] tablename,boolean offlined) method
>> >     [HBASE-9432] - Backport HBASE-8781 to 0.94
>> >     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
>> > talking to older servers
>> >     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
>> > to 0.94
>> >     [HBASE-9243] - Add more useful statistics in the HFile tool
>> >     [HBASE-9314] - Dropping a table always prints a
>> > TableInfoMissingException in the master log
>> >     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
>> > large scale"
>> >     [HBASE-9287] - TestCatalogTracker depends on the execution order
>> >
>> > The list of changes is also available here:
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>> >
>> > Here're the jenkins runs for this RC:
>> > https://builds.apache.org/job/HBase-0.94.12/4/ and
>> > https://builds.apache.org/job/HBase-0.94.12-security/5/
>> >
>> > Please try out the RC, check out the doc, take it for a spin, etc, and
>> > vote +1/-1 by September 18th on whether we should release this as
>> 0.94.12.
>> >
>> > Thanks.
>> >
>> > -- Lars
>>
>
>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Consider it sunk.
New RC coming tonight. (If HBASE-9566 is fixed)


-- Lars



________________________________
 From: Jesse Yates <je...@gmail.com>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org> 
Sent: Tuesday, September 17, 2013 4:26 PM
Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download
 

Filed HBASE-9566 <https://issues.apache.org/jira/browse/HBASE-9566> (and
added patch).

-------------------
Jesse Yates
@jesse_yates
jyates.github.com


On Tue, Sep 17, 2013 at 3:58 PM, Jesse Yates <je...@gmail.com>wrote:

> -1 WALEdit interface got changed, which broke Phoenix mutable indexing (we
> implement our own WALEdit to read them back in with our special KeyValue
> type).
>
> Looks like getScopes/setScopes interface changed to
> getFromScope/putIntoScope. We could do a shim layer... but that's really
> really ugly for managing between versions of 0.94. I'd rather add those
> methods back and keep the new ones for the circular replication fix for
> which they were added.
>
> -------------------
> Jesse Yates
> @jesse_yates
> jyates.github.com
>
>
> On Tue, Sep 17, 2013 at 12:45 PM, lars hofhansl <la...@apache.org> wrote:
>
>> Thanks Stack.
>>
>> 2 binding, 3 non binding +1's.
>> Going to release later today.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Stack <st...@duboce.net>
>> To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <
>> larsh@apache.org>
>> Sent: Tuesday, September 17, 2013 11:58 AM
>> Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available
>> for download
>>
>>
>> +1
>>
>> Checked md5 and signature.
>>
>> Checked out doc, UI, and unbundled layout.
>>
>> Ran a bulk load and confirmed all made it there in standalone mode.
>>
>> Checked logs.  Nothing untoward.
>>
>> St.Ack
>>
>>
>> On Wed, Sep 11, 2013 at 1:15 PM, lars hofhansl <la...@apache.org> wrote:
>>
>> > The 1st 0.94.12 RC is available for download at
>> > http://people.apache.org/~larsh/hbase-0.94.12-rc0/
>> > Signed with my code signing key: C7CFE328
>> >
>> > As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
>> > against it:
>> >     [HBASE-9277] - REST should use listTableNames to list tables
>> >     [HBASE-9279] - Thrift should use listTableNames to list tables
>> >     [HBASE-7709] - Infinite loop possible in Master/Master replication
>> >     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
>> > extra sleep
>> >     [HBASE-8760] - possible loss of data in snapshot taken after region
>> > split
>> >     [HBASE-8930] - Filter evaluates KVs outside requested columns
>> >     [HBASE-9167] - ServerCallable retries just once if timeout is not
>> > integer.max
>> >     [HBASE-9182] - Allow non-admin users to list all table names
>> >     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>> >     [HBASE-9207] - An Offline SplitParent Region can be assigned
>> breaking
>> > split references
>> >     [HBASE-9231] - Multipage book is generated to the wrong location
>> >     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
>> > was never assigned
>> >     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
>> > deprecated in 0.94
>> >     [HBASE-9256] - HBaseClient#setupIOStreams should handle all
>> exceptions
>> >     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
>> > synchronous
>> >     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
>> > update if the slave regionserver is stalled
>> >     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>> >     [HBASE-9303] - Snapshot restore of table which splits after snapshot
>> > was taken encounters 'Region is not online'
>> >     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
>> > breaks binding to the wildcard address. Revert HBASE-8640
>> >     [HBASE-9329] - SnapshotManager should check for directory existance
>> > before throwing a warning.
>> >     [HBASE-9344] - RegionServer not shutting down upon KeeperException
>> in
>> > open region
>> >     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
>> > incorrectly
>> >     [HBASE-9397] - Snapshots with the same name are allowed to proceed
>> > concurrently
>> >     [HBASE-9415] - In rpcServer, replicationQueue is initialized with
>> the
>> > max queue size instead of the max queue lenght
>> >     [HBASE-9428] - Regex filters are at least an order of magnitude
>> slower
>> > since 0.94.3
>> >     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
>> > conf,byte[] tablename,boolean offlined) method
>> >     [HBASE-9432] - Backport HBASE-8781 to 0.94
>> >     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
>> > talking to older servers
>> >     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
>> > to 0.94
>> >     [HBASE-9243] - Add more useful statistics in the HFile tool
>> >     [HBASE-9314] - Dropping a table always prints a
>> > TableInfoMissingException in the master log
>> >     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
>> > large scale"
>> >     [HBASE-9287] - TestCatalogTracker depends on the execution order
>> >
>> > The list of changes is also available here:
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>> >
>> > Here're the jenkins runs for this RC:
>> > https://builds.apache.org/job/HBase-0.94.12/4/ and
>> > https://builds.apache.org/job/HBase-0.94.12-security/5/
>> >
>> > Please try out the RC, check out the doc, take it for a spin, etc, and
>> > vote +1/-1 by September 18th on whether we should release this as
>> 0.94.12.
>> >
>> > Thanks.
>> >
>> > -- Lars
>>
>
>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by Jesse Yates <je...@gmail.com>.
Filed HBASE-9566 <https://issues.apache.org/jira/browse/HBASE-9566> (and
added patch).

-------------------
Jesse Yates
@jesse_yates
jyates.github.com


On Tue, Sep 17, 2013 at 3:58 PM, Jesse Yates <je...@gmail.com>wrote:

> -1 WALEdit interface got changed, which broke Phoenix mutable indexing (we
> implement our own WALEdit to read them back in with our special KeyValue
> type).
>
> Looks like getScopes/setScopes interface changed to
> getFromScope/putIntoScope. We could do a shim layer... but that's really
> really ugly for managing between versions of 0.94. I'd rather add those
> methods back and keep the new ones for the circular replication fix for
> which they were added.
>
> -------------------
> Jesse Yates
> @jesse_yates
> jyates.github.com
>
>
> On Tue, Sep 17, 2013 at 12:45 PM, lars hofhansl <la...@apache.org> wrote:
>
>> Thanks Stack.
>>
>> 2 binding, 3 non binding +1's.
>> Going to release later today.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Stack <st...@duboce.net>
>> To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <
>> larsh@apache.org>
>> Sent: Tuesday, September 17, 2013 11:58 AM
>> Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available
>> for download
>>
>>
>> +1
>>
>> Checked md5 and signature.
>>
>> Checked out doc, UI, and unbundled layout.
>>
>> Ran a bulk load and confirmed all made it there in standalone mode.
>>
>> Checked logs.  Nothing untoward.
>>
>> St.Ack
>>
>>
>> On Wed, Sep 11, 2013 at 1:15 PM, lars hofhansl <la...@apache.org> wrote:
>>
>> > The 1st 0.94.12 RC is available for download at
>> > http://people.apache.org/~larsh/hbase-0.94.12-rc0/
>> > Signed with my code signing key: C7CFE328
>> >
>> > As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
>> > against it:
>> >     [HBASE-9277] - REST should use listTableNames to list tables
>> >     [HBASE-9279] - Thrift should use listTableNames to list tables
>> >     [HBASE-7709] - Infinite loop possible in Master/Master replication
>> >     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
>> > extra sleep
>> >     [HBASE-8760] - possible loss of data in snapshot taken after region
>> > split
>> >     [HBASE-8930] - Filter evaluates KVs outside requested columns
>> >     [HBASE-9167] - ServerCallable retries just once if timeout is not
>> > integer.max
>> >     [HBASE-9182] - Allow non-admin users to list all table names
>> >     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>> >     [HBASE-9207] - An Offline SplitParent Region can be assigned
>> breaking
>> > split references
>> >     [HBASE-9231] - Multipage book is generated to the wrong location
>> >     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
>> > was never assigned
>> >     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
>> > deprecated in 0.94
>> >     [HBASE-9256] - HBaseClient#setupIOStreams should handle all
>> exceptions
>> >     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
>> > synchronous
>> >     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
>> > update if the slave regionserver is stalled
>> >     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>> >     [HBASE-9303] - Snapshot restore of table which splits after snapshot
>> > was taken encounters 'Region is not online'
>> >     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
>> > breaks binding to the wildcard address. Revert HBASE-8640
>> >     [HBASE-9329] - SnapshotManager should check for directory existance
>> > before throwing a warning.
>> >     [HBASE-9344] - RegionServer not shutting down upon KeeperException
>> in
>> > open region
>> >     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
>> > incorrectly
>> >     [HBASE-9397] - Snapshots with the same name are allowed to proceed
>> > concurrently
>> >     [HBASE-9415] - In rpcServer, replicationQueue is initialized with
>> the
>> > max queue size instead of the max queue lenght
>> >     [HBASE-9428] - Regex filters are at least an order of magnitude
>> slower
>> > since 0.94.3
>> >     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
>> > conf,byte[] tablename,boolean offlined) method
>> >     [HBASE-9432] - Backport HBASE-8781 to 0.94
>> >     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
>> > talking to older servers
>> >     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
>> > to 0.94
>> >     [HBASE-9243] - Add more useful statistics in the HFile tool
>> >     [HBASE-9314] - Dropping a table always prints a
>> > TableInfoMissingException in the master log
>> >     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
>> > large scale"
>> >     [HBASE-9287] - TestCatalogTracker depends on the execution order
>> >
>> > The list of changes is also available here:
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>> >
>> > Here're the jenkins runs for this RC:
>> > https://builds.apache.org/job/HBase-0.94.12/4/ and
>> > https://builds.apache.org/job/HBase-0.94.12-security/5/
>> >
>> > Please try out the RC, check out the doc, take it for a spin, etc, and
>> > vote +1/-1 by September 18th on whether we should release this as
>> 0.94.12.
>> >
>> > Thanks.
>> >
>> > -- Lars
>>
>
>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by Jesse Yates <je...@gmail.com>.
-1 WALEdit interface got changed, which broke Phoenix mutable indexing (we
implement our own WALEdit to read them back in with our special KeyValue
type).

Looks like getScopes/setScopes interface changed to
getFromScope/putIntoScope. We could do a shim layer... but that's really
really ugly for managing between versions of 0.94. I'd rather add those
methods back and keep the new ones for the circular replication fix for
which they were added.

-------------------
Jesse Yates
@jesse_yates
jyates.github.com


On Tue, Sep 17, 2013 at 12:45 PM, lars hofhansl <la...@apache.org> wrote:

> Thanks Stack.
>
> 2 binding, 3 non binding +1's.
> Going to release later today.
>
> -- Lars
>
>
>
> ________________________________
>  From: Stack <st...@duboce.net>
> To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <larsh@apache.org
> >
> Sent: Tuesday, September 17, 2013 11:58 AM
> Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available
> for download
>
>
> +1
>
> Checked md5 and signature.
>
> Checked out doc, UI, and unbundled layout.
>
> Ran a bulk load and confirmed all made it there in standalone mode.
>
> Checked logs.  Nothing untoward.
>
> St.Ack
>
>
> On Wed, Sep 11, 2013 at 1:15 PM, lars hofhansl <la...@apache.org> wrote:
>
> > The 1st 0.94.12 RC is available for download at
> > http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> > Signed with my code signing key: C7CFE328
> >
> > As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
> > against it:
> >     [HBASE-9277] - REST should use listTableNames to list tables
> >     [HBASE-9279] - Thrift should use listTableNames to list tables
> >     [HBASE-7709] - Infinite loop possible in Master/Master replication
> >     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> > extra sleep
> >     [HBASE-8760] - possible loss of data in snapshot taken after region
> > split
> >     [HBASE-8930] - Filter evaluates KVs outside requested columns
> >     [HBASE-9167] - ServerCallable retries just once if timeout is not
> > integer.max
> >     [HBASE-9182] - Allow non-admin users to list all table names
> >     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
> >     [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
> > split references
> >     [HBASE-9231] - Multipage book is generated to the wrong location
> >     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> > was never assigned
> >     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> > deprecated in 0.94
> >     [HBASE-9256] - HBaseClient#setupIOStreams should handle all
> exceptions
> >     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> > synchronous
> >     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> > update if the slave regionserver is stalled
> >     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
> >     [HBASE-9303] - Snapshot restore of table which splits after snapshot
> > was taken encounters 'Region is not online'
> >     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> > breaks binding to the wildcard address. Revert HBASE-8640
> >     [HBASE-9329] - SnapshotManager should check for directory existance
> > before throwing a warning.
> >     [HBASE-9344] - RegionServer not shutting down upon KeeperException in
> > open region
> >     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> > incorrectly
> >     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> > concurrently
> >     [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
> > max queue size instead of the max queue lenght
> >     [HBASE-9428] - Regex filters are at least an order of magnitude
> slower
> > since 0.94.3
> >     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> > conf,byte[] tablename,boolean offlined) method
> >     [HBASE-9432] - Backport HBASE-8781 to 0.94
> >     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> > talking to older servers
> >     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
> > to 0.94
> >     [HBASE-9243] - Add more useful statistics in the HFile tool
> >     [HBASE-9314] - Dropping a table always prints a
> > TableInfoMissingException in the master log
> >     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> > large scale"
> >     [HBASE-9287] - TestCatalogTracker depends on the execution order
> >
> > The list of changes is also available here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
> >
> > Here're the jenkins runs for this RC:
> > https://builds.apache.org/job/HBase-0.94.12/4/ and
> > https://builds.apache.org/job/HBase-0.94.12-security/5/
> >
> > Please try out the RC, check out the doc, take it for a spin, etc, and
> > vote +1/-1 by September 18th on whether we should release this as
> 0.94.12.
> >
> > Thanks.
> >
> > -- Lars
>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Thanks Stack.

2 binding, 3 non binding +1's.
Going to release later today.

-- Lars



________________________________
 From: Stack <st...@duboce.net>
To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <la...@apache.org> 
Sent: Tuesday, September 17, 2013 11:58 AM
Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download
 

+1

Checked md5 and signature.

Checked out doc, UI, and unbundled layout.

Ran a bulk load and confirmed all made it there in standalone mode.

Checked logs.  Nothing untoward.

St.Ack


On Wed, Sep 11, 2013 at 1:15 PM, lars hofhansl <la...@apache.org> wrote:

> The 1st 0.94.12 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> Signed with my code signing key: C7CFE328
>
> As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
> against it:
>     [HBASE-9277] - REST should use listTableNames to list tables
>     [HBASE-9279] - Thrift should use listTableNames to list tables
>     [HBASE-7709] - Infinite loop possible in Master/Master replication
>     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> extra sleep
>     [HBASE-8760] - possible loss of data in snapshot taken after region
> split
>     [HBASE-8930] - Filter evaluates KVs outside requested columns
>     [HBASE-9167] - ServerCallable retries just once if timeout is not
> integer.max
>     [HBASE-9182] - Allow non-admin users to list all table names
>     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>     [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
> split references
>     [HBASE-9231] - Multipage book is generated to the wrong location
>     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> was never assigned
>     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> deprecated in 0.94
>     [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
>     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> synchronous
>     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> update if the slave regionserver is stalled
>     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>     [HBASE-9303] - Snapshot restore of table which splits after snapshot
> was taken encounters 'Region is not online'
>     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> breaks binding to the wildcard address. Revert HBASE-8640
>     [HBASE-9329] - SnapshotManager should check for directory existance
> before throwing a warning.
>     [HBASE-9344] - RegionServer not shutting down upon KeeperException in
> open region
>     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> incorrectly
>     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> concurrently
>     [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
> max queue size instead of the max queue lenght
>     [HBASE-9428] - Regex filters are at least an order of magnitude slower
> since 0.94.3
>     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> conf,byte[] tablename,boolean offlined) method
>     [HBASE-9432] - Backport HBASE-8781 to 0.94
>     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> talking to older servers
>     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
> to 0.94
>     [HBASE-9243] - Add more useful statistics in the HFile tool
>     [HBASE-9314] - Dropping a table always prints a
> TableInfoMissingException in the master log
>     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> large scale"
>     [HBASE-9287] - TestCatalogTracker depends on the execution order
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.12/4/ and
> https://builds.apache.org/job/HBase-0.94.12-security/5/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by September 18th on whether we should release this as 0.94.12.
>
> Thanks.
>
> -- Lars

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by Stack <st...@duboce.net>.
+1

Checked md5 and signature.

Checked out doc, UI, and unbundled layout.

Ran a bulk load and confirmed all made it there in standalone mode.

Checked logs.  Nothing untoward.

St.Ack


On Wed, Sep 11, 2013 at 1:15 PM, lars hofhansl <la...@apache.org> wrote:

> The 1st 0.94.12 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> Signed with my code signing key: C7CFE328
>
> As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
> against it:
>     [HBASE-9277] - REST should use listTableNames to list tables
>     [HBASE-9279] - Thrift should use listTableNames to list tables
>     [HBASE-7709] - Infinite loop possible in Master/Master replication
>     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> extra sleep
>     [HBASE-8760] - possible loss of data in snapshot taken after region
> split
>     [HBASE-8930] - Filter evaluates KVs outside requested columns
>     [HBASE-9167] - ServerCallable retries just once if timeout is not
> integer.max
>     [HBASE-9182] - Allow non-admin users to list all table names
>     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>     [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
> split references
>     [HBASE-9231] - Multipage book is generated to the wrong location
>     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> was never assigned
>     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> deprecated in 0.94
>     [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
>     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> synchronous
>     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> update if the slave regionserver is stalled
>     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>     [HBASE-9303] - Snapshot restore of table which splits after snapshot
> was taken encounters 'Region is not online'
>     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> breaks binding to the wildcard address. Revert HBASE-8640
>     [HBASE-9329] - SnapshotManager should check for directory existance
> before throwing a warning.
>     [HBASE-9344] - RegionServer not shutting down upon KeeperException in
> open region
>     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> incorrectly
>     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> concurrently
>     [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
> max queue size instead of the max queue lenght
>     [HBASE-9428] - Regex filters are at least an order of magnitude slower
> since 0.94.3
>     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> conf,byte[] tablename,boolean offlined) method
>     [HBASE-9432] - Backport HBASE-8781 to 0.94
>     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> talking to older servers
>     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
> to 0.94
>     [HBASE-9243] - Add more useful statistics in the HFile tool
>     [HBASE-9314] - Dropping a table always prints a
> TableInfoMissingException in the master log
>     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> large scale"
>     [HBASE-9287] - TestCatalogTracker depends on the execution order
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.12/4/ and
> https://builds.apache.org/job/HBase-0.94.12-security/5/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by September 18th on whether we should release this as 0.94.12.
>
> Thanks.
>
> -- Lars

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by James Taylor <jt...@salesforce.com>.
Thanks, JM. Those are some good tests.

James

On Sep 13, 2013, at 9:04 AM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:

> Here is the performances comparison between 0.94.11 and 0.94.12
> (Lines/minutes or Lines/seconds):
>
> 0.94.11 0.94.12
> org.apache.hadoop.hbase.PerformanceEvaluation$FilteredScanTest 10.17 10.37
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest 810.58 833.65
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomSeekScanTest 255.71
> 251.57  org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest
> 25682.11 25243.45
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange10Test
> 28715.29 29399.64
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange100Test
> 18022.39 17789.79
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange1000Test
> 2346.85 2359.45
> org.apache.hadoop.hbase.PerformanceEvaluation$SequentialReadTest 2875.83
> 2877.06  org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest
> 26693.23 26576.31
> So it's pretty stable between the 2 versions.
>
>
>
>
> 2013/9/13 lars hofhansl <la...@apache.org>
>
>> - Checked the tarball, the documentation
>>
>> - Loaded 100m rows, flushes, compacted, scanned
>> - Did my usual tight loop performance tests
>> - Used client to connected to some older secure clusters (there was an
>> issue with that at some point during the 0.94.12 cycle)
>> - Double checked with Phoenix folks that no needed low level APIs were
>> changed
>>
>>
>> All good. +1
>>
>>
>> Other committers, please have a quick look if you can.
>>
>> Thanks.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>> From: lars hofhansl <la...@apache.org>
>> To: hbase-dev <de...@hbase.apache.org>
>> Sent: Wednesday, September 11, 2013 1:15 PM
>> Subject: [VOTE] The 1st hbase 0.94.12 release candidate is available for
>> download
>>
>>
>> The 1st 0.94.12 RC is available for download at
>> http://people.apache.org/~larsh/hbase-0.94.12-rc0/
>> Signed with my code signing key: C7CFE328
>>
>> As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
>> against it:
>>    [HBASE-9277] - REST should use listTableNames to list tables
>>    [HBASE-9279] - Thrift should use listTableNames to list tables
>>    [HBASE-7709] - Infinite loop possible in Master/Master replication
>>    [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
>> extra sleep
>>    [HBASE-8760] - possible loss of data in snapshot taken after region
>> split
>>    [HBASE-8930] - Filter evaluates KVs outside requested columns
>>    [HBASE-9167] - ServerCallable retries just once if timeout is not
>> integer.max
>>    [HBASE-9182] - Allow non-admin users to list all table names
>>    [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>>    [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
>> split references
>>    [HBASE-9231] - Multipage book is generated to the wrong location
>>    [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
>> was never assigned
>>    [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
>> deprecated in 0.94
>>    [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
>>    [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
>> synchronous
>>    [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
>> update if the slave regionserver is stalled
>>    [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>>    [HBASE-9303] - Snapshot restore of table which splits after snapshot
>> was taken encounters 'Region is not online'
>>    [HBASE-9326] - ServerName is created using getLocalSocketAddress,
>> breaks binding to the wildcard address. Revert HBASE-8640
>>    [HBASE-9329] - SnapshotManager should check for directory existance
>> before throwing a warning.
>>    [HBASE-9344] - RegionServer not shutting down upon KeeperException in
>> open region
>>    [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
>> incorrectly
>>    [HBASE-9397] - Snapshots with the same name are allowed to proceed
>> concurrently
>>    [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
>> max queue size instead of the max queue lenght
>>    [HBASE-9428] - Regex filters are at least an order of magnitude slower
>> since 0.94.3
>>    [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
>> conf,byte[] tablename,boolean offlined) method
>>    [HBASE-9432] - Backport HBASE-8781 to 0.94
>>    [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
>> talking to older servers
>>    [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
>> to 0.94
>>    [HBASE-9243] - Add more useful statistics in the HFile tool
>>    [HBASE-9314] - Dropping a table always prints a
>> TableInfoMissingException in the master log
>>    [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
>> large scale"
>>    [HBASE-9287] - TestCatalogTracker depends on the execution order
>>
>> The list of changes is also available here:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>>
>> Here're the jenkins runs for this RC:
>> https://builds.apache.org/job/HBase-0.94.12/4/ and
>> https://builds.apache.org/job/HBase-0.94.12-security/5/
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and
>> vote +1/-1 by September 18th on whether we should release this as 0.94.12.
>>
>> Thanks.
>>
>> -- Lars
>>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by James Taylor <jt...@salesforce.com>.
On Sep 13, 2013, at 9:04 AM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:

> Here is the performances comparison between 0.94.11 and 0.94.12
> (Lines/minutes or Lines/seconds):
>
> 0.94.11 0.94.12
> org.apache.hadoop.hbase.PerformanceEvaluation$FilteredScanTest 10.17 10.37
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest 810.58 833.65
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomSeekScanTest 255.71
> 251.57  org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest
> 25682.11 25243.45
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange10Test
> 28715.29 29399.64
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange100Test
> 18022.39 17789.79
> org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange1000Test
> 2346.85 2359.45
> org.apache.hadoop.hbase.PerformanceEvaluation$SequentialReadTest 2875.83
> 2877.06  org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest
> 26693.23 26576.31
> So it's pretty stable between the 2 versions.
>
>
>
>
> 2013/9/13 lars hofhansl <la...@apache.org>
>
>> - Checked the tarball, the documentation
>>
>> - Loaded 100m rows, flushes, compacted, scanned
>> - Did my usual tight loop performance tests
>> - Used client to connected to some older secure clusters (there was an
>> issue with that at some point during the 0.94.12 cycle)
>> - Double checked with Phoenix folks that no needed low level APIs were
>> changed
>>
>>
>> All good. +1
>>
>>
>> Other committers, please have a quick look if you can.
>>
>> Thanks.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>> From: lars hofhansl <la...@apache.org>
>> To: hbase-dev <de...@hbase.apache.org>
>> Sent: Wednesday, September 11, 2013 1:15 PM
>> Subject: [VOTE] The 1st hbase 0.94.12 release candidate is available for
>> download
>>
>>
>> The 1st 0.94.12 RC is available for download at
>> http://people.apache.org/~larsh/hbase-0.94.12-rc0/
>> Signed with my code signing key: C7CFE328
>>
>> As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
>> against it:
>>    [HBASE-9277] - REST should use listTableNames to list tables
>>    [HBASE-9279] - Thrift should use listTableNames to list tables
>>    [HBASE-7709] - Infinite loop possible in Master/Master replication
>>    [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
>> extra sleep
>>    [HBASE-8760] - possible loss of data in snapshot taken after region
>> split
>>    [HBASE-8930] - Filter evaluates KVs outside requested columns
>>    [HBASE-9167] - ServerCallable retries just once if timeout is not
>> integer.max
>>    [HBASE-9182] - Allow non-admin users to list all table names
>>    [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>>    [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
>> split references
>>    [HBASE-9231] - Multipage book is generated to the wrong location
>>    [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
>> was never assigned
>>    [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
>> deprecated in 0.94
>>    [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
>>    [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
>> synchronous
>>    [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
>> update if the slave regionserver is stalled
>>    [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>>    [HBASE-9303] - Snapshot restore of table which splits after snapshot
>> was taken encounters 'Region is not online'
>>    [HBASE-9326] - ServerName is created using getLocalSocketAddress,
>> breaks binding to the wildcard address. Revert HBASE-8640
>>    [HBASE-9329] - SnapshotManager should check for directory existance
>> before throwing a warning.
>>    [HBASE-9344] - RegionServer not shutting down upon KeeperException in
>> open region
>>    [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
>> incorrectly
>>    [HBASE-9397] - Snapshots with the same name are allowed to proceed
>> concurrently
>>    [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
>> max queue size instead of the max queue lenght
>>    [HBASE-9428] - Regex filters are at least an order of magnitude slower
>> since 0.94.3
>>    [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
>> conf,byte[] tablename,boolean offlined) method
>>    [HBASE-9432] - Backport HBASE-8781 to 0.94
>>    [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
>> talking to older servers
>>    [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
>> to 0.94
>>    [HBASE-9243] - Add more useful statistics in the HFile tool
>>    [HBASE-9314] - Dropping a table always prints a
>> TableInfoMissingException in the master log
>>    [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
>> large scale"
>>    [HBASE-9287] - TestCatalogTracker depends on the execution order
>>
>> The list of changes is also available here:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>>
>> Here're the jenkins runs for this RC:
>> https://builds.apache.org/job/HBase-0.94.12/4/ and
>> https://builds.apache.org/job/HBase-0.94.12-security/5/
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and
>> vote +1/-1 by September 18th on whether we should release this as 0.94.12.
>>
>> Thanks.
>>
>> -- Lars
>>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Here is the performances comparison between 0.94.11 and 0.94.12
(Lines/minutes or Lines/seconds):

0.94.11 0.94.12
org.apache.hadoop.hbase.PerformanceEvaluation$FilteredScanTest 10.17 10.37
org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest 810.58 833.65
org.apache.hadoop.hbase.PerformanceEvaluation$RandomSeekScanTest 255.71
251.57  org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest
25682.11 25243.45
org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange10Test
28715.29 29399.64
org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange100Test
18022.39 17789.79
org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange1000Test
2346.85 2359.45
org.apache.hadoop.hbase.PerformanceEvaluation$SequentialReadTest 2875.83
2877.06  org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest
26693.23 26576.31
So it's pretty stable between the 2 versions.




2013/9/13 lars hofhansl <la...@apache.org>

> - Checked the tarball, the documentation
>
> - Loaded 100m rows, flushes, compacted, scanned
> - Did my usual tight loop performance tests
> - Used client to connected to some older secure clusters (there was an
> issue with that at some point during the 0.94.12 cycle)
> - Double checked with Phoenix folks that no needed low level APIs were
> changed
>
>
> All good. +1
>
>
> Other committers, please have a quick look if you can.
>
> Thanks.
>
> -- Lars
>
>
>
> ________________________________
>  From: lars hofhansl <la...@apache.org>
> To: hbase-dev <de...@hbase.apache.org>
> Sent: Wednesday, September 11, 2013 1:15 PM
> Subject: [VOTE] The 1st hbase 0.94.12 release candidate is available for
> download
>
>
> The 1st 0.94.12 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.12-rc0/
> Signed with my code signing key: C7CFE328
>
> As before 0.94.12 is mostly a bug fix release and has 33 issues resolved
> against it:
>     [HBASE-9277] - REST should use listTableNames to list tables
>     [HBASE-9279] - Thrift should use listTableNames to list tables
>     [HBASE-7709] - Infinite loop possible in Master/Master replication
>     [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid
> extra sleep
>     [HBASE-8760] - possible loss of data in snapshot taken after region
> split
>     [HBASE-8930] - Filter evaluates KVs outside requested columns
>     [HBASE-9167] - ServerCallable retries just once if timeout is not
> integer.max
>     [HBASE-9182] - Allow non-admin users to list all table names
>     [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
>     [HBASE-9207] - An Offline SplitParent Region can be assigned breaking
> split references
>     [HBASE-9231] - Multipage book is generated to the wrong location
>     [HBASE-9233] - isTableAvailable() may be stuck if an offline parent
> was never assigned
>     [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be
> deprecated in 0.94
>     [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
>     [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is
> synchronous
>     [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't
> update if the slave regionserver is stalled
>     [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
>     [HBASE-9303] - Snapshot restore of table which splits after snapshot
> was taken encounters 'Region is not online'
>     [HBASE-9326] - ServerName is created using getLocalSocketAddress,
> breaks binding to the wildcard address. Revert HBASE-8640
>     [HBASE-9329] - SnapshotManager should check for directory existance
> before throwing a warning.
>     [HBASE-9344] - RegionServer not shutting down upon KeeperException in
> open region
>     [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared
> incorrectly
>     [HBASE-9397] - Snapshots with the same name are allowed to proceed
> concurrently
>     [HBASE-9415] - In rpcServer, replicationQueue is initialized with the
> max queue size instead of the max queue lenght
>     [HBASE-9428] - Regex filters are at least an order of magnitude slower
> since 0.94.3
>     [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration
> conf,byte[] tablename,boolean offlined) method
>     [HBASE-9432] - Backport HBASE-8781 to 0.94
>     [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if
> talking to older servers
>     [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7'
> to 0.94
>     [HBASE-9243] - Add more useful statistics in the HFile tool
>     [HBASE-9314] - Dropping a table always prints a
> TableInfoMissingException in the master log
>     [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at
> large scale"
>     [HBASE-9287] - TestCatalogTracker depends on the execution order
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.12/4/ and
> https://builds.apache.org/job/HBase-0.94.12-security/5/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by September 18th on whether we should release this as 0.94.12.
>
> Thanks.
>
> -- Lars
>

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
- Checked the tarball, the documentation

- Loaded 100m rows, flushes, compacted, scanned
- Did my usual tight loop performance tests
- Used client to connected to some older secure clusters (there was an issue with that at some point during the 0.94.12 cycle)
- Double checked with Phoenix folks that no needed low level APIs were changed


All good. +1


Other committers, please have a quick look if you can.

Thanks.

-- Lars



________________________________
 From: lars hofhansl <la...@apache.org>
To: hbase-dev <de...@hbase.apache.org> 
Sent: Wednesday, September 11, 2013 1:15 PM
Subject: [VOTE] The 1st hbase 0.94.12 release candidate is available for download
 

The 1st 0.94.12 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.12-rc0/
Signed with my code signing key: C7CFE328

As before 0.94.12 is mostly a bug fix release and has 33 issues resolved against it:
    [HBASE-9277] - REST should use listTableNames to list tables
    [HBASE-9279] - Thrift should use listTableNames to list tables
    [HBASE-7709] - Infinite loop possible in Master/Master replication
    [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid extra sleep
    [HBASE-8760] - possible loss of data in snapshot taken after region split
    [HBASE-8930] - Filter evaluates KVs outside requested columns
    [HBASE-9167] - ServerCallable retries just once if timeout is not integer.max
    [HBASE-9182] - Allow non-admin users to list all table names
    [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
    [HBASE-9207] - An Offline SplitParent Region can be assigned breaking split references
    [HBASE-9231] - Multipage book is generated to the wrong location
    [HBASE-9233] - isTableAvailable() may be stuck if an offline parent was never assigned
    [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be deprecated in 0.94
    [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
    [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is synchronous
    [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't update if the slave regionserver is stalled
    [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
    [HBASE-9303] - Snapshot restore of table which splits after snapshot was taken encounters 'Region is not online'
    [HBASE-9326] - ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address. Revert HBASE-8640
    [HBASE-9329] - SnapshotManager should check for directory existance before throwing a warning.
    [HBASE-9344] - RegionServer not shutting down upon KeeperException in open region
    [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared incorrectly
    [HBASE-9397] - Snapshots with the same name are allowed to proceed concurrently
    [HBASE-9415] - In rpcServer, replicationQueue is initialized with the max queue size instead of the max queue lenght
    [HBASE-9428] - Regex filters are at least an order of magnitude slower since 0.94.3
    [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration conf,byte[] tablename,boolean offlined) method
    [HBASE-9432] - Backport HBASE-8781 to 0.94
    [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if talking to older servers
    [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7' to 0.94
    [HBASE-9243] - Add more useful statistics in the HFile tool
    [HBASE-9314] - Dropping a table always prints a TableInfoMissingException in the master log
    [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at large scale"
    [HBASE-9287] - TestCatalogTracker depends on the execution order

The list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790

Here're the jenkins runs for this RC: https://builds.apache.org/job/HBase-0.94.12/4/ and https://builds.apache.org/job/HBase-0.94.12-security/5/

Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by September 18th on whether we should release this as 0.94.12.

Thanks.

-- Lars

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Thanks Benoit,

looking at the trace, this can only happen if (1) the internal Connection is used before it is fully constructed (i.e. a threading issues) or (2) when the Connection is used after it was closed.
I'm not aware of any changes in that area in 0.94.12.

-- Lars



________________________________
 From: tsuna <ts...@gmail.com>
To: dev@hbase.apache.org; lars hofhansl <la...@apache.org> 
Sent: Tuesday, September 17, 2013 12:09 AM
Subject: Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download
 

I upgraded HBase at Arista to 0.94.12 RC1 and noticed the following in
the RS logs:

2013-09-17 00:00:21,049 WARN org.apache.hadoop.ipc.HBaseServer: IPC
Server listener on 60586: readAndProcess threw exception
java.lang.NullPointerException. Count of bytes read: 0
java.lang.NullPointerException
        at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1178)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:748)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:539)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:514)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)

I think this was while one of the TSDs was unhappy that HBase had gone
away from under its feet, but I'm not sure it should trigger an NPE
there.  It only occurred once.

But other than this possibly cosmetic issue, everything is running
fine, with TSD sending 5k QPS and with reads that are much faster now
that HBASE-9428 is fixed.

-- 
Benoit "tsuna" Sigoure

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by tsuna <ts...@gmail.com>.
I upgraded HBase at Arista to 0.94.12 RC1 and noticed the following in
the RS logs:

2013-09-17 00:00:21,049 WARN org.apache.hadoop.ipc.HBaseServer: IPC
Server listener on 60586: readAndProcess threw exception
java.lang.NullPointerException. Count of bytes read: 0
java.lang.NullPointerException
        at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1178)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:748)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:539)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:514)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)

I think this was while one of the TSDs was unhappy that HBase had gone
away from under its feet, but I'm not sure it should trigger an NPE
there.  It only occurred once.

But other than this possibly cosmetic issue, everything is running
fine, with TSD sending 5k QPS and with reads that are much faster now
that HBASE-9428 is fixed.

-- 
Benoit "tsuna" Sigoure

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Gentle poke to please remember to check out this RC.

So far I have one binding +1 (mine)
And 2 none-binding +1's.

-- Lars



________________________________
 From: lars hofhansl <la...@apache.org>
To: hbase-dev <de...@hbase.apache.org> 
Sent: Wednesday, September 11, 2013 1:15 PM
Subject: [VOTE] The 1st hbase 0.94.12 release candidate is available for download
 

The 1st 0.94.12 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.12-rc0/
Signed with my code signing key: C7CFE328

As before 0.94.12 is mostly a bug fix release and has 33 issues resolved against it:
    [HBASE-9277] - REST should use listTableNames to list tables
    [HBASE-9279] - Thrift should use listTableNames to list tables
    [HBASE-7709] - Infinite loop possible in Master/Master replication
    [HBASE-7954] - Fix the retrying logic of memstore flushes to avoid extra sleep
    [HBASE-8760] - possible loss of data in snapshot taken after region split
    [HBASE-8930] - Filter evaluates KVs outside requested columns
    [HBASE-9167] - ServerCallable retries just once if timeout is not integer.max
    [HBASE-9182] - Allow non-admin users to list all table names
    [HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
    [HBASE-9207] - An Offline SplitParent Region can be assigned breaking split references
    [HBASE-9231] - Multipage book is generated to the wrong location
    [HBASE-9233] - isTableAvailable() may be stuck if an offline parent was never assigned
    [HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be deprecated in 0.94
    [HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
    [HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is synchronous
    [HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't update if the slave regionserver is stalled
    [HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
    [HBASE-9303] - Snapshot restore of table which splits after snapshot was taken encounters 'Region is not online'
    [HBASE-9326] - ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address. Revert HBASE-8640
    [HBASE-9329] - SnapshotManager should check for directory existance before throwing a warning.
    [HBASE-9344] - RegionServer not shutting down upon KeeperException in open region
    [HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared incorrectly
    [HBASE-9397] - Snapshots with the same name are allowed to proceed concurrently
    [HBASE-9415] - In rpcServer, replicationQueue is initialized with the max queue size instead of the max queue lenght
    [HBASE-9428] - Regex filters are at least an order of magnitude slower since 0.94.3
    [HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration conf,byte[] tablename,boolean offlined) method
    [HBASE-9432] - Backport HBASE-8781 to 0.94
    [HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if talking to older servers
    [HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7' to 0.94
    [HBASE-9243] - Add more useful statistics in the HFile tool
    [HBASE-9314] - Dropping a table always prints a TableInfoMissingException in the master log
    [HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at large scale"
    [HBASE-9287] - TestCatalogTracker depends on the execution order

The list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324790

Here're the jenkins runs for this RC: https://builds.apache.org/job/HBase-0.94.12/4/ and https://builds.apache.org/job/HBase-0.94.12-security/5/

Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by September 18th on whether we should release this as 0.94.12.

Thanks.

-- Lars