You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by lars hofhansl <la...@apache.org> on 2014/02/15 00:56:06 UTC

[VOTE] The 1st hbase 0.94.17 release candidate is available for download

The 1st 0.94.17 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.17-rc0/
Signed with my code signing key: C7CFE328

HBase 0.94.17 is a bug fix release with 26 fixes:
    [HBASE-7963] - HBase VerifyReplication not working when security enabled
    [HBASE-10249] - TestReplicationSyncUpTool fails because failover takes too long
    [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when shutdown ZooKeeperServers
    [HBASE-10319] - HLog should roll periodically to allow DN decommission to eventually complete.
    [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
    [HBASE-10335] - AuthFailedException in zookeeper may block replication forever
    [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName to support multi instances in a node
    [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool fail under hadoop 2.0/23 profiles.
    [HBASE-10371] - Compaction creates empty hfile, then selects this file for compaction and creates empty hfile and over again
    [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for version 0.94.15
    [HBASE-10400] - [hbck] Continue if region dir missing on region merge attempt
    [HBASE-10401] - [hbck] perform overlap group merges in parallel
    [HBASE-10448] - ZKUtil create and watch methods don't set watch in some cases
    [HBASE-10470] - Import generates huge log file while importing large amounts of data
    [HBASE-10481] - API Compatibility JDiff script does not properly handle arguments in reverse order
    [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed for tests
    [HBASE-10485] - PrefixFilter#filterKeyValue() should perform filtering on row key
    [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
    [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform filtering on row key
    [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
    [HBASE-10506] - Fail-fast if client connection is lost before the real call be executed in RPC layer
    [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up connection properly when repair is completed' to 0.94 and 0.96
    [HBASE-10423] - Report back the message of split or rollback failure to the master
    [HBASE-10457] - Print corrupted file information in SnapshotInfo tool without -file option
    [HBASE-10473] - Add utility for adorning http Context
    [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to insufficient waiting

The list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325845

Here're the jenkins runs for this RC: https://builds.apache.org/job/HBase-0.94.17/13/ and https://builds.apache.org/job/HBase-0.94.17-security/4/

Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by EOD February 21th on whether we should release this as 0.94.17.

I know release testing is like pulling teeth and 0.98 is probably a bit more exiting at this point, but please give this is quick run, so we can get these bug fixes out there.

Thanks.

-- Lars

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
OK. -1 on the RC.



----- Original Message -----
From: Andrew Purtell <ap...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Cc: 
Sent: Saturday, February 15, 2014 11:32 PM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:


> Actually looks like this was by design in HBASE-10340/HBASE-9892.
> It spawns three local region server threads in local mode now, still just
> one process.
>
> I now think it's OK. What do other folks think? Should we set the default
> back to 1?
>

I think unannounced things that violate the principle of least surprise are
bad. We should sink the RC and set the default back IMO.



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)


Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Looking at the Gaussian read benchmark...
Are you 100% you seeded the test data and with the *exact* same number of rows you use in the read benchmark. The read tests directly create an HFileReader and seek it directly. The seek into a specific file only succeeds if the keys actually falls into that file.

-- Lars



----- Original Message -----
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: 
Sent: Sunday, February 16, 2014 10:15 AM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Hmm... Do you see this in 0.94.17 only (but not in 0.94.16 or earlier)?
Are you running in local mode or with a real HDFS?

-- Lars


----- Original Message -----
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org>
Cc: 
Sent: Sunday, February 16, 2014 5:29 AM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

+1 to keep the default behavior. It's very nice to have to option to start
more than one thread but I think for 0.94 we should keep default config.
But also, it's not a big thing. So I will be only -0 for this in the RC. I
agree that it's a bit surprising the see the 3 servers, but not that
dramatic.

Also I'm getting this once in a while when doing HFilePerformanceEvaluation:

org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$NotSeekedException:
Not seeked to a key/value
    at
org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$Scanner.assertSeeked(AbstractHFileReader.java:320)
    at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:690)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$GaussianRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:347)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$3.run(HFilePerformanceEvaluation.java:97)
    at java.lang.Thread.run(Thread.java:744)

Occured 30% of the time, and only on GaussianRandomReadBenchmark.

JM



2014-02-16 2:32 GMT-05:00 Andrew Purtell <ap...@apache.org>:

> On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:
>
> > Actually looks like this was by design in HBASE-10340/HBASE-9892.
> > It spawns three local region server threads in local mode now, still just
> > one process.
> >
> > I now think it's OK. What do other folks think? Should we set the default
> > back to 1?
> >
>
> I think unannounced things that violate the principle of least surprise are
> bad. We should sink the RC and set the default back IMO.
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>


Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
This makes sense. Will wait for your patch to re-test it.

Thanks for looking at it.

JM


2014-02-16 14:53 GMT-05:00 lars hofhansl <la...@apache.org>:

> Actually the bug is in the Gaussian read test.
>
> In generates seek keys by using a Gaussian distribution with the mean of
> N/2 and a sigma of N/10 (N = number of rows used)  and using this key
> directly to seek into the HFile. The HFile was seeded with keys from 0-N.
> This will fail if we ever generate a key < 0, which is rare, but by no
> means impossible. We need to clamp the min and max values to 0 and 2*N,
> resp.
>
> -- Lars
>
>   ------------------------------
>  *From:* Jean-Marc Spaggiari <je...@spaggiari.org>
> *To:* dev <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> *Sent:* Sunday, February 16, 2014 10:59 AM
>
> *Subject:* Re: [VOTE] The 1st hbase 0.94.17 release candidate is
> available for download
>
> Running fully dist with Hadoop 1.2.1. Retried with 0.94.16 and got the
> same exception from time to time. So I don't think this will impact the
> release of 0.94.17. When my PE base line will be done, I will try the same
> with 0.96 + Hadoop 2.2.0 and see if I get the same exception.
>
>
> 2014-02-16 13:15 GMT-05:00 lars hofhansl <la...@apache.org>:
>
> Hmm... Do you see this in 0.94.17 only (but not in 0.94.16 or earlier)?
> Are you running in local mode or with a real HDFS?
>
> -- Lars
>
> ----- Original Message -----
> From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev <de...@hbase.apache.org>
> Cc:
> Sent: Sunday, February 16, 2014 5:29 AM
> Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available
> for download
>
> +1 to keep the default behavior. It's very nice to have to option to start
> more than one thread but I think for 0.94 we should keep default config.
> But also, it's not a big thing. So I will be only -0 for this in the RC. I
> agree that it's a bit surprising the see the 3 servers, but not that
> dramatic.
>
> Also I'm getting this once in a while when doing
> HFilePerformanceEvaluation:
>
> org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$NotSeekedException:
> Not seeked to a key/value
>     at
>
> org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$Scanner.assertSeeked(AbstractHFileReader.java:320)
>     at
>
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:690)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation$GaussianRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:347)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation$3.run(HFilePerformanceEvaluation.java:97)
>     at java.lang.Thread.run(Thread.java:744)
>
> Occured 30% of the time, and only on GaussianRandomReadBenchmark.
>
> JM
>
>
>
> 2014-02-16 2:32 GMT-05:00 Andrew Purtell <ap...@apache.org>:
>
> > On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:
> >
> > > Actually looks like this was by design in HBASE-10340/HBASE-9892.
> > > It spawns three local region server threads in local mode now, still
> just
> > > one process.
> > >
> > > I now think it's OK. What do other folks think? Should we set the
> default
> > > back to 1?
> > >
> >
> > I think unannounced things that violate the principle of least surprise
> are
> > bad. We should sink the RC and set the default back IMO.
> >
> >
> >
> > --
> > Best regards,
> >
> >    - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
>
>
>
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Actually the bug is in the Gaussian read test.

In generates seek keys by using a Gaussian distribution with the mean of N/2 and a sigma of N/10 (N = number of rows used)  and using this key directly to seek into the HFile. The HFile was seeded with keys from 0-N.

This will fail if we ever generate a key < 0, which is rare, but by no means impossible. We need to clamp the min and max values to 0 and 2*N, resp.


-- Lars



________________________________
 From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org>; lars hofhansl <la...@apache.org> 
Sent: Sunday, February 16, 2014 10:59 AM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download
 


Running fully dist with Hadoop 1.2.1. Retried with 0.94.16 and got the same exception from time to time. So I don't think this will impact the release of 0.94.17. When my PE base line will be done, I will try the same with 0.96 + Hadoop 2.2.0 and see if I get the same exception.




2014-02-16 13:15 GMT-05:00 lars hofhansl <la...@apache.org>:

Hmm... Do you see this in 0.94.17 only (but not in 0.94.16 or earlier)?
>Are you running in local mode or with a real HDFS?
>
>
>-- Lars
>
>----- Original Message -----
>
>From: Jean-Marc Spaggiari <je...@spaggiari.org>
>To: dev <de...@hbase.apache.org>
>
>Cc:
>Sent: Sunday, February 16, 2014 5:29 AM
>Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download
>
>
>+1 to keep the default behavior. It's very nice to have to option to start
>more than one thread but I think for 0.94 we should keep default config.
>But also, it's not a big thing. So I will be only -0 for this in the RC. I
>agree that it's a bit surprising the see the 3 servers, but not that
>dramatic.
>
>Also I'm getting this once in a while when doing HFilePerformanceEvaluation:
>
>org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$NotSeekedException:
>Not seeked to a key/value
>    at
>org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$Scanner.assertSeeked(AbstractHFileReader.java:320)
>    at
>org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:690)
>    at
>org.apache.hadoop.hbase.HFilePerformanceEvaluation$GaussianRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:347)
>    at
>org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169)
>    at
>org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121)
>    at
>org.apache.hadoop.hbase.HFilePerformanceEvaluation$3.run(HFilePerformanceEvaluation.java:97)
>    at java.lang.Thread.run(Thread.java:744)
>
>Occured 30% of the time, and only on GaussianRandomReadBenchmark.
>
>JM
>
>
>
>2014-02-16 2:32 GMT-05:00 Andrew Purtell <ap...@apache.org>:
>
>> On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:
>>
>> > Actually looks like this was by design in HBASE-10340/HBASE-9892.
>> > It spawns three local region server threads in local mode now, still just
>> > one process.
>> >
>> > I now think it's OK. What do other folks think? Should we set the default
>> > back to 1?
>> >
>>
>> I think unannounced things that violate the principle of least surprise are
>> bad. We should sink the RC and set the default back IMO.
>>
>>
>>
>> --
>> Best regards,
>>
>>    - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
>>
>
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Running fully dist with Hadoop 1.2.1. Retried with 0.94.16 and got the same
exception from time to time. So I don't think this will impact the release
of 0.94.17. When my PE base line will be done, I will try the same with
0.96 + Hadoop 2.2.0 and see if I get the same exception.


2014-02-16 13:15 GMT-05:00 lars hofhansl <la...@apache.org>:

> Hmm... Do you see this in 0.94.17 only (but not in 0.94.16 or earlier)?
> Are you running in local mode or with a real HDFS?
>
> -- Lars
>
> ----- Original Message -----
> From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev <de...@hbase.apache.org>
> Cc:
> Sent: Sunday, February 16, 2014 5:29 AM
> Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available
> for download
>
> +1 to keep the default behavior. It's very nice to have to option to start
> more than one thread but I think for 0.94 we should keep default config.
> But also, it's not a big thing. So I will be only -0 for this in the RC. I
> agree that it's a bit surprising the see the 3 servers, but not that
> dramatic.
>
> Also I'm getting this once in a while when doing
> HFilePerformanceEvaluation:
>
> org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$NotSeekedException:
> Not seeked to a key/value
>     at
>
> org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$Scanner.assertSeeked(AbstractHFileReader.java:320)
>     at
>
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:690)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation$GaussianRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:347)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121)
>     at
>
> org.apache.hadoop.hbase.HFilePerformanceEvaluation$3.run(HFilePerformanceEvaluation.java:97)
>     at java.lang.Thread.run(Thread.java:744)
>
> Occured 30% of the time, and only on GaussianRandomReadBenchmark.
>
> JM
>
>
>
> 2014-02-16 2:32 GMT-05:00 Andrew Purtell <ap...@apache.org>:
>
> > On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:
> >
> > > Actually looks like this was by design in HBASE-10340/HBASE-9892.
> > > It spawns three local region server threads in local mode now, still
> just
> > > one process.
> > >
> > > I now think it's OK. What do other folks think? Should we set the
> default
> > > back to 1?
> > >
> >
> > I think unannounced things that violate the principle of least surprise
> are
> > bad. We should sink the RC and set the default back IMO.
> >
> >
> >
> > --
> > Best regards,
> >
> >    - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Hmm... Do you see this in 0.94.17 only (but not in 0.94.16 or earlier)?
Are you running in local mode or with a real HDFS?

-- Lars

----- Original Message -----
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org>
Cc: 
Sent: Sunday, February 16, 2014 5:29 AM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

+1 to keep the default behavior. It's very nice to have to option to start
more than one thread but I think for 0.94 we should keep default config.
But also, it's not a big thing. So I will be only -0 for this in the RC. I
agree that it's a bit surprising the see the 3 servers, but not that
dramatic.

Also I'm getting this once in a while when doing HFilePerformanceEvaluation:

org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$NotSeekedException:
Not seeked to a key/value
    at
org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$Scanner.assertSeeked(AbstractHFileReader.java:320)
    at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:690)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$GaussianRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:347)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$3.run(HFilePerformanceEvaluation.java:97)
    at java.lang.Thread.run(Thread.java:744)

Occured 30% of the time, and only on GaussianRandomReadBenchmark.

JM



2014-02-16 2:32 GMT-05:00 Andrew Purtell <ap...@apache.org>:

> On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:
>
> > Actually looks like this was by design in HBASE-10340/HBASE-9892.
> > It spawns three local region server threads in local mode now, still just
> > one process.
> >
> > I now think it's OK. What do other folks think? Should we set the default
> > back to 1?
> >
>
> I think unannounced things that violate the principle of least surprise are
> bad. We should sink the RC and set the default back IMO.
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>


Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
+1 to keep the default behavior. It's very nice to have to option to start
more than one thread but I think for 0.94 we should keep default config.
But also, it's not a big thing. So I will be only -0 for this in the RC. I
agree that it's a bit surprising the see the 3 servers, but not that
dramatic.

Also I'm getting this once in a while when doing HFilePerformanceEvaluation:

org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$NotSeekedException:
Not seeked to a key/value
    at
org.apache.hadoop.hbase.io.hfile.AbstractHFileReader$Scanner.assertSeeked(AbstractHFileReader.java:320)
    at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:690)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$GaussianRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:347)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121)
    at
org.apache.hadoop.hbase.HFilePerformanceEvaluation$3.run(HFilePerformanceEvaluation.java:97)
    at java.lang.Thread.run(Thread.java:744)

Occured 30% of the time, and only on GaussianRandomReadBenchmark.

JM


2014-02-16 2:32 GMT-05:00 Andrew Purtell <ap...@apache.org>:

> On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:
>
> > Actually looks like this was by design in HBASE-10340/HBASE-9892.
> > It spawns three local region server threads in local mode now, still just
> > one process.
> >
> > I now think it's OK. What do other folks think? Should we set the default
> > back to 1?
> >
>
> I think unannounced things that violate the principle of least surprise are
> bad. We should sink the RC and set the default back IMO.
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by Andrew Purtell <ap...@apache.org>.
On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl <la...@apache.org> wrote:

> Actually looks like this was by design in HBASE-10340/HBASE-9892.
> It spawns three local region server threads in local mode now, still just
> one process.
>
> I now think it's OK. What do other folks think? Should we set the default
> back to 1?
>

I think unannounced things that violate the principle of least surprise are
bad. We should sink the RC and set the default back IMO.



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Actually looks like this was by design in HBASE-10340/HBASE-9892.
It spawns three local region server threads in local mode now, still just one process.

I now think it's OK. What do other folks think? Should we set the default back to 1?

-- Lars



----- Original Message -----
From: lars hofhansl <la...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc: 
Sent: Saturday, February 15, 2014 9:08 PM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Indeed I see this too. That sinks the RC I think, because it's confusing.
Offhand suspects:
HBASE-10473  Add utility for adorning http Context  
HBASE-10340  [BACKPORT] HBASE-9892 Add info port to ServerName to support multi instances in a node  

-- Lars
________________________________
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org>; lars hofhansl <la...@apache.org> 
Sent: Saturday, February 15, 2014 6:29 PM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download


;) Thanks for that ;)

I have testing in progress, but figured something strange when running in
standalone.

I just uncompressed the tar and star HBase and got 3 RS instead of a single
one.

Region Servers
ServerNameStart timeLoad t430s,33172,1392516855825 <http://t430s:57456/>Sat
Feb 15 21:14:15 EST 2014requestsPerSecond=0, numberOfOnlineRegions=0,
usedHeapMB=79, maxHeapMB=966 t430s,33507,1392516856568 <http://t430s:40651/>Sat
Feb 15 21:14:16 EST 2014requestsPerSecond=0, numberOfOnlineRegions=1,
usedHeapMB=79, maxHeapMB=966 t430s,48755,1392516856378 <http://t430s:45187/>Sat
Feb 15 21:14:16 EST 2014requestsPerSecond=0, numberOfOnlineRegions=1,
usedHeapMB=79, maxHeapMB=966 Total: servers: 3
requestsPerSecond=0, numberOfOnlineRegions=2
I just tried with 0.94.16 the same way:

Region Servers
ServerNameStart timeLoad t430s,45148,1392517651202 <http://t430s:60030/>Sat

Feb 15 21:27:31 EST 2014requestsPerSecond=0, numberOfOnlineRegions=2,
usedHeapMB=41, maxHeapMB=966 Total: servers: 1
requestsPerSecond=0, numberOfOnlineRegions=2

JM



2014-02-14 23:54 GMT-05:00 lars hofhansl <la...@apache.org>:

> Just for you JM :)
>
>
> ________________________________
>  From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev <de...@hbase.apache.org>
> Sent: Friday, February 14, 2014 8:14 PM
> Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available
> for download
>
>
> Thanks for making it before the week-end ;) I will run the tests tomorrow
> and Sunday. Might be able to report by Monday EOD.
>
> JM
>
>
>
> 2014-02-14 Ted Yu <yu...@gmail.com>:
>
> > +1 based on the following:
> >
> > 1. Ran test suite using JDK 1.7 - pass
> >   See bottom of email.
> > 2. compiled Phoenix with locally built 0.94.17 - pass
> > 3. checked the documentation
> >
> > Cheers
> >
> >
> > Results :
> >
> > Tests run: 1407, Failures: 0, Errors: 0, Skipped: 13
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD SUCCESS
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 1:09:06.469s
> >
> >
> > On Fri, Feb 14, 2014 at 3:56 PM, lars hofhansl <la...@apache.org> wrote:
> >
> > > The 1st 0.94.17 RC is available for download at
> > > http://people.apache.org/~larsh/hbase-0.94.17-rc0/
> > > Signed with my code signing key: C7CFE328
> > >
> > > HBase 0.94.17 is a bug fix release with 26 fixes:
> > >     [HBASE-7963] - HBase VerifyReplication not working when security
> > > enabled
> > >     [HBASE-10249] - TestReplicationSyncUpTool fails because failover
> > takes
> > > too long
> > >     [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when
> > > shutdown ZooKeeperServers
> > >     [HBASE-10319] - HLog should roll periodically to allow DN
> > decommission
> > > to eventually complete.
> > >     [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
> > >     [HBASE-10335] - AuthFailedException in zookeeper may block
> > replication
> > > forever
> > >     [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName
> to
> > > support multi instances in a node
> > >     [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool
> fail
> > > under hadoop 2.0/23 profiles.
> > >     [HBASE-10371] - Compaction creates empty hfile, then selects this
> > file
> > > for compaction and creates empty hfile and over again
> > >     [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for
> > > version 0.94.15
> > >     [HBASE-10400] - [hbck] Continue if region dir missing on region
> merge
> > > attempt
> > >     [HBASE-10401] - [hbck] perform overlap group merges in parallel
> > >     [HBASE-10448] - ZKUtil create and watch methods don't set watch in
> > > some cases
> > >     [HBASE-10470] - Import generates huge log file while importing
> large
> > > amounts of data
> > >     [HBASE-10481] - API Compatibility JDiff script does not properly
> > > handle arguments in reverse order
> > >     [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed
> for
> > > tests
> > >     [HBASE-10485] - PrefixFilter#filterKeyValue() should perform
> > filtering
> > > on row key
> > >     [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
> > >     [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform
> > > filtering on row key
> > >     [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
> > >     [HBASE-10506] - Fail-fast if client connection is lost before the
> > real
> > > call be executed in RPC layer
> > >     [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up
> > > connection properly when repair is completed' to 0.94 and 0.96
> > >     [HBASE-10423] - Report back the message of split or rollback
> failure
> > > to the master
> > >     [HBASE-10457] - Print corrupted file information in SnapshotInfo
> tool
> > > without -file option
> > >     [HBASE-10473] - Add utility for adorning http Context
> > >     [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to
> > > insufficient waiting
> > >
> > > The list of changes is also available here:
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325845
> > >
> > > Here're the jenkins runs for this RC:
> > > https://builds.apache.org/job/HBase-0.94.17/13/ and
> > > https://builds.apache.org/job/HBase-0.94.17-security/4/
> > >
> > > Please try out the RC, check out the doc, take it for a spin, etc, and
> > > vote +1/-1 by EOD February 21th on whether we should release this as
> > > 0.94.17.
> > >
> > > I know release testing is like pulling teeth and 0.98 is probably a bit
> > > more exiting at this point, but please give this is quick run, so we
> can
> > > get these bug fixes out there.
> > >
> > > Thanks.
> > >
> > > -- Lars
> >
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Indeed I see this too. That sinks the RC I think, because it's confusing.
Offhand suspects:
HBASE-10473  Add utility for adorning http Context  
HBASE-10340  [BACKPORT] HBASE-9892 Add info port to ServerName to support multi instances in a node  

-- Lars
________________________________
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org>; lars hofhansl <la...@apache.org> 
Sent: Saturday, February 15, 2014 6:29 PM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download


;) Thanks for that ;)

I have testing in progress, but figured something strange when running in
standalone.

I just uncompressed the tar and star HBase and got 3 RS instead of a single
one.

Region Servers
ServerNameStart timeLoad t430s,33172,1392516855825 <http://t430s:57456/>Sat
Feb 15 21:14:15 EST 2014requestsPerSecond=0, numberOfOnlineRegions=0,
usedHeapMB=79, maxHeapMB=966 t430s,33507,1392516856568 <http://t430s:40651/>Sat
Feb 15 21:14:16 EST 2014requestsPerSecond=0, numberOfOnlineRegions=1,
usedHeapMB=79, maxHeapMB=966 t430s,48755,1392516856378 <http://t430s:45187/>Sat
Feb 15 21:14:16 EST 2014requestsPerSecond=0, numberOfOnlineRegions=1,
usedHeapMB=79, maxHeapMB=966 Total: servers: 3
requestsPerSecond=0, numberOfOnlineRegions=2
I just tried with 0.94.16 the same way:

Region Servers
ServerNameStart timeLoad t430s,45148,1392517651202 <http://t430s:60030/>Sat
Feb 15 21:27:31 EST 2014requestsPerSecond=0, numberOfOnlineRegions=2,
usedHeapMB=41, maxHeapMB=966 Total: servers: 1
requestsPerSecond=0, numberOfOnlineRegions=2

JM



2014-02-14 23:54 GMT-05:00 lars hofhansl <la...@apache.org>:

> Just for you JM :)
>
>
> ________________________________
>  From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev <de...@hbase.apache.org>
> Sent: Friday, February 14, 2014 8:14 PM
> Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available
> for download
>
>
> Thanks for making it before the week-end ;) I will run the tests tomorrow
> and Sunday. Might be able to report by Monday EOD.
>
> JM
>
>
>
> 2014-02-14 Ted Yu <yu...@gmail.com>:
>
> > +1 based on the following:
> >
> > 1. Ran test suite using JDK 1.7 - pass
> >   See bottom of email.
> > 2. compiled Phoenix with locally built 0.94.17 - pass
> > 3. checked the documentation
> >
> > Cheers
> >
> >
> > Results :
> >
> > Tests run: 1407, Failures: 0, Errors: 0, Skipped: 13
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD SUCCESS
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 1:09:06.469s
> >
> >
> > On Fri, Feb 14, 2014 at 3:56 PM, lars hofhansl <la...@apache.org> wrote:
> >
> > > The 1st 0.94.17 RC is available for download at
> > > http://people.apache.org/~larsh/hbase-0.94.17-rc0/
> > > Signed with my code signing key: C7CFE328
> > >
> > > HBase 0.94.17 is a bug fix release with 26 fixes:
> > >     [HBASE-7963] - HBase VerifyReplication not working when security
> > > enabled
> > >     [HBASE-10249] - TestReplicationSyncUpTool fails because failover
> > takes
> > > too long
> > >     [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when
> > > shutdown ZooKeeperServers
> > >     [HBASE-10319] - HLog should roll periodically to allow DN
> > decommission
> > > to eventually complete.
> > >     [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
> > >     [HBASE-10335] - AuthFailedException in zookeeper may block
> > replication
> > > forever
> > >     [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName
> to
> > > support multi instances in a node
> > >     [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool
> fail
> > > under hadoop 2.0/23 profiles.
> > >     [HBASE-10371] - Compaction creates empty hfile, then selects this
> > file
> > > for compaction and creates empty hfile and over again
> > >     [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for
> > > version 0.94.15
> > >     [HBASE-10400] - [hbck] Continue if region dir missing on region
> merge
> > > attempt
> > >     [HBASE-10401] - [hbck] perform overlap group merges in parallel
> > >     [HBASE-10448] - ZKUtil create and watch methods don't set watch in
> > > some cases
> > >     [HBASE-10470] - Import generates huge log file while importing
> large
> > > amounts of data
> > >     [HBASE-10481] - API Compatibility JDiff script does not properly
> > > handle arguments in reverse order
> > >     [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed
> for
> > > tests
> > >     [HBASE-10485] - PrefixFilter#filterKeyValue() should perform
> > filtering
> > > on row key
> > >     [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
> > >     [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform
> > > filtering on row key
> > >     [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
> > >     [HBASE-10506] - Fail-fast if client connection is lost before the
> > real
> > > call be executed in RPC layer
> > >     [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up
> > > connection properly when repair is completed' to 0.94 and 0.96
> > >     [HBASE-10423] - Report back the message of split or rollback
> failure
> > > to the master
> > >     [HBASE-10457] - Print corrupted file information in SnapshotInfo
> tool
> > > without -file option
> > >     [HBASE-10473] - Add utility for adorning http Context
> > >     [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to
> > > insufficient waiting
> > >
> > > The list of changes is also available here:
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325845
> > >
> > > Here're the jenkins runs for this RC:
> > > https://builds.apache.org/job/HBase-0.94.17/13/ and
> > > https://builds.apache.org/job/HBase-0.94.17-security/4/
> > >
> > > Please try out the RC, check out the doc, take it for a spin, etc, and
> > > vote +1/-1 by EOD February 21th on whether we should release this as
> > > 0.94.17.
> > >
> > > I know release testing is like pulling teeth and 0.98 is probably a bit
> > > more exiting at this point, but please give this is quick run, so we
> can
> > > get these bug fixes out there.
> > >
> > > Thanks.
> > >
> > > -- Lars
> >
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
;) Thanks for that ;)

I have testing in progress, but figured something strange when running in
standalone.

I just uncompressed the tar and star HBase and got 3 RS instead of a single
one.

Region Servers
ServerNameStart timeLoad t430s,33172,1392516855825 <http://t430s:57456/>Sat
Feb 15 21:14:15 EST 2014requestsPerSecond=0, numberOfOnlineRegions=0,
usedHeapMB=79, maxHeapMB=966 t430s,33507,1392516856568 <http://t430s:40651/>Sat
Feb 15 21:14:16 EST 2014requestsPerSecond=0, numberOfOnlineRegions=1,
usedHeapMB=79, maxHeapMB=966 t430s,48755,1392516856378 <http://t430s:45187/>Sat
Feb 15 21:14:16 EST 2014requestsPerSecond=0, numberOfOnlineRegions=1,
usedHeapMB=79, maxHeapMB=966 Total: servers: 3
requestsPerSecond=0, numberOfOnlineRegions=2
I just tried with 0.94.16 the same way:

Region Servers
ServerNameStart timeLoad t430s,45148,1392517651202 <http://t430s:60030/>Sat
Feb 15 21:27:31 EST 2014requestsPerSecond=0, numberOfOnlineRegions=2,
usedHeapMB=41, maxHeapMB=966 Total: servers: 1
requestsPerSecond=0, numberOfOnlineRegions=2

JM


2014-02-14 23:54 GMT-05:00 lars hofhansl <la...@apache.org>:

> Just for you JM :)
>
>
> ________________________________
>  From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev <de...@hbase.apache.org>
> Sent: Friday, February 14, 2014 8:14 PM
> Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available
> for download
>
>
> Thanks for making it before the week-end ;) I will run the tests tomorrow
> and Sunday. Might be able to report by Monday EOD.
>
> JM
>
>
>
> 2014-02-14 Ted Yu <yu...@gmail.com>:
>
> > +1 based on the following:
> >
> > 1. Ran test suite using JDK 1.7 - pass
> >   See bottom of email.
> > 2. compiled Phoenix with locally built 0.94.17 - pass
> > 3. checked the documentation
> >
> > Cheers
> >
> >
> > Results :
> >
> > Tests run: 1407, Failures: 0, Errors: 0, Skipped: 13
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD SUCCESS
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 1:09:06.469s
> >
> >
> > On Fri, Feb 14, 2014 at 3:56 PM, lars hofhansl <la...@apache.org> wrote:
> >
> > > The 1st 0.94.17 RC is available for download at
> > > http://people.apache.org/~larsh/hbase-0.94.17-rc0/
> > > Signed with my code signing key: C7CFE328
> > >
> > > HBase 0.94.17 is a bug fix release with 26 fixes:
> > >     [HBASE-7963] - HBase VerifyReplication not working when security
> > > enabled
> > >     [HBASE-10249] - TestReplicationSyncUpTool fails because failover
> > takes
> > > too long
> > >     [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when
> > > shutdown ZooKeeperServers
> > >     [HBASE-10319] - HLog should roll periodically to allow DN
> > decommission
> > > to eventually complete.
> > >     [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
> > >     [HBASE-10335] - AuthFailedException in zookeeper may block
> > replication
> > > forever
> > >     [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName
> to
> > > support multi instances in a node
> > >     [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool
> fail
> > > under hadoop 2.0/23 profiles.
> > >     [HBASE-10371] - Compaction creates empty hfile, then selects this
> > file
> > > for compaction and creates empty hfile and over again
> > >     [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for
> > > version 0.94.15
> > >     [HBASE-10400] - [hbck] Continue if region dir missing on region
> merge
> > > attempt
> > >     [HBASE-10401] - [hbck] perform overlap group merges in parallel
> > >     [HBASE-10448] - ZKUtil create and watch methods don't set watch in
> > > some cases
> > >     [HBASE-10470] - Import generates huge log file while importing
> large
> > > amounts of data
> > >     [HBASE-10481] - API Compatibility JDiff script does not properly
> > > handle arguments in reverse order
> > >     [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed
> for
> > > tests
> > >     [HBASE-10485] - PrefixFilter#filterKeyValue() should perform
> > filtering
> > > on row key
> > >     [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
> > >     [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform
> > > filtering on row key
> > >     [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
> > >     [HBASE-10506] - Fail-fast if client connection is lost before the
> > real
> > > call be executed in RPC layer
> > >     [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up
> > > connection properly when repair is completed' to 0.94 and 0.96
> > >     [HBASE-10423] - Report back the message of split or rollback
> failure
> > > to the master
> > >     [HBASE-10457] - Print corrupted file information in SnapshotInfo
> tool
> > > without -file option
> > >     [HBASE-10473] - Add utility for adorning http Context
> > >     [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to
> > > insufficient waiting
> > >
> > > The list of changes is also available here:
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325845
> > >
> > > Here're the jenkins runs for this RC:
> > > https://builds.apache.org/job/HBase-0.94.17/13/ and
> > > https://builds.apache.org/job/HBase-0.94.17-security/4/
> > >
> > > Please try out the RC, check out the doc, take it for a spin, etc, and
> > > vote +1/-1 by EOD February 21th on whether we should release this as
> > > 0.94.17.
> > >
> > > I know release testing is like pulling teeth and 0.98 is probably a bit
> > > more exiting at this point, but please give this is quick run, so we
> can
> > > get these bug fixes out there.
> > >
> > > Thanks.
> > >
> > > -- Lars
> >
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by lars hofhansl <la...@apache.org>.
Just for you JM :)


________________________________
 From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org> 
Sent: Friday, February 14, 2014 8:14 PM
Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download
 

Thanks for making it before the week-end ;) I will run the tests tomorrow
and Sunday. Might be able to report by Monday EOD.

JM



2014-02-14 Ted Yu <yu...@gmail.com>:

> +1 based on the following:
>
> 1. Ran test suite using JDK 1.7 - pass
>   See bottom of email.
> 2. compiled Phoenix with locally built 0.94.17 - pass
> 3. checked the documentation
>
> Cheers
>
>
> Results :
>
> Tests run: 1407, Failures: 0, Errors: 0, Skipped: 13
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 1:09:06.469s
>
>
> On Fri, Feb 14, 2014 at 3:56 PM, lars hofhansl <la...@apache.org> wrote:
>
> > The 1st 0.94.17 RC is available for download at
> > http://people.apache.org/~larsh/hbase-0.94.17-rc0/
> > Signed with my code signing key: C7CFE328
> >
> > HBase 0.94.17 is a bug fix release with 26 fixes:
> >     [HBASE-7963] - HBase VerifyReplication not working when security
> > enabled
> >     [HBASE-10249] - TestReplicationSyncUpTool fails because failover
> takes
> > too long
> >     [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when
> > shutdown ZooKeeperServers
> >     [HBASE-10319] - HLog should roll periodically to allow DN
> decommission
> > to eventually complete.
> >     [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
> >     [HBASE-10335] - AuthFailedException in zookeeper may block
> replication
> > forever
> >     [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName to
> > support multi instances in a node
> >     [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool fail
> > under hadoop 2.0/23 profiles.
> >     [HBASE-10371] - Compaction creates empty hfile, then selects this
> file
> > for compaction and creates empty hfile and over again
> >     [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for
> > version 0.94.15
> >     [HBASE-10400] - [hbck] Continue if region dir missing on region merge
> > attempt
> >     [HBASE-10401] - [hbck] perform overlap group merges in parallel
> >     [HBASE-10448] - ZKUtil create and watch methods don't set watch in
> > some cases
> >     [HBASE-10470] - Import generates huge log file while importing large
> > amounts of data
> >     [HBASE-10481] - API Compatibility JDiff script does not properly
> > handle arguments in reverse order
> >     [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed for
> > tests
> >     [HBASE-10485] - PrefixFilter#filterKeyValue() should perform
> filtering
> > on row key
> >     [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
> >     [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform
> > filtering on row key
> >     [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
> >     [HBASE-10506] - Fail-fast if client connection is lost before the
> real
> > call be executed in RPC layer
> >     [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up
> > connection properly when repair is completed' to 0.94 and 0.96
> >     [HBASE-10423] - Report back the message of split or rollback failure
> > to the master
> >     [HBASE-10457] - Print corrupted file information in SnapshotInfo tool
> > without -file option
> >     [HBASE-10473] - Add utility for adorning http Context
> >     [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to
> > insufficient waiting
> >
> > The list of changes is also available here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325845
> >
> > Here're the jenkins runs for this RC:
> > https://builds.apache.org/job/HBase-0.94.17/13/ and
> > https://builds.apache.org/job/HBase-0.94.17-security/4/
> >
> > Please try out the RC, check out the doc, take it for a spin, etc, and
> > vote +1/-1 by EOD February 21th on whether we should release this as
> > 0.94.17.
> >
> > I know release testing is like pulling teeth and 0.98 is probably a bit
> > more exiting at this point, but please give this is quick run, so we can
> > get these bug fixes out there.
> >
> > Thanks.
> >
> > -- Lars
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Thanks for making it before the week-end ;) I will run the tests tomorrow
and Sunday. Might be able to report by Monday EOD.

JM


2014-02-14 Ted Yu <yu...@gmail.com>:

> +1 based on the following:
>
> 1. Ran test suite using JDK 1.7 - pass
>   See bottom of email.
> 2. compiled Phoenix with locally built 0.94.17 - pass
> 3. checked the documentation
>
> Cheers
>
>
> Results :
>
> Tests run: 1407, Failures: 0, Errors: 0, Skipped: 13
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 1:09:06.469s
>
>
> On Fri, Feb 14, 2014 at 3:56 PM, lars hofhansl <la...@apache.org> wrote:
>
> > The 1st 0.94.17 RC is available for download at
> > http://people.apache.org/~larsh/hbase-0.94.17-rc0/
> > Signed with my code signing key: C7CFE328
> >
> > HBase 0.94.17 is a bug fix release with 26 fixes:
> >     [HBASE-7963] - HBase VerifyReplication not working when security
> > enabled
> >     [HBASE-10249] - TestReplicationSyncUpTool fails because failover
> takes
> > too long
> >     [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when
> > shutdown ZooKeeperServers
> >     [HBASE-10319] - HLog should roll periodically to allow DN
> decommission
> > to eventually complete.
> >     [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
> >     [HBASE-10335] - AuthFailedException in zookeeper may block
> replication
> > forever
> >     [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName to
> > support multi instances in a node
> >     [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool fail
> > under hadoop 2.0/23 profiles.
> >     [HBASE-10371] - Compaction creates empty hfile, then selects this
> file
> > for compaction and creates empty hfile and over again
> >     [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for
> > version 0.94.15
> >     [HBASE-10400] - [hbck] Continue if region dir missing on region merge
> > attempt
> >     [HBASE-10401] - [hbck] perform overlap group merges in parallel
> >     [HBASE-10448] - ZKUtil create and watch methods don't set watch in
> > some cases
> >     [HBASE-10470] - Import generates huge log file while importing large
> > amounts of data
> >     [HBASE-10481] - API Compatibility JDiff script does not properly
> > handle arguments in reverse order
> >     [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed for
> > tests
> >     [HBASE-10485] - PrefixFilter#filterKeyValue() should perform
> filtering
> > on row key
> >     [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
> >     [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform
> > filtering on row key
> >     [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
> >     [HBASE-10506] - Fail-fast if client connection is lost before the
> real
> > call be executed in RPC layer
> >     [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up
> > connection properly when repair is completed' to 0.94 and 0.96
> >     [HBASE-10423] - Report back the message of split or rollback failure
> > to the master
> >     [HBASE-10457] - Print corrupted file information in SnapshotInfo tool
> > without -file option
> >     [HBASE-10473] - Add utility for adorning http Context
> >     [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to
> > insufficient waiting
> >
> > The list of changes is also available here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325845
> >
> > Here're the jenkins runs for this RC:
> > https://builds.apache.org/job/HBase-0.94.17/13/ and
> > https://builds.apache.org/job/HBase-0.94.17-security/4/
> >
> > Please try out the RC, check out the doc, take it for a spin, etc, and
> > vote +1/-1 by EOD February 21th on whether we should release this as
> > 0.94.17.
> >
> > I know release testing is like pulling teeth and 0.98 is probably a bit
> > more exiting at this point, but please give this is quick run, so we can
> > get these bug fixes out there.
> >
> > Thanks.
> >
> > -- Lars
>

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

Posted by Ted Yu <yu...@gmail.com>.
+1 based on the following:

1. Ran test suite using JDK 1.7 - pass
  See bottom of email.
2. compiled Phoenix with locally built 0.94.17 - pass
3. checked the documentation

Cheers


Results :

Tests run: 1407, Failures: 0, Errors: 0, Skipped: 13

[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 1:09:06.469s


On Fri, Feb 14, 2014 at 3:56 PM, lars hofhansl <la...@apache.org> wrote:

> The 1st 0.94.17 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.17-rc0/
> Signed with my code signing key: C7CFE328
>
> HBase 0.94.17 is a bug fix release with 26 fixes:
>     [HBASE-7963] - HBase VerifyReplication not working when security
> enabled
>     [HBASE-10249] - TestReplicationSyncUpTool fails because failover takes
> too long
>     [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when
> shutdown ZooKeeperServers
>     [HBASE-10319] - HLog should roll periodically to allow DN decommission
> to eventually complete.
>     [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
>     [HBASE-10335] - AuthFailedException in zookeeper may block replication
> forever
>     [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName to
> support multi instances in a node
>     [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool fail
> under hadoop 2.0/23 profiles.
>     [HBASE-10371] - Compaction creates empty hfile, then selects this file
> for compaction and creates empty hfile and over again
>     [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for
> version 0.94.15
>     [HBASE-10400] - [hbck] Continue if region dir missing on region merge
> attempt
>     [HBASE-10401] - [hbck] perform overlap group merges in parallel
>     [HBASE-10448] - ZKUtil create and watch methods don't set watch in
> some cases
>     [HBASE-10470] - Import generates huge log file while importing large
> amounts of data
>     [HBASE-10481] - API Compatibility JDiff script does not properly
> handle arguments in reverse order
>     [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed for
> tests
>     [HBASE-10485] - PrefixFilter#filterKeyValue() should perform filtering
> on row key
>     [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
>     [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform
> filtering on row key
>     [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
>     [HBASE-10506] - Fail-fast if client connection is lost before the real
> call be executed in RPC layer
>     [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up
> connection properly when repair is completed' to 0.94 and 0.96
>     [HBASE-10423] - Report back the message of split or rollback failure
> to the master
>     [HBASE-10457] - Print corrupted file information in SnapshotInfo tool
> without -file option
>     [HBASE-10473] - Add utility for adorning http Context
>     [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to
> insufficient waiting
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325845
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.17/13/ and
> https://builds.apache.org/job/HBase-0.94.17-security/4/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by EOD February 21th on whether we should release this as
> 0.94.17.
>
> I know release testing is like pulling teeth and 0.98 is probably a bit
> more exiting at this point, but please give this is quick run, so we can
> get these bug fixes out there.
>
> Thanks.
>
> -- Lars