You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Andrew Purtell <ap...@apache.org> on 2014/08/29 01:04:34 UTC

[VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

-1

See HBASE-11857. We should not release something known to not be compatible
with Phoenix. I made that a blocker for 0.98.6.


On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <ap...@apache.org> wrote:

> The 1st HBase 0.98.
> ​6
>  release candidate (RC0) is available for download at
> http://people.apache.org/~apurtell/0.98.6RC0/ and Maven artifacts are
> also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1032/
>
> Signed with my code signing key D5365CCD.
>
> The issues resolved in this release can be found here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
> ​
>
> This ​candidate contains a significant backported change, ZK-less region
> assignment (HBASE-11546), thanks to the heavy lifting of Virag Kothari (and
> original contributors Jimmy Xiang and Virag Kothari). The new code will not
> be active unless the configuration setting "
> hbase.assignment.usezk" is set to '
> ​false
> '.
> ​If possible please consider testing with this configuration change on a
> cluster and/or with the integration tests.​
>
> Please try out the candidate and vote +1/-1 by midnight Pacific Time
> (00:00 -0800 GMT) on
> ​September 2
> on whether or not we should release this as 0.98.
> ​6
> . Three +1 votes from PMC will be required to release.
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Anything you want. Will be glad to help.

It's a directory listing, I have copied all the files of the build
directories from the 4 clusters there. So if you go on
http://server.distparser.com:81/hbase/hbasetest1/hbase-server/target/surefire-reports/
you see all the output for one of the servers. node8, node1, etc. are other
servers.

Output of the specific test can be found there:
http://server.distparser.com:81/hbase/hbasetest1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt

Where we can see what Ted asked to be added:

2014-08-30 22:18:56,709 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label system
2014-08-30 22:18:56,709 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label secret
2014-08-30 22:18:56,710 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label topsecret
2014-08-30 22:18:56,710 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label confidential
2014-08-30 22:18:56,711 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label public
2014-08-30 22:18:56,711 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label private
2014-08-30 22:18:56,712 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label ©ABC
2014-08-30 22:18:56,712 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label à¥
2014-08-30 22:18:56,712 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label ©ABC"ॠ\secret"'&\
2014-08-30 22:18:56,713 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label '"+
2014-08-30 22:18:56,713 DEBUG [Thread-243]
visibility.TestVisibilityLabelsWithDefaultVisLabelService(137):
Retrieved label -?


I can try to install Jenkins on those servers if that helps, run anything
else (tests, builds, etc.) or even give you a remote access. Just let me
know.

JM


2014-08-31 19:54 GMT-04:00 Andrew Purtell <an...@gmail.com>:

> I get a directory listing when I click through.
>
> Build status on Apache Jenkins looks pretty good -
> https://builds.apache.org/job/HBase-0.98/ - and I don't have failing
> tests on my local dev boxes. Any chance you can help us track down what's
> different about your environment?
>
>
> > On Aug 31, 2014, at 3:36 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
> >
> > Here are the results.
> >
> > 4 builds, 4 computers, 4 failed.
> >
> > HTH
> >
> > http://server.distparser.com:81/hbase/
> >
> > Let me know if you want me to run anything else.
> >
> > JM
> >
> >
> > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> >
> >> Jean-Marc:
> >> I couldn't reproduce the test failure - on Mac or Linux.
> >>
> >> Can you apply the following and run test again ?
> >> http://pastebin.com/Z1czdBes
> >>
> >> It would reveal whether log replay didn't bring back the labels written
> >> prior to RS restart, or the new labels were not written successfully.
> >>
> >> Thanks
> >>
> >>
> >> On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> >> jean-marc@spaggiari.org> wrote:
> >>
> >>> I will see if I can build something where the logs are automatically
> >>> uploaded so that will make easier to look at them.
> >>>
> >>> I just pushed the files related to this test.
> >>
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> >>
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> >>>
> >>> HTH
> >>>
> >>> JM
> >>>
> >>>
> >>> 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> >>>
> >>>> On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> >>>> jean-marc@spaggiari.org> wrote:
> >>>>
> >>>>> Here are the logs for
> >>
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> >>>>> : http://www.spaggiari.org/hbase-0.98.6.logs
> >>>>>
> >>>>> Let me know if you need any other file. This is the standard output
> >>> with
> >>>>> -X.
> >>>>
> >>>> I was looking for the
> >>>> hbase-server/target/surefire-reports/<test-name>-output.txt file, but
> >>> ​you
> >>>> could run the test with -Dtest.output.tofile=false​ and capture
> >> standard
> >>>> output too.
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Best regards,
> >>>>
> >>>>   - Andy
> >>>>
> >>>> Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein
> >>>> (via Tom White)
> >>
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Andrew Purtell <an...@gmail.com>.
I get a directory listing when I click through. 

Build status on Apache Jenkins looks pretty good - https://builds.apache.org/job/HBase-0.98/ - and I don't have failing tests on my local dev boxes. Any chance you can help us track down what's different about your environment? 


> On Aug 31, 2014, at 3:36 PM, Jean-Marc Spaggiari <je...@spaggiari.org> wrote:
> 
> Here are the results.
> 
> 4 builds, 4 computers, 4 failed.
> 
> HTH
> 
> http://server.distparser.com:81/hbase/
> 
> Let me know if you want me to run anything else.
> 
> JM
> 
> 
> 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> 
>> Jean-Marc:
>> I couldn't reproduce the test failure - on Mac or Linux.
>> 
>> Can you apply the following and run test again ?
>> http://pastebin.com/Z1czdBes
>> 
>> It would reveal whether log replay didn't bring back the labels written
>> prior to RS restart, or the new labels were not written successfully.
>> 
>> Thanks
>> 
>> 
>> On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
>> jean-marc@spaggiari.org> wrote:
>> 
>>> I will see if I can build something where the logs are automatically
>>> uploaded so that will make easier to look at them.
>>> 
>>> I just pushed the files related to this test.
>> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
>> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
>>> 
>>> HTH
>>> 
>>> JM
>>> 
>>> 
>>> 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
>>> 
>>>> On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
>>>> jean-marc@spaggiari.org> wrote:
>>>> 
>>>>> Here are the logs for
>> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
>>>>> : http://www.spaggiari.org/hbase-0.98.6.logs
>>>>> 
>>>>> Let me know if you need any other file. This is the standard output
>>> with
>>>>> -X.
>>>> 
>>>> I was looking for the
>>>> hbase-server/target/surefire-reports/<test-name>-output.txt file, but
>>> ​you
>>>> could run the test with -Dtest.output.tofile=false​ and capture
>> standard
>>>> output too.
>>>> 
>>>> 
>>>> 
>>>> --
>>>> Best regards,
>>>> 
>>>>   - Andy
>>>> 
>>>> Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein
>>>> (via Tom White)
>> 

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Ted Yu <yu...@gmail.com>.
Thanks J-M

Your effort is valuable.


On Tue, Sep 2, 2014 at 11:16 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Tried Ted's patch on 3 servers. The 3 passed.
>
>
> 2014-09-02 10:40 GMT-04:00 Ted Yu <yu...@gmail.com>:
>
> > Thanks to Jean-Marc's assistance, the cause
> > for
> >
> TestVisibilityLabelsWithDistributedLogReplay#testAddVisibilityLabelsOnRSRestart
> > failure has been found.
> >
> > I logged HBASE-11878 and attached a preliminary patch.
> >
> > Cheers
> >
> >
> > On Mon, Sep 1, 2014 at 10:41 AM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > Searching for 'hbase.ResourceChecker(147): before' in
> > >
> >
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > showed that testAddVisibilityLabelsOnRSRestart was the first sub-test
> to
> > > be run:
> > >
> > > 2014-09-01 08:41:12,266 INFO  [pool-1-thread-1]
> > hbase.ResourceChecker(147): before:
> >
> security.visibility.TestVisibilityLabelsWithDistributedLogReplay#testAddVisibilityLabelsOnRSRestart
> > Thread=295, OpenFileDescriptor=380, MaxFileDescriptor=65536,
> > >
> > > What Ram described was different from the problem JMS reported - since
> > "ABC" and "XYZ" were not written to hbase:labels table, the test would
> > surely fail.
> > >
> > > Cheers
> > >
> > >
> > >
> > > On Mon, Sep 1, 2014 at 9:53 AM, ramkrishna vasudevan <
> > > ramkrishna.s.vasudevan@gmail.com> wrote:
> > >
> > >> To reproduce just ensured that
> > >> in TestVisibilityLabelsWithDefaultVisLabelService the testAddLabels
> and
> > >> then testVddAddVisibilityLabelsOnRSRestart runs.
> > >> This ensures that the total no of labels is 17 and not 13.
> > >>
> > >> So may be when it runs in Jenkins the order of execution determines
> the
> > >> way
> > >> the labels are added or deleted.
> > >> String[] labels = { SECRET, TOPSECRET, CONFIDENTIAL, PUBLIC, PRIVATE,
> > >> COPYRIGHT,
> > >>       ACCENT, UNICODE_VIS_TAG, UC1, UC2 };
> > >> static String[] labels1 = { "L1", SECRET, "L2", "invalid~", "L3" };
> > >>   static String[] labels2 = { SECRET, CONFIDENTIAL, PRIVATE, "ABC",
> > "XYZ"
> > >> };
> > >>
> > >> Count this excluding the repeated confidential, secret and private it
> > >> gives
> > >> 17.   So may be we can seperate the test cases?
> > >>
> > >> Regards
> > >> Ram
> > >>
> > >>
> > >> On Mon, Sep 1, 2014 at 9:55 PM, Jean-Marc Spaggiari <
> > >> jean-marc@spaggiari.org
> > >> > wrote:
> > >>
> > >> > Cool! Glad to see I'm not the only one ;)
> > >> >
> > >> > Since it passed on Jenkins does it mean we need to add some
> additional
> > >> > tests?
> > >> > Le 2014-09-01 12:20, "ramkrishna vasudevan" <
> > >> > ramkrishna.s.vasudevan@gmail.com> a écrit :
> > >> >
> > >> > > Am able to reproduce this locally. Will try to come up with a
> patch.
> > >> > >
> > >> > >
> > >> > > On Mon, Sep 1, 2014 at 9:43 PM, Jean-Marc Spaggiari <
> > >> > > jean-marc@spaggiari.org
> > >> > > > wrote:
> > >> > >
> > >> > > > So I guess that's why we don't see the log you have added? It
> > loops
> > >> and
> > >> > > > timeout and never reach that point?
> > >> > > >
> > >> > > > What's next? Anything else I can run/do/test/check? I can even
> > >> install
> > >> > > > Jenkins on those 4 servers....
> > >> > > >
> > >> > > >
> > >> > > > 2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > >>
> > >> > > >
> > >> > > > > The patch I sent to Jean-Marc added a loop when retrieving
> > labels.
> > >> > > > >
> > >> > > > > Looking at
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > >> > > > > , there was no log from DefaultVisibilityLabelServiceImpl
> w.r.t.
> > >> > labels
> > >> > > > ABC
> > >> > > > > and XYZ.
> > >> > > > >
> > >> > > > > The timeout of test was due to these two labels not written to
> > >> > > > hbase:labels
> > >> > > > > table.
> > >> > > > >
> > >> > > > > Cheers
> > >> > > > >
> > >> > > > >
> > >> > > > >
> > >> > > > > On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
> > >> > > > > jean-marc@spaggiari.org
> > >> > > > > > wrote:
> > >> > > > >
> > >> > > > > > Ted sent me another patch to test.
> > >> > > > > >
> > >> > > > > > Everything is here:
> > >> > > > > http://server.distparser.com:81/hbase/with_teds_patch/
> > >> > > > > >
> > >> > > > > > This specific test did not failed on hbasetest1
> > >> > > > > >
> > >> > > > > > Only this one failed on node8:
> > >> > > > > > Tests in error:
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> > >> > > > > > test timed out after 60000 milliseconds
> > >> > > > > >
> > >> > > > > > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > And many tests failed on node1 and t430s. But all
> > >> > > > > > TestVisibilityLabelsWithDistributedLogReplay failed with
> > >> timeout.
> > >> > > > > >
> > >> > > > > > Again, I have copied everything on the server so you look at
> > >> > whatever
> > >> > > > can
> > >> > > > > > be interesting.
> > >> > > > > >
> > >> > > > > > <
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > >> > > > > > >
> > >> > > > > >
> > >> > > > > > Feel free to send me anything you want me to test. Also, I
> can
> > >> > share
> > >> > > > all
> > >> > > > > > required information, like CPU, etc. if that helps.
> > >> > > > > >
> > >> > > > > > JM
> > >> > > > > >
> > >> > > > > > 2014-09-01 0:06 GMT-04:00 Anoop John <anoop.hbase@gmail.com
> >:
> > >> > > > > >
> > >> > > > > > > The addition of the 2 new labels would have failed (?)
> May
> > >> be we
> > >> > > log
> > >> > > > > the
> > >> > > > > > > return value of this addition in test and see the trace?
> > >> > > > > > >
> > >> > > > > > > -Anoop-
> > >> > > > > > >
> > >> > > > > > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <
> yuzhihong@gmail.com
> > >
> > >> > > wrote:
> > >> > > > > > >
> > >> > > > > > > > In the output of successful test run, I saw:
> > >> > > > > > > >
> > >> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
> > >> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > >> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252):
> Adding
> > >> the
> > >> > > label
> > >> > > > > ABC
> > >> > > > > > > >
> > >> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
> > >> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > >> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252):
> Adding
> > >> the
> > >> > > label
> > >> > > > > XYZ
> > >> > > > > > > >
> > >> > > > > > > > From
> > >> > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > >> > > > > > > > , I don't see the above.
> > >> > > > > > > >
> > >> > > > > > > > The additional debug log confirmed that the two new
> labels
> > >> were
> > >> > > not
> > >> > > > > > read
> > >> > > > > > > > back.
> > >> > > > > > > >
> > >> > > > > > > > Cheers
> > >> > > > > > > >
> > >> > > > > > > >
> > >> > > > > > > >
> > >> > > > > > > >
> > >> > > > > > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> > >> > > > > > > >  jean-marc@spaggiari.org> wrote:
> > >> > > > > > > >
> > >> > > > > > > > > Here are the results.
> > >> > > > > > > > >
> > >> > > > > > > > > 4 builds, 4 computers, 4 failed.
> > >> > > > > > > > >
> > >> > > > > > > > > HTH
> > >> > > > > > > > >
> > >> > > > > > > > > http://server.distparser.com:81/hbase/
> > >> > > > > > > > >
> > >> > > > > > > > > Let me know if you want me to run anything else.
> > >> > > > > > > > >
> > >> > > > > > > > > JM
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <
> yuzhihong@gmail.com
> > >:
> > >> > > > > > > > >
> > >> > > > > > > > > > Jean-Marc:
> > >> > > > > > > > > > I couldn't reproduce the test failure - on Mac or
> > Linux.
> > >> > > > > > > > > >
> > >> > > > > > > > > > Can you apply the following and run test again ?
> > >> > > > > > > > > > http://pastebin.com/Z1czdBes
> > >> > > > > > > > > >
> > >> > > > > > > > > > It would reveal whether log replay didn't bring back
> > the
> > >> > > labels
> > >> > > > > > > written
> > >> > > > > > > > > > prior to RS restart, or the new labels were not
> > written
> > >> > > > > > successfully.
> > >> > > > > > > > > >
> > >> > > > > > > > > > Thanks
> > >> > > > > > > > > >
> > >> > > > > > > > > >
> > >> > > > > > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc
> Spaggiari <
> > >> > > > > > > > > > jean-marc@spaggiari.org> wrote:
> > >> > > > > > > > > >
> > >> > > > > > > > > > > I will see if I can build something where the logs
> > are
> > >> > > > > > > automatically
> > >> > > > > > > > > > > uploaded so that will make easier to look at them.
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > I just pushed the files related to this test.
> > >> > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > >> > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > HTH
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > JM
> > >> > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <
> > >> > > > apurtell@apache.org
> > >> > > > > >:
> > >> > > > > > > > > > >
> > >> > > > > > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc
> > >> Spaggiari <
> > >> > > > > > > > > > > > jean-marc@spaggiari.org> wrote:
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > > > Here are the logs for
> > >> > > > > > > > > > > > >
> > >> > > > > > > > > > > > >
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > >> > > > > > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > >> > > > > > > > > > > > >
> > >> > > > > > > > > > > > > Let me know if you need any other file. This
> is
> > >> the
> > >> > > > > standard
> > >> > > > > > > > output
> > >> > > > > > > > > > > with
> > >> > > > > > > > > > > > > -X.
> > >> > > > > > > > > > > > >
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > > I was looking for the
> > >> > > > > > > > > > > >
> > >> > > hbase-server/target/surefire-reports/<test-name>-output.txt
> > >> > > > > > file,
> > >> > > > > > > > but
> > >> > > > > > > > > > > ​you
> > >> > > > > > > > > > > > could run the test with
> > -Dtest.output.tofile=false​
> > >> and
> > >> > > > > capture
> > >> > > > > > > > > > standard
> > >> > > > > > > > > > > > output too.
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > > --
> > >> > > > > > > > > > > > Best regards,
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > >    - Andy
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > > > Problems worthy of attack prove their worth by
> > >> hitting
> > >> > > > back.
> > >> > > > > -
> > >> > > > > > > Piet
> > >> > > > > > > > > > Hein
> > >> > > > > > > > > > > > (via Tom White)
> > >> > > > > > > > > > > >
> > >> > > > > > > > > > >
> > >> > > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Tried Ted's patch on 3 servers. The 3 passed.


2014-09-02 10:40 GMT-04:00 Ted Yu <yu...@gmail.com>:

> Thanks to Jean-Marc's assistance, the cause
> for
> TestVisibilityLabelsWithDistributedLogReplay#testAddVisibilityLabelsOnRSRestart
> failure has been found.
>
> I logged HBASE-11878 and attached a preliminary patch.
>
> Cheers
>
>
> On Mon, Sep 1, 2014 at 10:41 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > Searching for 'hbase.ResourceChecker(147): before' in
> >
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > showed that testAddVisibilityLabelsOnRSRestart was the first sub-test to
> > be run:
> >
> > 2014-09-01 08:41:12,266 INFO  [pool-1-thread-1]
> hbase.ResourceChecker(147): before:
> security.visibility.TestVisibilityLabelsWithDistributedLogReplay#testAddVisibilityLabelsOnRSRestart
> Thread=295, OpenFileDescriptor=380, MaxFileDescriptor=65536,
> >
> > What Ram described was different from the problem JMS reported - since
> "ABC" and "XYZ" were not written to hbase:labels table, the test would
> surely fail.
> >
> > Cheers
> >
> >
> >
> > On Mon, Sep 1, 2014 at 9:53 AM, ramkrishna vasudevan <
> > ramkrishna.s.vasudevan@gmail.com> wrote:
> >
> >> To reproduce just ensured that
> >> in TestVisibilityLabelsWithDefaultVisLabelService the testAddLabels and
> >> then testVddAddVisibilityLabelsOnRSRestart runs.
> >> This ensures that the total no of labels is 17 and not 13.
> >>
> >> So may be when it runs in Jenkins the order of execution determines the
> >> way
> >> the labels are added or deleted.
> >> String[] labels = { SECRET, TOPSECRET, CONFIDENTIAL, PUBLIC, PRIVATE,
> >> COPYRIGHT,
> >>       ACCENT, UNICODE_VIS_TAG, UC1, UC2 };
> >> static String[] labels1 = { "L1", SECRET, "L2", "invalid~", "L3" };
> >>   static String[] labels2 = { SECRET, CONFIDENTIAL, PRIVATE, "ABC",
> "XYZ"
> >> };
> >>
> >> Count this excluding the repeated confidential, secret and private it
> >> gives
> >> 17.   So may be we can seperate the test cases?
> >>
> >> Regards
> >> Ram
> >>
> >>
> >> On Mon, Sep 1, 2014 at 9:55 PM, Jean-Marc Spaggiari <
> >> jean-marc@spaggiari.org
> >> > wrote:
> >>
> >> > Cool! Glad to see I'm not the only one ;)
> >> >
> >> > Since it passed on Jenkins does it mean we need to add some additional
> >> > tests?
> >> > Le 2014-09-01 12:20, "ramkrishna vasudevan" <
> >> > ramkrishna.s.vasudevan@gmail.com> a écrit :
> >> >
> >> > > Am able to reproduce this locally. Will try to come up with a patch.
> >> > >
> >> > >
> >> > > On Mon, Sep 1, 2014 at 9:43 PM, Jean-Marc Spaggiari <
> >> > > jean-marc@spaggiari.org
> >> > > > wrote:
> >> > >
> >> > > > So I guess that's why we don't see the log you have added? It
> loops
> >> and
> >> > > > timeout and never reach that point?
> >> > > >
> >> > > > What's next? Anything else I can run/do/test/check? I can even
> >> install
> >> > > > Jenkins on those 4 servers....
> >> > > >
> >> > > >
> >> > > > 2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:
> >>
> >> > > >
> >> > > > > The patch I sent to Jean-Marc added a loop when retrieving
> labels.
> >> > > > >
> >> > > > > Looking at
> >> > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> >> > > > > , there was no log from DefaultVisibilityLabelServiceImpl w.r.t.
> >> > labels
> >> > > > ABC
> >> > > > > and XYZ.
> >> > > > >
> >> > > > > The timeout of test was due to these two labels not written to
> >> > > > hbase:labels
> >> > > > > table.
> >> > > > >
> >> > > > > Cheers
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > > On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
> >> > > > > jean-marc@spaggiari.org
> >> > > > > > wrote:
> >> > > > >
> >> > > > > > Ted sent me another patch to test.
> >> > > > > >
> >> > > > > > Everything is here:
> >> > > > > http://server.distparser.com:81/hbase/with_teds_patch/
> >> > > > > >
> >> > > > > > This specific test did not failed on hbasetest1
> >> > > > > >
> >> > > > > > Only this one failed on node8:
> >> > > > > > Tests in error:
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> >> > > > > > test timed out after 60000 milliseconds
> >> > > > > >
> >> > > > > > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
> >> > > > > >
> >> > > > > >
> >> > > > > > And many tests failed on node1 and t430s. But all
> >> > > > > > TestVisibilityLabelsWithDistributedLogReplay failed with
> >> timeout.
> >> > > > > >
> >> > > > > > Again, I have copied everything on the server so you look at
> >> > whatever
> >> > > > can
> >> > > > > > be interesting.
> >> > > > > >
> >> > > > > > <
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> >> > > > > > >
> >> > > > > >
> >> > > > > > Feel free to send me anything you want me to test. Also, I can
> >> > share
> >> > > > all
> >> > > > > > required information, like CPU, etc. if that helps.
> >> > > > > >
> >> > > > > > JM
> >> > > > > >
> >> > > > > > 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
> >> > > > > >
> >> > > > > > > The addition of the 2 new labels would have failed (?)  May
> >> be we
> >> > > log
> >> > > > > the
> >> > > > > > > return value of this addition in test and see the trace?
> >> > > > > > >
> >> > > > > > > -Anoop-
> >> > > > > > >
> >> > > > > > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yuzhihong@gmail.com
> >
> >> > > wrote:
> >> > > > > > >
> >> > > > > > > > In the output of successful test run, I saw:
> >> > > > > > > >
> >> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
> >> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> >> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding
> >> the
> >> > > label
> >> > > > > ABC
> >> > > > > > > >
> >> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
> >> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> >> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding
> >> the
> >> > > label
> >> > > > > XYZ
> >> > > > > > > >
> >> > > > > > > > From
> >> > > > > > > >
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> >> > > > > > > > , I don't see the above.
> >> > > > > > > >
> >> > > > > > > > The additional debug log confirmed that the two new labels
> >> were
> >> > > not
> >> > > > > > read
> >> > > > > > > > back.
> >> > > > > > > >
> >> > > > > > > > Cheers
> >> > > > > > > >
> >> > > > > > > >
> >> > > > > > > >
> >> > > > > > > >
> >> > > > > > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> >> > > > > > > >  jean-marc@spaggiari.org> wrote:
> >> > > > > > > >
> >> > > > > > > > > Here are the results.
> >> > > > > > > > >
> >> > > > > > > > > 4 builds, 4 computers, 4 failed.
> >> > > > > > > > >
> >> > > > > > > > > HTH
> >> > > > > > > > >
> >> > > > > > > > > http://server.distparser.com:81/hbase/
> >> > > > > > > > >
> >> > > > > > > > > Let me know if you want me to run anything else.
> >> > > > > > > > >
> >> > > > > > > > > JM
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yuzhihong@gmail.com
> >:
> >> > > > > > > > >
> >> > > > > > > > > > Jean-Marc:
> >> > > > > > > > > > I couldn't reproduce the test failure - on Mac or
> Linux.
> >> > > > > > > > > >
> >> > > > > > > > > > Can you apply the following and run test again ?
> >> > > > > > > > > > http://pastebin.com/Z1czdBes
> >> > > > > > > > > >
> >> > > > > > > > > > It would reveal whether log replay didn't bring back
> the
> >> > > labels
> >> > > > > > > written
> >> > > > > > > > > > prior to RS restart, or the new labels were not
> written
> >> > > > > > successfully.
> >> > > > > > > > > >
> >> > > > > > > > > > Thanks
> >> > > > > > > > > >
> >> > > > > > > > > >
> >> > > > > > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> >> > > > > > > > > > jean-marc@spaggiari.org> wrote:
> >> > > > > > > > > >
> >> > > > > > > > > > > I will see if I can build something where the logs
> are
> >> > > > > > > automatically
> >> > > > > > > > > > > uploaded so that will make easier to look at them.
> >> > > > > > > > > > >
> >> > > > > > > > > > > I just pushed the files related to this test.
> >> > > > > > > > > > >
> >> > > > > > > > > > >
> >> > > > > > > > > > >
> >> > > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> >> > > > > > > > > > >
> >> > > > > > > > > > >
> >> > > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> >> > > > > > > > > > >
> >> > > > > > > > > > > HTH
> >> > > > > > > > > > >
> >> > > > > > > > > > > JM
> >> > > > > > > > > > >
> >> > > > > > > > > > >
> >> > > > > > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <
> >> > > > apurtell@apache.org
> >> > > > > >:
> >> > > > > > > > > > >
> >> > > > > > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc
> >> Spaggiari <
> >> > > > > > > > > > > > jean-marc@spaggiari.org> wrote:
> >> > > > > > > > > > > >
> >> > > > > > > > > > > > > Here are the logs for
> >> > > > > > > > > > > > >
> >> > > > > > > > > > > > >
> >> > > > > > > > > > > >
> >> > > > > > > > > > >
> >> > > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> >> > > > > > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> >> > > > > > > > > > > > >
> >> > > > > > > > > > > > > Let me know if you need any other file. This is
> >> the
> >> > > > > standard
> >> > > > > > > > output
> >> > > > > > > > > > > with
> >> > > > > > > > > > > > > -X.
> >> > > > > > > > > > > > >
> >> > > > > > > > > > > >
> >> > > > > > > > > > > > I was looking for the
> >> > > > > > > > > > > >
> >> > > hbase-server/target/surefire-reports/<test-name>-output.txt
> >> > > > > > file,
> >> > > > > > > > but
> >> > > > > > > > > > > ​you
> >> > > > > > > > > > > > could run the test with
> -Dtest.output.tofile=false​
> >> and
> >> > > > > capture
> >> > > > > > > > > > standard
> >> > > > > > > > > > > > output too.
> >> > > > > > > > > > > >
> >> > > > > > > > > > > >
> >> > > > > > > > > > > >
> >> > > > > > > > > > > > --
> >> > > > > > > > > > > > Best regards,
> >> > > > > > > > > > > >
> >> > > > > > > > > > > >    - Andy
> >> > > > > > > > > > > >
> >> > > > > > > > > > > > Problems worthy of attack prove their worth by
> >> hitting
> >> > > > back.
> >> > > > > -
> >> > > > > > > Piet
> >> > > > > > > > > > Hein
> >> > > > > > > > > > > > (via Tom White)
> >> > > > > > > > > > > >
> >> > > > > > > > > > >
> >> > > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Ted Yu <yu...@gmail.com>.
Thanks to Jean-Marc's assistance, the cause
for TestVisibilityLabelsWithDistributedLogReplay#testAddVisibilityLabelsOnRSRestart
failure has been found.

I logged HBASE-11878 and attached a preliminary patch.

Cheers


On Mon, Sep 1, 2014 at 10:41 AM, Ted Yu <yu...@gmail.com> wrote:

> Searching for 'hbase.ResourceChecker(147): before' in
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> showed that testAddVisibilityLabelsOnRSRestart was the first sub-test to
> be run:
>
> 2014-09-01 08:41:12,266 INFO  [pool-1-thread-1] hbase.ResourceChecker(147): before: security.visibility.TestVisibilityLabelsWithDistributedLogReplay#testAddVisibilityLabelsOnRSRestart Thread=295, OpenFileDescriptor=380, MaxFileDescriptor=65536,
>
> What Ram described was different from the problem JMS reported - since "ABC" and "XYZ" were not written to hbase:labels table, the test would surely fail.
>
> Cheers
>
>
>
> On Mon, Sep 1, 2014 at 9:53 AM, ramkrishna vasudevan <
> ramkrishna.s.vasudevan@gmail.com> wrote:
>
>> To reproduce just ensured that
>> in TestVisibilityLabelsWithDefaultVisLabelService the testAddLabels and
>> then testVddAddVisibilityLabelsOnRSRestart runs.
>> This ensures that the total no of labels is 17 and not 13.
>>
>> So may be when it runs in Jenkins the order of execution determines the
>> way
>> the labels are added or deleted.
>> String[] labels = { SECRET, TOPSECRET, CONFIDENTIAL, PUBLIC, PRIVATE,
>> COPYRIGHT,
>>       ACCENT, UNICODE_VIS_TAG, UC1, UC2 };
>> static String[] labels1 = { "L1", SECRET, "L2", "invalid~", "L3" };
>>   static String[] labels2 = { SECRET, CONFIDENTIAL, PRIVATE, "ABC", "XYZ"
>> };
>>
>> Count this excluding the repeated confidential, secret and private it
>> gives
>> 17.   So may be we can seperate the test cases?
>>
>> Regards
>> Ram
>>
>>
>> On Mon, Sep 1, 2014 at 9:55 PM, Jean-Marc Spaggiari <
>> jean-marc@spaggiari.org
>> > wrote:
>>
>> > Cool! Glad to see I'm not the only one ;)
>> >
>> > Since it passed on Jenkins does it mean we need to add some additional
>> > tests?
>> > Le 2014-09-01 12:20, "ramkrishna vasudevan" <
>> > ramkrishna.s.vasudevan@gmail.com> a écrit :
>> >
>> > > Am able to reproduce this locally. Will try to come up with a patch.
>> > >
>> > >
>> > > On Mon, Sep 1, 2014 at 9:43 PM, Jean-Marc Spaggiari <
>> > > jean-marc@spaggiari.org
>> > > > wrote:
>> > >
>> > > > So I guess that's why we don't see the log you have added? It loops
>> and
>> > > > timeout and never reach that point?
>> > > >
>> > > > What's next? Anything else I can run/do/test/check? I can even
>> install
>> > > > Jenkins on those 4 servers....
>> > > >
>> > > >
>> > > > 2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:
>>
>> > > >
>> > > > > The patch I sent to Jean-Marc added a loop when retrieving labels.
>> > > > >
>> > > > > Looking at
>> > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
>> > > > > , there was no log from DefaultVisibilityLabelServiceImpl w.r.t.
>> > labels
>> > > > ABC
>> > > > > and XYZ.
>> > > > >
>> > > > > The timeout of test was due to these two labels not written to
>> > > > hbase:labels
>> > > > > table.
>> > > > >
>> > > > > Cheers
>> > > > >
>> > > > >
>> > > > >
>> > > > > On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
>> > > > > jean-marc@spaggiari.org
>> > > > > > wrote:
>> > > > >
>> > > > > > Ted sent me another patch to test.
>> > > > > >
>> > > > > > Everything is here:
>> > > > > http://server.distparser.com:81/hbase/with_teds_patch/
>> > > > > >
>> > > > > > This specific test did not failed on hbasetest1
>> > > > > >
>> > > > > > Only this one failed on node8:
>> > > > > > Tests in error:
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
>> > > > > > test timed out after 60000 milliseconds
>> > > > > >
>> > > > > > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
>> > > > > >
>> > > > > >
>> > > > > > And many tests failed on node1 and t430s. But all
>> > > > > > TestVisibilityLabelsWithDistributedLogReplay failed with
>> timeout.
>> > > > > >
>> > > > > > Again, I have copied everything on the server so you look at
>> > whatever
>> > > > can
>> > > > > > be interesting.
>> > > > > >
>> > > > > > <
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
>> > > > > > >
>> > > > > >
>> > > > > > Feel free to send me anything you want me to test. Also, I can
>> > share
>> > > > all
>> > > > > > required information, like CPU, etc. if that helps.
>> > > > > >
>> > > > > > JM
>> > > > > >
>> > > > > > 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
>> > > > > >
>> > > > > > > The addition of the 2 new labels would have failed (?)  May
>> be we
>> > > log
>> > > > > the
>> > > > > > > return value of this addition in test and see the trace?
>> > > > > > >
>> > > > > > > -Anoop-
>> > > > > > >
>> > > > > > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com>
>> > > wrote:
>> > > > > > >
>> > > > > > > > In the output of successful test run, I saw:
>> > > > > > > >
>> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
>> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
>> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding
>> the
>> > > label
>> > > > > ABC
>> > > > > > > >
>> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
>> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
>> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding
>> the
>> > > label
>> > > > > XYZ
>> > > > > > > >
>> > > > > > > > From
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
>> > > > > > > > , I don't see the above.
>> > > > > > > >
>> > > > > > > > The additional debug log confirmed that the two new labels
>> were
>> > > not
>> > > > > > read
>> > > > > > > > back.
>> > > > > > > >
>> > > > > > > > Cheers
>> > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
>> > > > > > > >  jean-marc@spaggiari.org> wrote:
>> > > > > > > >
>> > > > > > > > > Here are the results.
>> > > > > > > > >
>> > > > > > > > > 4 builds, 4 computers, 4 failed.
>> > > > > > > > >
>> > > > > > > > > HTH
>> > > > > > > > >
>> > > > > > > > > http://server.distparser.com:81/hbase/
>> > > > > > > > >
>> > > > > > > > > Let me know if you want me to run anything else.
>> > > > > > > > >
>> > > > > > > > > JM
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
>> > > > > > > > >
>> > > > > > > > > > Jean-Marc:
>> > > > > > > > > > I couldn't reproduce the test failure - on Mac or Linux.
>> > > > > > > > > >
>> > > > > > > > > > Can you apply the following and run test again ?
>> > > > > > > > > > http://pastebin.com/Z1czdBes
>> > > > > > > > > >
>> > > > > > > > > > It would reveal whether log replay didn't bring back the
>> > > labels
>> > > > > > > written
>> > > > > > > > > > prior to RS restart, or the new labels were not written
>> > > > > > successfully.
>> > > > > > > > > >
>> > > > > > > > > > Thanks
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
>> > > > > > > > > > jean-marc@spaggiari.org> wrote:
>> > > > > > > > > >
>> > > > > > > > > > > I will see if I can build something where the logs are
>> > > > > > > automatically
>> > > > > > > > > > > uploaded so that will make easier to look at them.
>> > > > > > > > > > >
>> > > > > > > > > > > I just pushed the files related to this test.
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
>> > > > > > > > > > >
>> > > > > > > > > > > HTH
>> > > > > > > > > > >
>> > > > > > > > > > > JM
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <
>> > > > apurtell@apache.org
>> > > > > >:
>> > > > > > > > > > >
>> > > > > > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc
>> Spaggiari <
>> > > > > > > > > > > > jean-marc@spaggiari.org> wrote:
>> > > > > > > > > > > >
>> > > > > > > > > > > > > Here are the logs for
>> > > > > > > > > > > > >
>> > > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
>> > > > > > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
>> > > > > > > > > > > > >
>> > > > > > > > > > > > > Let me know if you need any other file. This is
>> the
>> > > > > standard
>> > > > > > > > output
>> > > > > > > > > > > with
>> > > > > > > > > > > > > -X.
>> > > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > > > I was looking for the
>> > > > > > > > > > > >
>> > > hbase-server/target/surefire-reports/<test-name>-output.txt
>> > > > > > file,
>> > > > > > > > but
>> > > > > > > > > > > ​you
>> > > > > > > > > > > > could run the test with -Dtest.output.tofile=false​
>> and
>> > > > > capture
>> > > > > > > > > > standard
>> > > > > > > > > > > > output too.
>> > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > > > --
>> > > > > > > > > > > > Best regards,
>> > > > > > > > > > > >
>> > > > > > > > > > > >    - Andy
>> > > > > > > > > > > >
>> > > > > > > > > > > > Problems worthy of attack prove their worth by
>> hitting
>> > > > back.
>> > > > > -
>> > > > > > > Piet
>> > > > > > > > > > Hein
>> > > > > > > > > > > > (via Tom White)
>> > > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Ted Yu <yu...@gmail.com>.
Searching for 'hbase.ResourceChecker(147): before' in
http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
showed that testAddVisibilityLabelsOnRSRestart was the first sub-test to be
run:

2014-09-01 08:41:12,266 INFO  [pool-1-thread-1]
hbase.ResourceChecker(147): before:
security.visibility.TestVisibilityLabelsWithDistributedLogReplay#testAddVisibilityLabelsOnRSRestart
Thread=295, OpenFileDescriptor=380, MaxFileDescriptor=65536,

What Ram described was different from the problem JMS reported - since
"ABC" and "XYZ" were not written to hbase:labels table, the test would
surely fail.

Cheers



On Mon, Sep 1, 2014 at 9:53 AM, ramkrishna vasudevan <
ramkrishna.s.vasudevan@gmail.com> wrote:

> To reproduce just ensured that
> in TestVisibilityLabelsWithDefaultVisLabelService the testAddLabels and
> then testVddAddVisibilityLabelsOnRSRestart runs.
> This ensures that the total no of labels is 17 and not 13.
>
> So may be when it runs in Jenkins the order of execution determines the way
> the labels are added or deleted.
> String[] labels = { SECRET, TOPSECRET, CONFIDENTIAL, PUBLIC, PRIVATE,
> COPYRIGHT,
>       ACCENT, UNICODE_VIS_TAG, UC1, UC2 };
> static String[] labels1 = { "L1", SECRET, "L2", "invalid~", "L3" };
>   static String[] labels2 = { SECRET, CONFIDENTIAL, PRIVATE, "ABC", "XYZ"
> };
>
> Count this excluding the repeated confidential, secret and private it gives
> 17.   So may be we can seperate the test cases?
>
> Regards
> Ram
>
>
> On Mon, Sep 1, 2014 at 9:55 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org
> > wrote:
>
> > Cool! Glad to see I'm not the only one ;)
> >
> > Since it passed on Jenkins does it mean we need to add some additional
> > tests?
> > Le 2014-09-01 12:20, "ramkrishna vasudevan" <
> > ramkrishna.s.vasudevan@gmail.com> a écrit :
> >
> > > Am able to reproduce this locally. Will try to come up with a patch.
> > >
> > >
> > > On Mon, Sep 1, 2014 at 9:43 PM, Jean-Marc Spaggiari <
> > > jean-marc@spaggiari.org
> > > > wrote:
> > >
> > > > So I guess that's why we don't see the log you have added? It loops
> and
> > > > timeout and never reach that point?
> > > >
> > > > What's next? Anything else I can run/do/test/check? I can even
> install
> > > > Jenkins on those 4 servers....
> > > >
> > > >
> > > > 2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > >
> > > > > The patch I sent to Jean-Marc added a loop when retrieving labels.
> > > > >
> > > > > Looking at
> > > > >
> > > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > , there was no log from DefaultVisibilityLabelServiceImpl w.r.t.
> > labels
> > > > ABC
> > > > > and XYZ.
> > > > >
> > > > > The timeout of test was due to these two labels not written to
> > > > hbase:labels
> > > > > table.
> > > > >
> > > > > Cheers
> > > > >
> > > > >
> > > > >
> > > > > On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
> > > > > jean-marc@spaggiari.org
> > > > > > wrote:
> > > > >
> > > > > > Ted sent me another patch to test.
> > > > > >
> > > > > > Everything is here:
> > > > > http://server.distparser.com:81/hbase/with_teds_patch/
> > > > > >
> > > > > > This specific test did not failed on hbasetest1
> > > > > >
> > > > > > Only this one failed on node8:
> > > > > > Tests in error:
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> > > > > > test timed out after 60000 milliseconds
> > > > > >
> > > > > > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
> > > > > >
> > > > > >
> > > > > > And many tests failed on node1 and t430s. But all
> > > > > > TestVisibilityLabelsWithDistributedLogReplay failed with timeout.
> > > > > >
> > > > > > Again, I have copied everything on the server so you look at
> > whatever
> > > > can
> > > > > > be interesting.
> > > > > >
> > > > > > <
> > > > > >
> > > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > >
> > > > > >
> > > > > > Feel free to send me anything you want me to test. Also, I can
> > share
> > > > all
> > > > > > required information, like CPU, etc. if that helps.
> > > > > >
> > > > > > JM
> > > > > >
> > > > > > 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
> > > > > >
> > > > > > > The addition of the 2 new labels would have failed (?)  May be
> we
> > > log
> > > > > the
> > > > > > > return value of this addition in test and see the trace?
> > > > > > >
> > > > > > > -Anoop-
> > > > > > >
> > > > > > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com>
> > > wrote:
> > > > > > >
> > > > > > > > In the output of successful test run, I saw:
> > > > > > > >
> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the
> > > label
> > > > > ABC
> > > > > > > >
> > > > > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the
> > > label
> > > > > XYZ
> > > > > > > >
> > > > > > > > From
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > > > , I don't see the above.
> > > > > > > >
> > > > > > > > The additional debug log confirmed that the two new labels
> were
> > > not
> > > > > > read
> > > > > > > > back.
> > > > > > > >
> > > > > > > > Cheers
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> > > > > > > >  jean-marc@spaggiari.org> wrote:
> > > > > > > >
> > > > > > > > > Here are the results.
> > > > > > > > >
> > > > > > > > > 4 builds, 4 computers, 4 failed.
> > > > > > > > >
> > > > > > > > > HTH
> > > > > > > > >
> > > > > > > > > http://server.distparser.com:81/hbase/
> > > > > > > > >
> > > > > > > > > Let me know if you want me to run anything else.
> > > > > > > > >
> > > > > > > > > JM
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > > > > > > >
> > > > > > > > > > Jean-Marc:
> > > > > > > > > > I couldn't reproduce the test failure - on Mac or Linux.
> > > > > > > > > >
> > > > > > > > > > Can you apply the following and run test again ?
> > > > > > > > > > http://pastebin.com/Z1czdBes
> > > > > > > > > >
> > > > > > > > > > It would reveal whether log replay didn't bring back the
> > > labels
> > > > > > > written
> > > > > > > > > > prior to RS restart, or the new labels were not written
> > > > > > successfully.
> > > > > > > > > >
> > > > > > > > > > Thanks
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > > > >
> > > > > > > > > > > I will see if I can build something where the logs are
> > > > > > > automatically
> > > > > > > > > > > uploaded so that will make easier to look at them.
> > > > > > > > > > >
> > > > > > > > > > > I just pushed the files related to this test.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > > > > > >
> > > > > > > > > > > HTH
> > > > > > > > > > >
> > > > > > > > > > > JM
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <
> > > > apurtell@apache.org
> > > > > >:
> > > > > > > > > > >
> > > > > > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari
> <
> > > > > > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > Here are the logs for
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > > > > > > > > >
> > > > > > > > > > > > > Let me know if you need any other file. This is the
> > > > > standard
> > > > > > > > output
> > > > > > > > > > > with
> > > > > > > > > > > > > -X.
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > I was looking for the
> > > > > > > > > > > >
> > > hbase-server/target/surefire-reports/<test-name>-output.txt
> > > > > > file,
> > > > > > > > but
> > > > > > > > > > > ​you
> > > > > > > > > > > > could run the test with -Dtest.output.tofile=false​
> and
> > > > > capture
> > > > > > > > > > standard
> > > > > > > > > > > > output too.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Best regards,
> > > > > > > > > > > >
> > > > > > > > > > > >    - Andy
> > > > > > > > > > > >
> > > > > > > > > > > > Problems worthy of attack prove their worth by
> hitting
> > > > back.
> > > > > -
> > > > > > > Piet
> > > > > > > > > > Hein
> > > > > > > > > > > > (via Tom White)
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by ramkrishna vasudevan <ra...@gmail.com>.
To reproduce just ensured that
in TestVisibilityLabelsWithDefaultVisLabelService the testAddLabels and
then testVddAddVisibilityLabelsOnRSRestart runs.
This ensures that the total no of labels is 17 and not 13.

So may be when it runs in Jenkins the order of execution determines the way
the labels are added or deleted.
String[] labels = { SECRET, TOPSECRET, CONFIDENTIAL, PUBLIC, PRIVATE,
COPYRIGHT,
      ACCENT, UNICODE_VIS_TAG, UC1, UC2 };
static String[] labels1 = { "L1", SECRET, "L2", "invalid~", "L3" };
  static String[] labels2 = { SECRET, CONFIDENTIAL, PRIVATE, "ABC", "XYZ" };

Count this excluding the repeated confidential, secret and private it gives
17.   So may be we can seperate the test cases?

Regards
Ram


On Mon, Sep 1, 2014 at 9:55 PM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:

> Cool! Glad to see I'm not the only one ;)
>
> Since it passed on Jenkins does it mean we need to add some additional
> tests?
> Le 2014-09-01 12:20, "ramkrishna vasudevan" <
> ramkrishna.s.vasudevan@gmail.com> a écrit :
>
> > Am able to reproduce this locally. Will try to come up with a patch.
> >
> >
> > On Mon, Sep 1, 2014 at 9:43 PM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org
> > > wrote:
> >
> > > So I guess that's why we don't see the log you have added? It loops and
> > > timeout and never reach that point?
> > >
> > > What's next? Anything else I can run/do/test/check? I can even install
> > > Jenkins on those 4 servers....
> > >
> > >
> > > 2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > >
> > > > The patch I sent to Jean-Marc added a loop when retrieving labels.
> > > >
> > > > Looking at
> > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > , there was no log from DefaultVisibilityLabelServiceImpl w.r.t.
> labels
> > > ABC
> > > > and XYZ.
> > > >
> > > > The timeout of test was due to these two labels not written to
> > > hbase:labels
> > > > table.
> > > >
> > > > Cheers
> > > >
> > > >
> > > >
> > > > On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
> > > > jean-marc@spaggiari.org
> > > > > wrote:
> > > >
> > > > > Ted sent me another patch to test.
> > > > >
> > > > > Everything is here:
> > > > http://server.distparser.com:81/hbase/with_teds_patch/
> > > > >
> > > > > This specific test did not failed on hbasetest1
> > > > >
> > > > > Only this one failed on node8:
> > > > > Tests in error:
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> > > > > test timed out after 60000 milliseconds
> > > > >
> > > > > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
> > > > >
> > > > >
> > > > > And many tests failed on node1 and t430s. But all
> > > > > TestVisibilityLabelsWithDistributedLogReplay failed with timeout.
> > > > >
> > > > > Again, I have copied everything on the server so you look at
> whatever
> > > can
> > > > > be interesting.
> > > > >
> > > > > <
> > > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > >
> > > > >
> > > > > Feel free to send me anything you want me to test. Also, I can
> share
> > > all
> > > > > required information, like CPU, etc. if that helps.
> > > > >
> > > > > JM
> > > > >
> > > > > 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
> > > > >
> > > > > > The addition of the 2 new labels would have failed (?)  May be we
> > log
> > > > the
> > > > > > return value of this addition in test and see the trace?
> > > > > >
> > > > > > -Anoop-
> > > > > >
> > > > > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com>
> > wrote:
> > > > > >
> > > > > > > In the output of successful test run, I saw:
> > > > > > >
> > > > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the
> > label
> > > > ABC
> > > > > > >
> > > > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the
> > label
> > > > XYZ
> > > > > > >
> > > > > > > From
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > > , I don't see the above.
> > > > > > >
> > > > > > > The additional debug log confirmed that the two new labels were
> > not
> > > > > read
> > > > > > > back.
> > > > > > >
> > > > > > > Cheers
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> > > > > > >  jean-marc@spaggiari.org> wrote:
> > > > > > >
> > > > > > > > Here are the results.
> > > > > > > >
> > > > > > > > 4 builds, 4 computers, 4 failed.
> > > > > > > >
> > > > > > > > HTH
> > > > > > > >
> > > > > > > > http://server.distparser.com:81/hbase/
> > > > > > > >
> > > > > > > > Let me know if you want me to run anything else.
> > > > > > > >
> > > > > > > > JM
> > > > > > > >
> > > > > > > >
> > > > > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > > > > > >
> > > > > > > > > Jean-Marc:
> > > > > > > > > I couldn't reproduce the test failure - on Mac or Linux.
> > > > > > > > >
> > > > > > > > > Can you apply the following and run test again ?
> > > > > > > > > http://pastebin.com/Z1czdBes
> > > > > > > > >
> > > > > > > > > It would reveal whether log replay didn't bring back the
> > labels
> > > > > > written
> > > > > > > > > prior to RS restart, or the new labels were not written
> > > > > successfully.
> > > > > > > > >
> > > > > > > > > Thanks
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > > >
> > > > > > > > > > I will see if I can build something where the logs are
> > > > > > automatically
> > > > > > > > > > uploaded so that will make easier to look at them.
> > > > > > > > > >
> > > > > > > > > > I just pushed the files related to this test.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > > > > >
> > > > > > > > > > HTH
> > > > > > > > > >
> > > > > > > > > > JM
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <
> > > apurtell@apache.org
> > > > >:
> > > > > > > > > >
> > > > > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Here are the logs for
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > > > > > > > >
> > > > > > > > > > > > Let me know if you need any other file. This is the
> > > > standard
> > > > > > > output
> > > > > > > > > > with
> > > > > > > > > > > > -X.
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > I was looking for the
> > > > > > > > > > >
> > hbase-server/target/surefire-reports/<test-name>-output.txt
> > > > > file,
> > > > > > > but
> > > > > > > > > > ​you
> > > > > > > > > > > could run the test with -Dtest.output.tofile=false​ and
> > > > capture
> > > > > > > > > standard
> > > > > > > > > > > output too.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Best regards,
> > > > > > > > > > >
> > > > > > > > > > >    - Andy
> > > > > > > > > > >
> > > > > > > > > > > Problems worthy of attack prove their worth by hitting
> > > back.
> > > > -
> > > > > > Piet
> > > > > > > > > Hein
> > > > > > > > > > > (via Tom White)
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Cool! Glad to see I'm not the only one ;)

Since it passed on Jenkins does it mean we need to add some additional
tests?
Le 2014-09-01 12:20, "ramkrishna vasudevan" <
ramkrishna.s.vasudevan@gmail.com> a écrit :

> Am able to reproduce this locally. Will try to come up with a patch.
>
>
> On Mon, Sep 1, 2014 at 9:43 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org
> > wrote:
>
> > So I guess that's why we don't see the log you have added? It loops and
> > timeout and never reach that point?
> >
> > What's next? Anything else I can run/do/test/check? I can even install
> > Jenkins on those 4 servers....
> >
> >
> > 2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:
> >
> > > The patch I sent to Jean-Marc added a loop when retrieving labels.
> > >
> > > Looking at
> > >
> > >
> >
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > , there was no log from DefaultVisibilityLabelServiceImpl w.r.t. labels
> > ABC
> > > and XYZ.
> > >
> > > The timeout of test was due to these two labels not written to
> > hbase:labels
> > > table.
> > >
> > > Cheers
> > >
> > >
> > >
> > > On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
> > > jean-marc@spaggiari.org
> > > > wrote:
> > >
> > > > Ted sent me another patch to test.
> > > >
> > > > Everything is here:
> > > http://server.distparser.com:81/hbase/with_teds_patch/
> > > >
> > > > This specific test did not failed on hbasetest1
> > > >
> > > > Only this one failed on node8:
> > > > Tests in error:
> > > >
> > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> > > > test timed out after 60000 milliseconds
> > > >
> > > > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
> > > >
> > > >
> > > > And many tests failed on node1 and t430s. But all
> > > > TestVisibilityLabelsWithDistributedLogReplay failed with timeout.
> > > >
> > > > Again, I have copied everything on the server so you look at whatever
> > can
> > > > be interesting.
> > > >
> > > > <
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > >
> > > >
> > > > Feel free to send me anything you want me to test. Also, I can share
> > all
> > > > required information, like CPU, etc. if that helps.
> > > >
> > > > JM
> > > >
> > > > 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
> > > >
> > > > > The addition of the 2 new labels would have failed (?)  May be we
> log
> > > the
> > > > > return value of this addition in test and see the trace?
> > > > >
> > > > > -Anoop-
> > > > >
> > > > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com>
> wrote:
> > > > >
> > > > > > In the output of successful test run, I saw:
> > > > > >
> > > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the
> label
> > > ABC
> > > > > >
> > > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the
> label
> > > XYZ
> > > > > >
> > > > > > From
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > , I don't see the above.
> > > > > >
> > > > > > The additional debug log confirmed that the two new labels were
> not
> > > > read
> > > > > > back.
> > > > > >
> > > > > > Cheers
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> > > > > >  jean-marc@spaggiari.org> wrote:
> > > > > >
> > > > > > > Here are the results.
> > > > > > >
> > > > > > > 4 builds, 4 computers, 4 failed.
> > > > > > >
> > > > > > > HTH
> > > > > > >
> > > > > > > http://server.distparser.com:81/hbase/
> > > > > > >
> > > > > > > Let me know if you want me to run anything else.
> > > > > > >
> > > > > > > JM
> > > > > > >
> > > > > > >
> > > > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > > > > >
> > > > > > > > Jean-Marc:
> > > > > > > > I couldn't reproduce the test failure - on Mac or Linux.
> > > > > > > >
> > > > > > > > Can you apply the following and run test again ?
> > > > > > > > http://pastebin.com/Z1czdBes
> > > > > > > >
> > > > > > > > It would reveal whether log replay didn't bring back the
> labels
> > > > > written
> > > > > > > > prior to RS restart, or the new labels were not written
> > > > successfully.
> > > > > > > >
> > > > > > > > Thanks
> > > > > > > >
> > > > > > > >
> > > > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > >
> > > > > > > > > I will see if I can build something where the logs are
> > > > > automatically
> > > > > > > > > uploaded so that will make easier to look at them.
> > > > > > > > >
> > > > > > > > > I just pushed the files related to this test.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > > > >
> > > > > > > > > HTH
> > > > > > > > >
> > > > > > > > > JM
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <
> > apurtell@apache.org
> > > >:
> > > > > > > > >
> > > > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > > > >
> > > > > > > > > > > Here are the logs for
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > > > > > > >
> > > > > > > > > > > Let me know if you need any other file. This is the
> > > standard
> > > > > > output
> > > > > > > > > with
> > > > > > > > > > > -X.
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > I was looking for the
> > > > > > > > > >
> hbase-server/target/surefire-reports/<test-name>-output.txt
> > > > file,
> > > > > > but
> > > > > > > > > ​you
> > > > > > > > > > could run the test with -Dtest.output.tofile=false​ and
> > > capture
> > > > > > > > standard
> > > > > > > > > > output too.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Best regards,
> > > > > > > > > >
> > > > > > > > > >    - Andy
> > > > > > > > > >
> > > > > > > > > > Problems worthy of attack prove their worth by hitting
> > back.
> > > -
> > > > > Piet
> > > > > > > > Hein
> > > > > > > > > > (via Tom White)
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by ramkrishna vasudevan <ra...@gmail.com>.
Am able to reproduce this locally. Will try to come up with a patch.


On Mon, Sep 1, 2014 at 9:43 PM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:

> So I guess that's why we don't see the log you have added? It loops and
> timeout and never reach that point?
>
> What's next? Anything else I can run/do/test/check? I can even install
> Jenkins on those 4 servers....
>
>
> 2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:
>
> > The patch I sent to Jean-Marc added a loop when retrieving labels.
> >
> > Looking at
> >
> >
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > , there was no log from DefaultVisibilityLabelServiceImpl w.r.t. labels
> ABC
> > and XYZ.
> >
> > The timeout of test was due to these two labels not written to
> hbase:labels
> > table.
> >
> > Cheers
> >
> >
> >
> > On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org
> > > wrote:
> >
> > > Ted sent me another patch to test.
> > >
> > > Everything is here:
> > http://server.distparser.com:81/hbase/with_teds_patch/
> > >
> > > This specific test did not failed on hbasetest1
> > >
> > > Only this one failed on node8:
> > > Tests in error:
> > >
> > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> > > test timed out after 60000 milliseconds
> > >
> > > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
> > >
> > >
> > > And many tests failed on node1 and t430s. But all
> > > TestVisibilityLabelsWithDistributedLogReplay failed with timeout.
> > >
> > > Again, I have copied everything on the server so you look at whatever
> can
> > > be interesting.
> > >
> > > <
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > >
> > >
> > > Feel free to send me anything you want me to test. Also, I can share
> all
> > > required information, like CPU, etc. if that helps.
> > >
> > > JM
> > >
> > > 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
> > >
> > > > The addition of the 2 new labels would have failed (?)  May be we log
> > the
> > > > return value of this addition in test and see the trace?
> > > >
> > > > -Anoop-
> > > >
> > > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com> wrote:
> > > >
> > > > > In the output of successful test run, I saw:
> > > > >
> > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label
> > ABC
> > > > >
> > > > > 2014-08-30 11:24:12,139 DEBUG
> > > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label
> > XYZ
> > > > >
> > > > > From
> > > > >
> > > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > , I don't see the above.
> > > > >
> > > > > The additional debug log confirmed that the two new labels were not
> > > read
> > > > > back.
> > > > >
> > > > > Cheers
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> > > > >  jean-marc@spaggiari.org> wrote:
> > > > >
> > > > > > Here are the results.
> > > > > >
> > > > > > 4 builds, 4 computers, 4 failed.
> > > > > >
> > > > > > HTH
> > > > > >
> > > > > > http://server.distparser.com:81/hbase/
> > > > > >
> > > > > > Let me know if you want me to run anything else.
> > > > > >
> > > > > > JM
> > > > > >
> > > > > >
> > > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > > > >
> > > > > > > Jean-Marc:
> > > > > > > I couldn't reproduce the test failure - on Mac or Linux.
> > > > > > >
> > > > > > > Can you apply the following and run test again ?
> > > > > > > http://pastebin.com/Z1czdBes
> > > > > > >
> > > > > > > It would reveal whether log replay didn't bring back the labels
> > > > written
> > > > > > > prior to RS restart, or the new labels were not written
> > > successfully.
> > > > > > >
> > > > > > > Thanks
> > > > > > >
> > > > > > >
> > > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > >
> > > > > > > > I will see if I can build something where the logs are
> > > > automatically
> > > > > > > > uploaded so that will make easier to look at them.
> > > > > > > >
> > > > > > > > I just pushed the files related to this test.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > > >
> > > > > > > > HTH
> > > > > > > >
> > > > > > > > JM
> > > > > > > >
> > > > > > > >
> > > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <
> apurtell@apache.org
> > >:
> > > > > > > >
> > > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > > >
> > > > > > > > > > Here are the logs for
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > > > > > >
> > > > > > > > > > Let me know if you need any other file. This is the
> > standard
> > > > > output
> > > > > > > > with
> > > > > > > > > > -X.
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > I was looking for the
> > > > > > > > > hbase-server/target/surefire-reports/<test-name>-output.txt
> > > file,
> > > > > but
> > > > > > > > ​you
> > > > > > > > > could run the test with -Dtest.output.tofile=false​ and
> > capture
> > > > > > > standard
> > > > > > > > > output too.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Best regards,
> > > > > > > > >
> > > > > > > > >    - Andy
> > > > > > > > >
> > > > > > > > > Problems worthy of attack prove their worth by hitting
> back.
> > -
> > > > Piet
> > > > > > > Hein
> > > > > > > > > (via Tom White)
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
So I guess that's why we don't see the log you have added? It loops and
timeout and never reach that point?

What's next? Anything else I can run/do/test/check? I can even install
Jenkins on those 4 servers....


2014-09-01 11:59 GMT-04:00 Ted Yu <yu...@gmail.com>:

> The patch I sent to Jean-Marc added a loop when retrieving labels.
>
> Looking at
>
> http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> , there was no log from DefaultVisibilityLabelServiceImpl w.r.t. labels ABC
> and XYZ.
>
> The timeout of test was due to these two labels not written to hbase:labels
> table.
>
> Cheers
>
>
>
> On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org
> > wrote:
>
> > Ted sent me another patch to test.
> >
> > Everything is here:
> http://server.distparser.com:81/hbase/with_teds_patch/
> >
> > This specific test did not failed on hbasetest1
> >
> > Only this one failed on node8:
> > Tests in error:
> >
> >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> > test timed out after 60000 milliseconds
> >
> > Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
> >
> >
> > And many tests failed on node1 and t430s. But all
> > TestVisibilityLabelsWithDistributedLogReplay failed with timeout.
> >
> > Again, I have copied everything on the server so you look at whatever can
> > be interesting.
> >
> > <
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > >
> >
> > Feel free to send me anything you want me to test. Also, I can share all
> > required information, like CPU, etc. if that helps.
> >
> > JM
> >
> > 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
> >
> > > The addition of the 2 new labels would have failed (?)  May be we log
> the
> > > return value of this addition in test and see the trace?
> > >
> > > -Anoop-
> > >
> > > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > In the output of successful test run, I saw:
> > > >
> > > > 2014-08-30 11:24:12,139 DEBUG
> > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label
> ABC
> > > >
> > > > 2014-08-30 11:24:12,139 DEBUG
> > > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label
> XYZ
> > > >
> > > > From
> > > >
> > > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > , I don't see the above.
> > > >
> > > > The additional debug log confirmed that the two new labels were not
> > read
> > > > back.
> > > >
> > > > Cheers
> > > >
> > > >
> > > >
> > > >
> > > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> > > >  jean-marc@spaggiari.org> wrote:
> > > >
> > > > > Here are the results.
> > > > >
> > > > > 4 builds, 4 computers, 4 failed.
> > > > >
> > > > > HTH
> > > > >
> > > > > http://server.distparser.com:81/hbase/
> > > > >
> > > > > Let me know if you want me to run anything else.
> > > > >
> > > > > JM
> > > > >
> > > > >
> > > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > > >
> > > > > > Jean-Marc:
> > > > > > I couldn't reproduce the test failure - on Mac or Linux.
> > > > > >
> > > > > > Can you apply the following and run test again ?
> > > > > > http://pastebin.com/Z1czdBes
> > > > > >
> > > > > > It would reveal whether log replay didn't bring back the labels
> > > written
> > > > > > prior to RS restart, or the new labels were not written
> > successfully.
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > >
> > > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > > > > jean-marc@spaggiari.org> wrote:
> > > > > >
> > > > > > > I will see if I can build something where the logs are
> > > automatically
> > > > > > > uploaded so that will make easier to look at them.
> > > > > > >
> > > > > > > I just pushed the files related to this test.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > > >
> > > > > > > HTH
> > > > > > >
> > > > > > > JM
> > > > > > >
> > > > > > >
> > > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <apurtell@apache.org
> >:
> > > > > > >
> > > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > > >
> > > > > > > > > Here are the logs for
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > > > > >
> > > > > > > > > Let me know if you need any other file. This is the
> standard
> > > > output
> > > > > > > with
> > > > > > > > > -X.
> > > > > > > > >
> > > > > > > >
> > > > > > > > I was looking for the
> > > > > > > > hbase-server/target/surefire-reports/<test-name>-output.txt
> > file,
> > > > but
> > > > > > > ​you
> > > > > > > > could run the test with -Dtest.output.tofile=false​ and
> capture
> > > > > > standard
> > > > > > > > output too.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best regards,
> > > > > > > >
> > > > > > > >    - Andy
> > > > > > > >
> > > > > > > > Problems worthy of attack prove their worth by hitting back.
> -
> > > Piet
> > > > > > Hein
> > > > > > > > (via Tom White)
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Ted Yu <yu...@gmail.com>.
The patch I sent to Jean-Marc added a loop when retrieving labels.

Looking at
http://server.distparser.com:81/hbase/with_teds_patch/node8/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
, there was no log from DefaultVisibilityLabelServiceImpl w.r.t. labels ABC
and XYZ.

The timeout of test was due to these two labels not written to hbase:labels
table.

Cheers



On Mon, Sep 1, 2014 at 8:26 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:

> Ted sent me another patch to test.
>
> Everything is here: http://server.distparser.com:81/hbase/with_teds_patch/
>
> This specific test did not failed on hbasetest1
>
> Only this one failed on node8:
> Tests in error:
>
>
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
> test timed out after 60000 milliseconds
>
> Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8
>
>
> And many tests failed on node1 and t430s. But all
> TestVisibilityLabelsWithDistributedLogReplay failed with timeout.
>
> Again, I have copied everything on the server so you look at whatever can
> be interesting.
>
> <
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> >
>
> Feel free to send me anything you want me to test. Also, I can share all
> required information, like CPU, etc. if that helps.
>
> JM
>
> 2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:
>
> > The addition of the 2 new labels would have failed (?)  May be we log the
> > return value of this addition in test and see the trace?
> >
> > -Anoop-
> >
> > On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > In the output of successful test run, I saw:
> > >
> > > 2014-08-30 11:24:12,139 DEBUG
> > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label ABC
> > >
> > > 2014-08-30 11:24:12,139 DEBUG
> > > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label XYZ
> > >
> > > From
> > >
> > >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > , I don't see the above.
> > >
> > > The additional debug log confirmed that the two new labels were not
> read
> > > back.
> > >
> > > Cheers
> > >
> > >
> > >
> > >
> > > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> > >  jean-marc@spaggiari.org> wrote:
> > >
> > > > Here are the results.
> > > >
> > > > 4 builds, 4 computers, 4 failed.
> > > >
> > > > HTH
> > > >
> > > > http://server.distparser.com:81/hbase/
> > > >
> > > > Let me know if you want me to run anything else.
> > > >
> > > > JM
> > > >
> > > >
> > > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > > >
> > > > > Jean-Marc:
> > > > > I couldn't reproduce the test failure - on Mac or Linux.
> > > > >
> > > > > Can you apply the following and run test again ?
> > > > > http://pastebin.com/Z1czdBes
> > > > >
> > > > > It would reveal whether log replay didn't bring back the labels
> > written
> > > > > prior to RS restart, or the new labels were not written
> successfully.
> > > > >
> > > > > Thanks
> > > > >
> > > > >
> > > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > > > jean-marc@spaggiari.org> wrote:
> > > > >
> > > > > > I will see if I can build something where the logs are
> > automatically
> > > > > > uploaded so that will make easier to look at them.
> > > > > >
> > > > > > I just pushed the files related to this test.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > > >
> > > > > > HTH
> > > > > >
> > > > > > JM
> > > > > >
> > > > > >
> > > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> > > > > >
> > > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > > > > jean-marc@spaggiari.org> wrote:
> > > > > > >
> > > > > > > > Here are the logs for
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > > > >
> > > > > > > > Let me know if you need any other file. This is the standard
> > > output
> > > > > > with
> > > > > > > > -X.
> > > > > > > >
> > > > > > >
> > > > > > > I was looking for the
> > > > > > > hbase-server/target/surefire-reports/<test-name>-output.txt
> file,
> > > but
> > > > > > ​you
> > > > > > > could run the test with -Dtest.output.tofile=false​ and capture
> > > > > standard
> > > > > > > output too.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Best regards,
> > > > > > >
> > > > > > >    - Andy
> > > > > > >
> > > > > > > Problems worthy of attack prove their worth by hitting back. -
> > Piet
> > > > > Hein
> > > > > > > (via Tom White)
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Ted sent me another patch to test.

Everything is here: http://server.distparser.com:81/hbase/with_teds_patch/

This specific test did not failed on hbasetest1

Only this one failed on node8:
Tests in error:

testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay):
test timed out after 60000 milliseconds

Tests run: 1284, Failures: 0, Errors: 1, Skipped: 8


And many tests failed on node1 and t430s. But all
TestVisibilityLabelsWithDistributedLogReplay failed with timeout.

Again, I have copied everything on the server so you look at whatever can
be interesting.

<http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt>

Feel free to send me anything you want me to test. Also, I can share all
required information, like CPU, etc. if that helps.

JM

2014-09-01 0:06 GMT-04:00 Anoop John <an...@gmail.com>:

> The addition of the 2 new labels would have failed (?)  May be we log the
> return value of this addition in test and see the trace?
>
> -Anoop-
>
> On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > In the output of successful test run, I saw:
> >
> > 2014-08-30 11:24:12,139 DEBUG
> > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label ABC
> >
> > 2014-08-30 11:24:12,139 DEBUG
> > [B.defaultRpcServer.handler=1,queue=0,port=56716]
> > visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label XYZ
> >
> > From
> >
> >
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > , I don't see the above.
> >
> > The additional debug log confirmed that the two new labels were not read
> > back.
> >
> > Cheers
> >
> >
> >
> >
> > On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
> >  jean-marc@spaggiari.org> wrote:
> >
> > > Here are the results.
> > >
> > > 4 builds, 4 computers, 4 failed.
> > >
> > > HTH
> > >
> > > http://server.distparser.com:81/hbase/
> > >
> > > Let me know if you want me to run anything else.
> > >
> > > JM
> > >
> > >
> > > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> > >
> > > > Jean-Marc:
> > > > I couldn't reproduce the test failure - on Mac or Linux.
> > > >
> > > > Can you apply the following and run test again ?
> > > > http://pastebin.com/Z1czdBes
> > > >
> > > > It would reveal whether log replay didn't bring back the labels
> written
> > > > prior to RS restart, or the new labels were not written successfully.
> > > >
> > > > Thanks
> > > >
> > > >
> > > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > > jean-marc@spaggiari.org> wrote:
> > > >
> > > > > I will see if I can build something where the logs are
> automatically
> > > > > uploaded so that will make easier to look at them.
> > > > >
> > > > > I just pushed the files related to this test.
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > > >
> > > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > > >
> > > > > HTH
> > > > >
> > > > > JM
> > > > >
> > > > >
> > > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> > > > >
> > > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > > > jean-marc@spaggiari.org> wrote:
> > > > > >
> > > > > > > Here are the logs for
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > > >
> > > > > > > Let me know if you need any other file. This is the standard
> > output
> > > > > with
> > > > > > > -X.
> > > > > > >
> > > > > >
> > > > > > I was looking for the
> > > > > > hbase-server/target/surefire-reports/<test-name>-output.txt file,
> > but
> > > > > ​you
> > > > > > could run the test with -Dtest.output.tofile=false​ and capture
> > > > standard
> > > > > > output too.
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > >
> > > > > >    - Andy
> > > > > >
> > > > > > Problems worthy of attack prove their worth by hitting back. -
> Piet
> > > > Hein
> > > > > > (via Tom White)
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Anoop John <an...@gmail.com>.
The addition of the 2 new labels would have failed (?)  May be we log the
return value of this addition in test and see the trace?

-Anoop-

On Mon, Sep 1, 2014 at 5:59 AM, Ted Yu <yu...@gmail.com> wrote:

> In the output of successful test run, I saw:
>
> 2014-08-30 11:24:12,139 DEBUG
> [B.defaultRpcServer.handler=1,queue=0,port=56716]
> visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label ABC
>
> 2014-08-30 11:24:12,139 DEBUG
> [B.defaultRpcServer.handler=1,queue=0,port=56716]
> visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label XYZ
>
> From
>
> http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> , I don't see the above.
>
> The additional debug log confirmed that the two new labels were not read
> back.
>
> Cheers
>
>
>
>
> On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
>  jean-marc@spaggiari.org> wrote:
>
> > Here are the results.
> >
> > 4 builds, 4 computers, 4 failed.
> >
> > HTH
> >
> > http://server.distparser.com:81/hbase/
> >
> > Let me know if you want me to run anything else.
> >
> > JM
> >
> >
> > 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
> >
> > > Jean-Marc:
> > > I couldn't reproduce the test failure - on Mac or Linux.
> > >
> > > Can you apply the following and run test again ?
> > > http://pastebin.com/Z1czdBes
> > >
> > > It would reveal whether log replay didn't bring back the labels written
> > > prior to RS restart, or the new labels were not written successfully.
> > >
> > > Thanks
> > >
> > >
> > > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > > jean-marc@spaggiari.org> wrote:
> > >
> > > > I will see if I can build something where the logs are automatically
> > > > uploaded so that will make easier to look at them.
> > > >
> > > > I just pushed the files related to this test.
> > > >
> > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > > >
> > > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > > >
> > > > HTH
> > > >
> > > > JM
> > > >
> > > >
> > > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> > > >
> > > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > > jean-marc@spaggiari.org> wrote:
> > > > >
> > > > > > Here are the logs for
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > > >
> > > > > > Let me know if you need any other file. This is the standard
> output
> > > > with
> > > > > > -X.
> > > > > >
> > > > >
> > > > > I was looking for the
> > > > > hbase-server/target/surefire-reports/<test-name>-output.txt file,
> but
> > > > ​you
> > > > > could run the test with -Dtest.output.tofile=false​ and capture
> > > standard
> > > > > output too.
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best regards,
> > > > >
> > > > >    - Andy
> > > > >
> > > > > Problems worthy of attack prove their worth by hitting back. - Piet
> > > Hein
> > > > > (via Tom White)
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Ted Yu <yu...@gmail.com>.
In the output of successful test run, I saw:

2014-08-30 11:24:12,139 DEBUG
[B.defaultRpcServer.handler=1,queue=0,port=56716]
visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label ABC

2014-08-30 11:24:12,139 DEBUG
[B.defaultRpcServer.handler=1,queue=0,port=56716]
visibility.DefaultVisibilityLabelServiceImpl(252): Adding the label XYZ

From
http://server.distparser.com:81/hbase/node1/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
, I don't see the above.

The additional debug log confirmed that the two new labels were not read
back.

Cheers




On Sun, Aug 31, 2014 at 3:36 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Here are the results.
>
> 4 builds, 4 computers, 4 failed.
>
> HTH
>
> http://server.distparser.com:81/hbase/
>
> Let me know if you want me to run anything else.
>
> JM
>
>
> 2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:
>
> > Jean-Marc:
> > I couldn't reproduce the test failure - on Mac or Linux.
> >
> > Can you apply the following and run test again ?
> > http://pastebin.com/Z1czdBes
> >
> > It would reveal whether log replay didn't bring back the labels written
> > prior to RS restart, or the new labels were not written successfully.
> >
> > Thanks
> >
> >
> > On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > I will see if I can build something where the logs are automatically
> > > uploaded so that will make easier to look at them.
> > >
> > > I just pushed the files related to this test.
> > >
> > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> > >
> > >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> > >
> > > HTH
> > >
> > > JM
> > >
> > >
> > > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> > >
> > > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > > jean-marc@spaggiari.org> wrote:
> > > >
> > > > > Here are the logs for
> > > > >
> > > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > > >
> > > > > Let me know if you need any other file. This is the standard output
> > > with
> > > > > -X.
> > > > >
> > > >
> > > > I was looking for the
> > > > hbase-server/target/surefire-reports/<test-name>-output.txt file, but
> > > ​you
> > > > could run the test with -Dtest.output.tofile=false​ and capture
> > standard
> > > > output too.
> > > >
> > > >
> > > >
> > > > --
> > > > Best regards,
> > > >
> > > >    - Andy
> > > >
> > > > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein
> > > > (via Tom White)
> > > >
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Here are the results.

4 builds, 4 computers, 4 failed.

HTH

http://server.distparser.com:81/hbase/

Let me know if you want me to run anything else.

JM


2014-08-30 14:29 GMT-04:00 Ted Yu <yu...@gmail.com>:

> Jean-Marc:
> I couldn't reproduce the test failure - on Mac or Linux.
>
> Can you apply the following and run test again ?
> http://pastebin.com/Z1czdBes
>
> It would reveal whether log replay didn't bring back the labels written
> prior to RS restart, or the new labels were not written successfully.
>
> Thanks
>
>
> On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > I will see if I can build something where the logs are automatically
> > uploaded so that will make easier to look at them.
> >
> > I just pushed the files related to this test.
> >
> >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
> >
> >
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
> >
> > HTH
> >
> > JM
> >
> >
> > 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> >
> > > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > > jean-marc@spaggiari.org> wrote:
> > >
> > > > Here are the logs for
> > > >
> > > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > > >
> > > > Let me know if you need any other file. This is the standard output
> > with
> > > > -X.
> > > >
> > >
> > > I was looking for the
> > > hbase-server/target/surefire-reports/<test-name>-output.txt file, but
> > ​you
> > > could run the test with -Dtest.output.tofile=false​ and capture
> standard
> > > output too.
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > >    - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Ted Yu <yu...@gmail.com>.
Jean-Marc:
I couldn't reproduce the test failure - on Mac or Linux.

Can you apply the following and run test again ?
http://pastebin.com/Z1czdBes

It would reveal whether log replay didn't bring back the labels written
prior to RS restart, or the new labels were not written successfully.

Thanks


On Fri, Aug 29, 2014 at 6:08 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> I will see if I can build something where the logs are automatically
> uploaded so that will make easier to look at them.
>
> I just pushed the files related to this test.
>
>
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
>
> http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt
>
> HTH
>
> JM
>
>
> 2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:
>
> > On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > Here are the logs for
> > >
> > >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > > : http://www.spaggiari.org/hbase-0.98.6.logs
> > >
> > > Let me know if you need any other file. This is the standard output
> with
> > > -X.
> > >
> >
> > I was looking for the
> > hbase-server/target/surefire-reports/<test-name>-output.txt file, but
> ​you
> > could run the test with -Dtest.output.tofile=false​ and capture standard
> > output too.
> >
> >
> >
> > --
> > Best regards,
> >
> >    - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
I will see if I can build something where the logs are automatically
uploaded so that will make easier to look at them.

I just pushed the files related to this test.

http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay.txt
http://www.spaggiari.org/org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay-output.txt

HTH

JM


2014-08-29 20:05 GMT-04:00 Andrew Purtell <ap...@apache.org>:

> On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Here are the logs for
> >
> >
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> > : http://www.spaggiari.org/hbase-0.98.6.logs
> >
> > Let me know if you need any other file. This is the standard output with
> > -X.
> >
>
> I was looking for the
> hbase-server/target/surefire-reports/<test-name>-output.txt file, but ​you
> could run the test with -Dtest.output.tofile=false​ and capture standard
> output too.
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Andrew Purtell <ap...@apache.org>.
On Fri, Aug 29, 2014 at 5:01 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Here are the logs for
>
> testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
> : http://www.spaggiari.org/hbase-0.98.6.logs
>
> Let me know if you need any other file. This is the standard output with
> -X.
>

I was looking for the
hbase-server/target/surefire-reports/<test-name>-output.txt file, but ​you
could run the test with -Dtest.output.tofile=false​ and capture standard
output too.



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Not sure to get why I have hadoop related issues. Hadoop is running on some
of the nodes where I run those tests, but on one of them it's not and I get
the same error...

I will shut hadoop down on all nodes and retry...

Here are the logs for
testAddVisibilityLabelsOnRSRestart(org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDistributedLogReplay)
: http://www.spaggiari.org/hbase-0.98.6.logs

Let me know if you need any other file. This is the standard output with -X.

JM


2014-08-29 19:01 GMT-04:00 Andrew Purtell <ap...@apache.org>:

> You may have Hadoop related setup issues, given the tests are failing as
> errors and these are all mapreduce minicluster test failures. The mapreduce
> tests have been passing for me on various EC2 instances throughout the
> ​0.98​
> .6 dev cycle
> ​on
>  JDK 6
> ​, 7, and 8 (though I only tested on 8 once last week)
> . I also ran TestRowCounter and TestImportExport on my dev box right now
> with JDK 7 and they both passed.
> ​​If you can pastebin the full test output from one of the erroring
> mapreduce tests that might be helpful.
>
>
> Like Ted I think the TestVisibilityLabelsWithDistributedLogReplay failure
> is potentially interesting.
> ​ Could we look at the full test output of that?​
>
>
> On Fri, Aug 29, 2014 at 3:38 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Here you go: http://pastebin.com/LH8cPTkp
> >
> > Ran 12 times. 4 different hosts, with JDK6 to 8.
> >
> > All 8 failed the same way. Passed only once with JDK7.
> >
> > I will try with -X to find the details but will focus on JDK7 on a single
> > host for now.
> >
> > JM
> >
> >
> > 2014-08-28 20:10 GMT-04:00 Jean-Marc Spaggiari <jean-marc@spaggiari.org
> >:
> >
> > > I will re-spin on the 3 servers tonight, using the command you gave,
> and
> > > report here. 0.94.23 passed on them.
> > > Le 2014-08-28 19:50, "Andrew Purtell" <ap...@apache.org> a écrit :
> > >
> > > On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> > >> jean-marc@spaggiari.org> wrote:
> > >>
> > >> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and
> > it
> > >> > failed with all. Did I missed something? Is there a new command line
> > to
> > >> > start the tests?
> > >> >
> > >>
> > >> That's worrying
> > >>
> > >> 'mvn test' didn't work for you?
> > >>
> > >> Typically to get a clean result I do 'git checkout -f 0.98 && git
> clean
> > >> -df
> > >>  && mvn -DskipTests clean install && mvn test'
> > >>
> > >>
> > >>
> > >> On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> > >> jean-marc@spaggiari.org> wrote:
> > >>
> > >> > somewhere it's a good news for me ;) Will give more time.
> > >> >
> > >> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and
> > it
> > >> > failed with all. Did I missed something? Is there a new command line
> > to
> > >> > start the tests?
> > >> >
> > >> >
> > >> > 2014-08-28 19:04 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> > >> >
> > >> > > -1
> > >> > >
> > >> > > See HBASE-11857. We should not release something known to not be
> > >> > compatible
> > >> > > with Phoenix. I made that a blocker for 0.98.6.
> > >> > >
> > >> > >
> > >> > > On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <
> > apurtell@apache.org>
> > >> > > wrote:
> > >> > >
> > >> > > > The 1st HBase 0.98.
> > >> > > > ​6
> > >> > > >  release candidate (RC0) is available for download at
> > >> > > > http://people.apache.org/~apurtell/0.98.6RC0/ and Maven
> artifacts
> > >> are
> > >> > > > also available in the temporary repository
> > >> > > >
> > >> >
> > https://repository.apache.org/content/repositories/orgapachehbase-1032/
> > >> > > >
> > >> > > > Signed with my code signing key D5365CCD.
> > >> > > >
> > >> > > > The issues resolved in this release can be found here:
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
> > >> > > > ​
> > >> > > >
> > >> > > > This ​candidate contains a significant backported change,
> ZK-less
> > >> > region
> > >> > > > assignment (HBASE-11546), thanks to the heavy lifting of Virag
> > >> Kothari
> > >> > > (and
> > >> > > > original contributors Jimmy Xiang and Virag Kothari). The new
> code
> > >> will
> > >> > > not
> > >> > > > be active unless the configuration setting "
> > >> > > > hbase.assignment.usezk" is set to '
> > >> > > > ​false
> > >> > > > '.
> > >> > > > ​If possible please consider testing with this configuration
> > change
> > >> on
> > >> > a
> > >> > > > cluster and/or with the integration tests.​
> > >> > > >
> > >> > > > Please try out the candidate and vote +1/-1 by midnight Pacific
> > Time
> > >> > > > (00:00 -0800 GMT) on
> > >> > > > ​September 2
> > >> > > > on whether or not we should release this as 0.98.
> > >> > > > ​6
> > >> > > > . Three +1 votes from PMC will be required to release.
> > >> > > >
> > >> > > > --
> > >> > > > Best regards,
> > >> > > >
> > >> > > >    - Andy
> > >> > > >
> > >> > > > Problems worthy of attack prove their worth by hitting back. -
> > Piet
> > >> > Hein
> > >> > > > (via Tom White)
> > >> > > >
> > >> > >
> > >> > >
> > >> > >
> > >> > > --
> > >> > > Best regards,
> > >> > >
> > >> > >    - Andy
> > >> > >
> > >> > > Problems worthy of attack prove their worth by hitting back. -
> Piet
> > >> Hein
> > >> > > (via Tom White)
> > >> > >
> > >> >
> > >>
> > >>
> > >>
> > >> --
> > >> Best regards,
> > >>
> > >>    - Andy
> > >>
> > >> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > >> (via Tom White)
> > >>
> > >
> >
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Andrew Purtell <ap...@apache.org>.
You may have Hadoop related setup issues, given the tests are failing as
errors and these are all mapreduce minicluster test failures. The mapreduce
tests have been passing for me on various EC2 instances throughout the
​0.98​
.6 dev cycle
​on
 JDK 6
​, 7, and 8 (though I only tested on 8 once last week)
. I also ran TestRowCounter and TestImportExport on my dev box right now
with JDK 7 and they both passed.
​​If you can pastebin the full test output from one of the erroring
mapreduce tests that might be helpful.


Like Ted I think the TestVisibilityLabelsWithDistributedLogReplay failure
is potentially interesting.
​ Could we look at the full test output of that?​


On Fri, Aug 29, 2014 at 3:38 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Here you go: http://pastebin.com/LH8cPTkp
>
> Ran 12 times. 4 different hosts, with JDK6 to 8.
>
> All 8 failed the same way. Passed only once with JDK7.
>
> I will try with -X to find the details but will focus on JDK7 on a single
> host for now.
>
> JM
>
>
> 2014-08-28 20:10 GMT-04:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
>
> > I will re-spin on the 3 servers tonight, using the command you gave, and
> > report here. 0.94.23 passed on them.
> > Le 2014-08-28 19:50, "Andrew Purtell" <ap...@apache.org> a écrit :
> >
> > On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> >> jean-marc@spaggiari.org> wrote:
> >>
> >> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and
> it
> >> > failed with all. Did I missed something? Is there a new command line
> to
> >> > start the tests?
> >> >
> >>
> >> That's worrying
> >>
> >> 'mvn test' didn't work for you?
> >>
> >> Typically to get a clean result I do 'git checkout -f 0.98 && git clean
> >> -df
> >>  && mvn -DskipTests clean install && mvn test'
> >>
> >>
> >>
> >> On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> >> jean-marc@spaggiari.org> wrote:
> >>
> >> > somewhere it's a good news for me ;) Will give more time.
> >> >
> >> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and
> it
> >> > failed with all. Did I missed something? Is there a new command line
> to
> >> > start the tests?
> >> >
> >> >
> >> > 2014-08-28 19:04 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> >> >
> >> > > -1
> >> > >
> >> > > See HBASE-11857. We should not release something known to not be
> >> > compatible
> >> > > with Phoenix. I made that a blocker for 0.98.6.
> >> > >
> >> > >
> >> > > On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <
> apurtell@apache.org>
> >> > > wrote:
> >> > >
> >> > > > The 1st HBase 0.98.
> >> > > > ​6
> >> > > >  release candidate (RC0) is available for download at
> >> > > > http://people.apache.org/~apurtell/0.98.6RC0/ and Maven artifacts
> >> are
> >> > > > also available in the temporary repository
> >> > > >
> >> >
> https://repository.apache.org/content/repositories/orgapachehbase-1032/
> >> > > >
> >> > > > Signed with my code signing key D5365CCD.
> >> > > >
> >> > > > The issues resolved in this release can be found here:
> >> > > >
> >> > >
> >> >
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
> >> > > > ​
> >> > > >
> >> > > > This ​candidate contains a significant backported change, ZK-less
> >> > region
> >> > > > assignment (HBASE-11546), thanks to the heavy lifting of Virag
> >> Kothari
> >> > > (and
> >> > > > original contributors Jimmy Xiang and Virag Kothari). The new code
> >> will
> >> > > not
> >> > > > be active unless the configuration setting "
> >> > > > hbase.assignment.usezk" is set to '
> >> > > > ​false
> >> > > > '.
> >> > > > ​If possible please consider testing with this configuration
> change
> >> on
> >> > a
> >> > > > cluster and/or with the integration tests.​
> >> > > >
> >> > > > Please try out the candidate and vote +1/-1 by midnight Pacific
> Time
> >> > > > (00:00 -0800 GMT) on
> >> > > > ​September 2
> >> > > > on whether or not we should release this as 0.98.
> >> > > > ​6
> >> > > > . Three +1 votes from PMC will be required to release.
> >> > > >
> >> > > > --
> >> > > > Best regards,
> >> > > >
> >> > > >    - Andy
> >> > > >
> >> > > > Problems worthy of attack prove their worth by hitting back. -
> Piet
> >> > Hein
> >> > > > (via Tom White)
> >> > > >
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Best regards,
> >> > >
> >> > >    - Andy
> >> > >
> >> > > Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein
> >> > > (via Tom White)
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >> Best regards,
> >>
> >>    - Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> >> (via Tom White)
> >>
> >
>



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Ted Yu <yu...@gmail.com>.
If you have the test ouput for TestVisibilityLabelsWithDistributedLogReplay,
can you pastebin it ?

Thanks


On Fri, Aug 29, 2014 at 3:38 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Here you go: http://pastebin.com/LH8cPTkp
>
> Ran 12 times. 4 different hosts, with JDK6 to 8.
>
> All 8 failed the same way. Passed only once with JDK7.
>
> I will try with -X to find the details but will focus on JDK7 on a single
> host for now.
>
> JM
>
>
> 2014-08-28 20:10 GMT-04:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
>
> > I will re-spin on the 3 servers tonight, using the command you gave, and
> > report here. 0.94.23 passed on them.
> > Le 2014-08-28 19:50, "Andrew Purtell" <ap...@apache.org> a écrit :
> >
> > On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> >> jean-marc@spaggiari.org> wrote:
> >>
> >> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and
> it
> >> > failed with all. Did I missed something? Is there a new command line
> to
> >> > start the tests?
> >> >
> >>
> >> That's worrying
> >>
> >> 'mvn test' didn't work for you?
> >>
> >> Typically to get a clean result I do 'git checkout -f 0.98 && git clean
> >> -df
> >>  && mvn -DskipTests clean install && mvn test'
> >>
> >>
> >>
> >> On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> >> jean-marc@spaggiari.org> wrote:
> >>
> >> > somewhere it's a good news for me ;) Will give more time.
> >> >
> >> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and
> it
> >> > failed with all. Did I missed something? Is there a new command line
> to
> >> > start the tests?
> >> >
> >> >
> >> > 2014-08-28 19:04 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> >> >
> >> > > -1
> >> > >
> >> > > See HBASE-11857. We should not release something known to not be
> >> > compatible
> >> > > with Phoenix. I made that a blocker for 0.98.6.
> >> > >
> >> > >
> >> > > On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <
> apurtell@apache.org>
> >> > > wrote:
> >> > >
> >> > > > The 1st HBase 0.98.
> >> > > > ​6
> >> > > >  release candidate (RC0) is available for download at
> >> > > > http://people.apache.org/~apurtell/0.98.6RC0/ and Maven artifacts
> >> are
> >> > > > also available in the temporary repository
> >> > > >
> >> >
> https://repository.apache.org/content/repositories/orgapachehbase-1032/
> >> > > >
> >> > > > Signed with my code signing key D5365CCD.
> >> > > >
> >> > > > The issues resolved in this release can be found here:
> >> > > >
> >> > >
> >> >
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
> >> > > > ​
> >> > > >
> >> > > > This ​candidate contains a significant backported change, ZK-less
> >> > region
> >> > > > assignment (HBASE-11546), thanks to the heavy lifting of Virag
> >> Kothari
> >> > > (and
> >> > > > original contributors Jimmy Xiang and Virag Kothari). The new code
> >> will
> >> > > not
> >> > > > be active unless the configuration setting "
> >> > > > hbase.assignment.usezk" is set to '
> >> > > > ​false
> >> > > > '.
> >> > > > ​If possible please consider testing with this configuration
> change
> >> on
> >> > a
> >> > > > cluster and/or with the integration tests.​
> >> > > >
> >> > > > Please try out the candidate and vote +1/-1 by midnight Pacific
> Time
> >> > > > (00:00 -0800 GMT) on
> >> > > > ​September 2
> >> > > > on whether or not we should release this as 0.98.
> >> > > > ​6
> >> > > > . Three +1 votes from PMC will be required to release.
> >> > > >
> >> > > > --
> >> > > > Best regards,
> >> > > >
> >> > > >    - Andy
> >> > > >
> >> > > > Problems worthy of attack prove their worth by hitting back. -
> Piet
> >> > Hein
> >> > > > (via Tom White)
> >> > > >
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Best regards,
> >> > >
> >> > >    - Andy
> >> > >
> >> > > Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein
> >> > > (via Tom White)
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >> Best regards,
> >>
> >>    - Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> >> (via Tom White)
> >>
> >
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Here you go: http://pastebin.com/LH8cPTkp

Ran 12 times. 4 different hosts, with JDK6 to 8.

All 8 failed the same way. Passed only once with JDK7.

I will try with -X to find the details but will focus on JDK7 on a single
host for now.

JM


2014-08-28 20:10 GMT-04:00 Jean-Marc Spaggiari <je...@spaggiari.org>:

> I will re-spin on the 3 servers tonight, using the command you gave, and
> report here. 0.94.23 passed on them.
> Le 2014-08-28 19:50, "Andrew Purtell" <ap...@apache.org> a écrit :
>
> On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
>> jean-marc@spaggiari.org> wrote:
>>
>> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and it
>> > failed with all. Did I missed something? Is there a new command line to
>> > start the tests?
>> >
>>
>> That's worrying
>>
>> 'mvn test' didn't work for you?
>>
>> Typically to get a clean result I do 'git checkout -f 0.98 && git clean
>> -df
>>  && mvn -DskipTests clean install && mvn test'
>>
>>
>>
>> On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
>> jean-marc@spaggiari.org> wrote:
>>
>> > somewhere it's a good news for me ;) Will give more time.
>> >
>> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and it
>> > failed with all. Did I missed something? Is there a new command line to
>> > start the tests?
>> >
>> >
>> > 2014-08-28 19:04 GMT-04:00 Andrew Purtell <ap...@apache.org>:
>> >
>> > > -1
>> > >
>> > > See HBASE-11857. We should not release something known to not be
>> > compatible
>> > > with Phoenix. I made that a blocker for 0.98.6.
>> > >
>> > >
>> > > On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <ap...@apache.org>
>> > > wrote:
>> > >
>> > > > The 1st HBase 0.98.
>> > > > ​6
>> > > >  release candidate (RC0) is available for download at
>> > > > http://people.apache.org/~apurtell/0.98.6RC0/ and Maven artifacts
>> are
>> > > > also available in the temporary repository
>> > > >
>> > https://repository.apache.org/content/repositories/orgapachehbase-1032/
>> > > >
>> > > > Signed with my code signing key D5365CCD.
>> > > >
>> > > > The issues resolved in this release can be found here:
>> > > >
>> > >
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
>> > > > ​
>> > > >
>> > > > This ​candidate contains a significant backported change, ZK-less
>> > region
>> > > > assignment (HBASE-11546), thanks to the heavy lifting of Virag
>> Kothari
>> > > (and
>> > > > original contributors Jimmy Xiang and Virag Kothari). The new code
>> will
>> > > not
>> > > > be active unless the configuration setting "
>> > > > hbase.assignment.usezk" is set to '
>> > > > ​false
>> > > > '.
>> > > > ​If possible please consider testing with this configuration change
>> on
>> > a
>> > > > cluster and/or with the integration tests.​
>> > > >
>> > > > Please try out the candidate and vote +1/-1 by midnight Pacific Time
>> > > > (00:00 -0800 GMT) on
>> > > > ​September 2
>> > > > on whether or not we should release this as 0.98.
>> > > > ​6
>> > > > . Three +1 votes from PMC will be required to release.
>> > > >
>> > > > --
>> > > > Best regards,
>> > > >
>> > > >    - Andy
>> > > >
>> > > > Problems worthy of attack prove their worth by hitting back. - Piet
>> > Hein
>> > > > (via Tom White)
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Best regards,
>> > >
>> > >    - Andy
>> > >
>> > > Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein
>> > > (via Tom White)
>> > >
>> >
>>
>>
>>
>> --
>> Best regards,
>>
>>    - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
>>
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
I will re-spin on the 3 servers tonight, using the command you gave, and
report here. 0.94.23 passed on them.
Le 2014-08-28 19:50, "Andrew Purtell" <ap...@apache.org> a écrit :

> On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and it
> > failed with all. Did I missed something? Is there a new command line to
> > start the tests?
> >
>
> That's worrying
>
> 'mvn test' didn't work for you?
>
> Typically to get a clean result I do 'git checkout -f 0.98 && git clean -df
>  && mvn -DskipTests clean install && mvn test'
>
>
>
> On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > somewhere it's a good news for me ;) Will give more time.
> >
> > I tried the test suite with JDK6, 7 and 8 on 3 different servers and it
> > failed with all. Did I missed something? Is there a new command line to
> > start the tests?
> >
> >
> > 2014-08-28 19:04 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> >
> > > -1
> > >
> > > See HBASE-11857. We should not release something known to not be
> > compatible
> > > with Phoenix. I made that a blocker for 0.98.6.
> > >
> > >
> > > On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <ap...@apache.org>
> > > wrote:
> > >
> > > > The 1st HBase 0.98.
> > > > ​6
> > > >  release candidate (RC0) is available for download at
> > > > http://people.apache.org/~apurtell/0.98.6RC0/ and Maven artifacts
> are
> > > > also available in the temporary repository
> > > >
> > https://repository.apache.org/content/repositories/orgapachehbase-1032/
> > > >
> > > > Signed with my code signing key D5365CCD.
> > > >
> > > > The issues resolved in this release can be found here:
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
> > > > ​
> > > >
> > > > This ​candidate contains a significant backported change, ZK-less
> > region
> > > > assignment (HBASE-11546), thanks to the heavy lifting of Virag
> Kothari
> > > (and
> > > > original contributors Jimmy Xiang and Virag Kothari). The new code
> will
> > > not
> > > > be active unless the configuration setting "
> > > > hbase.assignment.usezk" is set to '
> > > > ​false
> > > > '.
> > > > ​If possible please consider testing with this configuration change
> on
> > a
> > > > cluster and/or with the integration tests.​
> > > >
> > > > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > > > (00:00 -0800 GMT) on
> > > > ​September 2
> > > > on whether or not we should release this as 0.98.
> > > > ​6
> > > > . Three +1 votes from PMC will be required to release.
> > > >
> > > > --
> > > > Best regards,
> > > >
> > > >    - Andy
> > > >
> > > > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein
> > > > (via Tom White)
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > >    - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Andrew Purtell <ap...@apache.org>.
On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> I tried the test suite with JDK6, 7 and 8 on 3 different servers and it
> failed with all. Did I missed something? Is there a new command line to
> start the tests?
>

That's worrying

'mvn test' didn't work for you?

Typically to get a clean result I do 'git checkout -f 0.98 && git clean -df
 && mvn -DskipTests clean install && mvn test'



On Thu, Aug 28, 2014 at 4:42 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> somewhere it's a good news for me ;) Will give more time.
>
> I tried the test suite with JDK6, 7 and 8 on 3 different servers and it
> failed with all. Did I missed something? Is there a new command line to
> start the tests?
>
>
> 2014-08-28 19:04 GMT-04:00 Andrew Purtell <ap...@apache.org>:
>
> > -1
> >
> > See HBASE-11857. We should not release something known to not be
> compatible
> > with Phoenix. I made that a blocker for 0.98.6.
> >
> >
> > On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <ap...@apache.org>
> > wrote:
> >
> > > The 1st HBase 0.98.
> > > ​6
> > >  release candidate (RC0) is available for download at
> > > http://people.apache.org/~apurtell/0.98.6RC0/ and Maven artifacts are
> > > also available in the temporary repository
> > >
> https://repository.apache.org/content/repositories/orgapachehbase-1032/
> > >
> > > Signed with my code signing key D5365CCD.
> > >
> > > The issues resolved in this release can be found here:
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
> > > ​
> > >
> > > This ​candidate contains a significant backported change, ZK-less
> region
> > > assignment (HBASE-11546), thanks to the heavy lifting of Virag Kothari
> > (and
> > > original contributors Jimmy Xiang and Virag Kothari). The new code will
> > not
> > > be active unless the configuration setting "
> > > hbase.assignment.usezk" is set to '
> > > ​false
> > > '.
> > > ​If possible please consider testing with this configuration change on
> a
> > > cluster and/or with the integration tests.​
> > >
> > > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > > (00:00 -0800 GMT) on
> > > ​September 2
> > > on whether or not we should release this as 0.98.
> > > ​6
> > > . Three +1 votes from PMC will be required to release.
> > >
> > > --
> > > Best regards,
> > >
> > >    - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> >    - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>



-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)

Re: [VOTE] [FAILED] Re: The 1st HBase 0.98.6 release candidate (RC0) is available, vote closing 9/2/2014

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
somewhere it's a good news for me ;) Will give more time.

I tried the test suite with JDK6, 7 and 8 on 3 different servers and it
failed with all. Did I missed something? Is there a new command line to
start the tests?


2014-08-28 19:04 GMT-04:00 Andrew Purtell <ap...@apache.org>:

> -1
>
> See HBASE-11857. We should not release something known to not be compatible
> with Phoenix. I made that a blocker for 0.98.6.
>
>
> On Wed, Aug 27, 2014 at 8:23 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > The 1st HBase 0.98.
> > ​6
> >  release candidate (RC0) is available for download at
> > http://people.apache.org/~apurtell/0.98.6RC0/ and Maven artifacts are
> > also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1032/
> >
> > Signed with my code signing key D5365CCD.
> >
> > The issues resolved in this release can be found here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12327376
> > ​
> >
> > This ​candidate contains a significant backported change, ZK-less region
> > assignment (HBASE-11546), thanks to the heavy lifting of Virag Kothari
> (and
> > original contributors Jimmy Xiang and Virag Kothari). The new code will
> not
> > be active unless the configuration setting "
> > hbase.assignment.usezk" is set to '
> > ​false
> > '.
> > ​If possible please consider testing with this configuration change on a
> > cluster and/or with the integration tests.​
> >
> > Please try out the candidate and vote +1/-1 by midnight Pacific Time
> > (00:00 -0800 GMT) on
> > ​September 2
> > on whether or not we should release this as 0.98.
> > ​6
> > . Three +1 votes from PMC will be required to release.
> >
> > --
> > Best regards,
> >
> >    - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
>
>
> --
> Best regards,
>
>    - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>