You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jean-Marc Spaggiari <je...@spaggiari.org> on 2013/01/02 16:10:40 UTC
How to run HBase tests against 0.94? (seems to be for and old version
of HBase)
Hi,
When I try to run the tests on 0.94.4RC I'm getting "hbase-default.xml
file seems to be for and old version of HBase (@@@VERSION@@@), this
version is 0.94.4"
It seems I need to setup hbase.defaults.for.version.skip to true, but
on the test, the configuration is created even before we can access a
Before class. So it's failing right from the initialization.
What's the right way to run the tests under 0.94.4RC? How can I skip this test?
Thanks,
JM
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
I ran both mvn and dev-support tests against 0.94.4RC1.
Here is dev-support results:
Results :
There are 127 small tests
There are 136 medium tests
There are 50 large tests
Tests run: 595, Failures: 0, Errors: 0, Skipped: 0
Tests run: 536, Failures: 0, Errors: 0, Skipped: 5
Tests run: 684, Failures: 0, Errors: 0, Skipped: 8
Medium and large (if selected) tests executed after 113 minutes
##########################
316 tests executed successfully
0 tests are in error
0 tests didn't finish
Tests in error are:
Tests that didn't finish are:
Execution time in minutes: 113
##########################
Here is mvn results
Tests run: 1220, Failures: 0, Errors: 0, Skipped: 13
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:06:45.841s
[INFO] Finished at: Thu Jan 03 11:42:35 EST 2013
[INFO] Final Memory: 44M/1185M
[INFO] ------------------------------------------------------------------------
mvn ran 1220 while dev-support ran 1800 (ish) tests.
mvn ran almost twice faster than dev-support!
Since mvn ran less tests than dev-support, is is still correct to rely
on its results? Since it's twice faster, I will prefer to use it
instead of dev-support...
JM
2013/1/2, Jean-Marc Spaggiari <je...@spaggiari.org>:
> I agree, but Lars spent a lot of time to make sure the tests are
> working fine, and I don't want him to yell at me if something is
> broken ;)
>
> dev-support/hbasetests.sh is running and seems to be working so far. I
> can see all the tests passing fine.
>
> If they all pass, I will submit the patch and re-run all the tests
> with the mvn command line to see if it's faster.
>
> Also, I ran mvn clean test -PrunAllTests
> -Djava.net.preferIPv4Stack=true
> -Dtest=org.apache.hadoop.hbase.master.cleaner.TestCleanerChore and it
> passed too. So I will submit the patch now.
>
> Thanks all,
>
> JM
>
> 2013/1/2, Nicolas Liochon <nk...@gmail.com>:
>> From what I see in 0.94 and in the jira, it should work, there is nothing
>> fancy there.
>>
>> moving to dev list btw, user in bcc.
>>
>>
>> On Wed, Jan 2, 2013 at 6:15 PM, Nicolas Liochon <nk...@gmail.com>
>> wrote:
>>
>>> If it works, it's ok: it's not going to give you wrong results. Just
>>> that
>>> it adds nothing to a plain mvn test.
>>> So if it worked for you on this patch, then you're done :-).
>>>
>>> This should be enough most most cases:
>>> mvn test
>>>
>>> If you want to play it safe, you will run all the tests before sending
>>> the
>>> patch.
>>> That's mvn test -P runAllTests
>>>
>>> And this should work. If you have a strange error, you can clean the env
>>> with a mvn clean install -DskipTests.
>>>
>>> 'P runAllTests' adds some extra tests and increases the parallelization,
>>> but does not change the environment.
>>>
>>>
>>> I'm gonna have a look at the JIRA you're working on to see if there
>>> something that could explain the issue you're having.
>>>
>>>
>>> On Wed, Jan 2, 2013 at 6:03 PM, Jean-Marc Spaggiari <
>>> jean-marc@spaggiari.org> wrote:
>>>
>>>> for my code validation? What's the right way to run the tests on 0.94?
>>>
>>>
>>>
>>
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
I agree, but Lars spent a lot of time to make sure the tests are
working fine, and I don't want him to yell at me if something is
broken ;)
dev-support/hbasetests.sh is running and seems to be working so far. I
can see all the tests passing fine.
If they all pass, I will submit the patch and re-run all the tests
with the mvn command line to see if it's faster.
Also, I ran mvn clean test -PrunAllTests
-Djava.net.preferIPv4Stack=true
-Dtest=org.apache.hadoop.hbase.master.cleaner.TestCleanerChore and it
passed too. So I will submit the patch now.
Thanks all,
JM
2013/1/2, Nicolas Liochon <nk...@gmail.com>:
> From what I see in 0.94 and in the jira, it should work, there is nothing
> fancy there.
>
> moving to dev list btw, user in bcc.
>
>
> On Wed, Jan 2, 2013 at 6:15 PM, Nicolas Liochon <nk...@gmail.com> wrote:
>
>> If it works, it's ok: it's not going to give you wrong results. Just that
>> it adds nothing to a plain mvn test.
>> So if it worked for you on this patch, then you're done :-).
>>
>> This should be enough most most cases:
>> mvn test
>>
>> If you want to play it safe, you will run all the tests before sending
>> the
>> patch.
>> That's mvn test -P runAllTests
>>
>> And this should work. If you have a strange error, you can clean the env
>> with a mvn clean install -DskipTests.
>>
>> 'P runAllTests' adds some extra tests and increases the parallelization,
>> but does not change the environment.
>>
>>
>> I'm gonna have a look at the JIRA you're working on to see if there
>> something that could explain the issue you're having.
>>
>>
>> On Wed, Jan 2, 2013 at 6:03 PM, Jean-Marc Spaggiari <
>> jean-marc@spaggiari.org> wrote:
>>
>>> for my code validation? What's the right way to run the tests on 0.94?
>>
>>
>>
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Nicolas Liochon <nk...@gmail.com>.
>From what I see in 0.94 and in the jira, it should work, there is nothing
fancy there.
moving to dev list btw, user in bcc.
On Wed, Jan 2, 2013 at 6:15 PM, Nicolas Liochon <nk...@gmail.com> wrote:
> If it works, it's ok: it's not going to give you wrong results. Just that
> it adds nothing to a plain mvn test.
> So if it worked for you on this patch, then you're done :-).
>
> This should be enough most most cases:
> mvn test
>
> If you want to play it safe, you will run all the tests before sending the
> patch.
> That's mvn test -P runAllTests
>
> And this should work. If you have a strange error, you can clean the env
> with a mvn clean install -DskipTests.
>
> 'P runAllTests' adds some extra tests and increases the parallelization,
> but does not change the environment.
>
>
> I'm gonna have a look at the JIRA you're working on to see if there
> something that could explain the issue you're having.
>
>
> On Wed, Jan 2, 2013 at 6:03 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> for my code validation? What's the right way to run the tests on 0.94?
>
>
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Nicolas Liochon <nk...@gmail.com>.
>From what I see in 0.94 and in the jira, it should work, there is nothing
fancy there.
moving to dev list btw, user in bcc.
On Wed, Jan 2, 2013 at 6:15 PM, Nicolas Liochon <nk...@gmail.com> wrote:
> If it works, it's ok: it's not going to give you wrong results. Just that
> it adds nothing to a plain mvn test.
> So if it worked for you on this patch, then you're done :-).
>
> This should be enough most most cases:
> mvn test
>
> If you want to play it safe, you will run all the tests before sending the
> patch.
> That's mvn test -P runAllTests
>
> And this should work. If you have a strange error, you can clean the env
> with a mvn clean install -DskipTests.
>
> 'P runAllTests' adds some extra tests and increases the parallelization,
> but does not change the environment.
>
>
> I'm gonna have a look at the JIRA you're working on to see if there
> something that could explain the issue you're having.
>
>
> On Wed, Jan 2, 2013 at 6:03 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> for my code validation? What's the right way to run the tests on 0.94?
>
>
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Nicolas Liochon <nk...@gmail.com>.
If it works, it's ok: it's not going to give you wrong results. Just that
it adds nothing to a plain mvn test.
So if it worked for you on this patch, then you're done :-).
This should be enough most most cases:
mvn test
If you want to play it safe, you will run all the tests before sending the
patch.
That's mvn test -P runAllTests
And this should work. If you have a strange error, you can clean the env
with a mvn clean install -DskipTests.
'P runAllTests' adds some extra tests and increases the parallelization,
but does not change the environment.
I'm gonna have a look at the JIRA you're working on to see if there
something that could explain the issue you're having.
On Wed, Jan 2, 2013 at 6:03 PM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> for my code validation? What's the right way to run the tests on 0.94?
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Andrew Purtell <ap...@apache.org>.
This is what I use for running the unit test suite on 0.94:
$ mvn clean test -PrunAllTests -Djava.net.preferIPv4Stack=true
(and also -Psecurity, but you don't need this unless building with
security features added)
and for running a single test:
$ mvn clean test -PrunAllTests -Djava.net.preferIPv4Stack=true
-Dtest=$TESTCLASS
(where $TESTCLASS might be for example TestAcidGuarantees)
I don't know how to exclude specific tests.
On Wed, Jan 2, 2013 at 9:03 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> Nicolas, does it mean I should not rely on the hbasetest.sh results
> for my code validation? What's the right way to run the tests on 0.94?
>
> Vandana, thanks for the suggestion! I will try that too.
>
> JM
>
> 2013/1/2, Vandana Ayyalasomayajula <av...@yahoo-inc.com>:
> > Hi Jean,
> >
> > Try adding the hbase-site.xml from src/test/ resources to your test class
> > path and running the test.
> >
> > Thanks
> > Vandana
> >
> > On Jan 2, 2013, at 7:46 AM, "Jean-Marc Spaggiari" <
> jean-marc@spaggiari.org>
> > wrote:
> >
> >> Exact, I'm running the test for 7467 ;)
> >>
> >> I was trying to avoid to run ALL the tests to save some time. I have
> >> started them now. using dev-support/hbasetest.sh runAllTests
> >>
> >> I will submit the patch as soon as I get a successful test.
> >>
> >> I did the initial build/install using maven clean install -DskipTests.
> >>
> >> I got the error when I tried to run the test using Eclipse. I will
> >> take a look into hbasetest.sh to see if the magic is inside ;)
> >>
> >> JM
> >>
> >> 2013/1/2, Ted Yu <yu...@gmail.com>:
> >>> I guess you're testing your patch for HBASE-7467.
> >>>
> >>> You can use the tip of 0.94 codebase plus your patch.
> >>> The following command should run all test cases:
> >>>
> >>> mvn clean test -P runAllTests > result.txt &
> >>>
> >>> Cheers
> >>>
> >>> On Wed, Jan 2, 2013 at 7:10 AM, Jean-Marc Spaggiari
> >>> <jean-marc@spaggiari.org
> >>>> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> When I try to run the tests on 0.94.4RC I'm getting "hbase-default.xml
> >>>> file seems to be for and old version of HBase (@@@VERSION@@@), this
> >>>> version is 0.94.4"
> >>>>
> >>>> It seems I need to setup hbase.defaults.for.version.skip to true, but
> >>>> on the test, the configuration is created even before we can access a
> >>>> Before class. So it's failing right from the initialization.
> >>>>
> >>>> What's the right way to run the tests under 0.94.4RC? How can I skip
> >>>> this
> >>>> test?
> >>>>
> >>>> Thanks,
> >>>>
> >>>> JM
> >>>
> >
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Nicolas, does it mean I should not rely on the hbasetest.sh results
for my code validation? What's the right way to run the tests on 0.94?
Vandana, thanks for the suggestion! I will try that too.
JM
2013/1/2, Vandana Ayyalasomayajula <av...@yahoo-inc.com>:
> Hi Jean,
>
> Try adding the hbase-site.xml from src/test/ resources to your test class
> path and running the test.
>
> Thanks
> Vandana
>
> On Jan 2, 2013, at 7:46 AM, "Jean-Marc Spaggiari" <je...@spaggiari.org>
> wrote:
>
>> Exact, I'm running the test for 7467 ;)
>>
>> I was trying to avoid to run ALL the tests to save some time. I have
>> started them now. using dev-support/hbasetest.sh runAllTests
>>
>> I will submit the patch as soon as I get a successful test.
>>
>> I did the initial build/install using maven clean install -DskipTests.
>>
>> I got the error when I tried to run the test using Eclipse. I will
>> take a look into hbasetest.sh to see if the magic is inside ;)
>>
>> JM
>>
>> 2013/1/2, Ted Yu <yu...@gmail.com>:
>>> I guess you're testing your patch for HBASE-7467.
>>>
>>> You can use the tip of 0.94 codebase plus your patch.
>>> The following command should run all test cases:
>>>
>>> mvn clean test -P runAllTests > result.txt &
>>>
>>> Cheers
>>>
>>> On Wed, Jan 2, 2013 at 7:10 AM, Jean-Marc Spaggiari
>>> <jean-marc@spaggiari.org
>>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> When I try to run the tests on 0.94.4RC I'm getting "hbase-default.xml
>>>> file seems to be for and old version of HBase (@@@VERSION@@@), this
>>>> version is 0.94.4"
>>>>
>>>> It seems I need to setup hbase.defaults.for.version.skip to true, but
>>>> on the test, the configuration is created even before we can access a
>>>> Before class. So it's failing right from the initialization.
>>>>
>>>> What's the right way to run the tests under 0.94.4RC? How can I skip
>>>> this
>>>> test?
>>>>
>>>> Thanks,
>>>>
>>>> JM
>>>
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Vandana Ayyalasomayajula <av...@yahoo-inc.com>.
Hi Jean,
Try adding the hbase-site.xml from src/test/ resources to your test class path and running the test.
Thanks
Vandana
On Jan 2, 2013, at 7:46 AM, "Jean-Marc Spaggiari" <je...@spaggiari.org> wrote:
> Exact, I'm running the test for 7467 ;)
>
> I was trying to avoid to run ALL the tests to save some time. I have
> started them now. using dev-support/hbasetest.sh runAllTests
>
> I will submit the patch as soon as I get a successful test.
>
> I did the initial build/install using maven clean install -DskipTests.
>
> I got the error when I tried to run the test using Eclipse. I will
> take a look into hbasetest.sh to see if the magic is inside ;)
>
> JM
>
> 2013/1/2, Ted Yu <yu...@gmail.com>:
>> I guess you're testing your patch for HBASE-7467.
>>
>> You can use the tip of 0.94 codebase plus your patch.
>> The following command should run all test cases:
>>
>> mvn clean test -P runAllTests > result.txt &
>>
>> Cheers
>>
>> On Wed, Jan 2, 2013 at 7:10 AM, Jean-Marc Spaggiari
>> <jean-marc@spaggiari.org
>>> wrote:
>>
>>> Hi,
>>>
>>> When I try to run the tests on 0.94.4RC I'm getting "hbase-default.xml
>>> file seems to be for and old version of HBase (@@@VERSION@@@), this
>>> version is 0.94.4"
>>>
>>> It seems I need to setup hbase.defaults.for.version.skip to true, but
>>> on the test, the configuration is created even before we can access a
>>> Before class. So it's failing right from the initialization.
>>>
>>> What's the right way to run the tests under 0.94.4RC? How can I skip this
>>> test?
>>>
>>> Thanks,
>>>
>>> JM
>>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Nicolas Liochon <nk...@gmail.com>.
hbasetest.sh was developed before we had the parallelism by maven surefire.
It's not really maintained anymore (actually it's somewhere in my todo list
to remove it). But for sure there is no magic there :-).
On Wed, Jan 2, 2013 at 4:45 PM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> take a look into hbasetest.sh to see if the magic is inside ;)
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Exact, I'm running the test for 7467 ;)
I was trying to avoid to run ALL the tests to save some time. I have
started them now. using dev-support/hbasetest.sh runAllTests
I will submit the patch as soon as I get a successful test.
I did the initial build/install using maven clean install -DskipTests.
I got the error when I tried to run the test using Eclipse. I will
take a look into hbasetest.sh to see if the magic is inside ;)
JM
2013/1/2, Ted Yu <yu...@gmail.com>:
> I guess you're testing your patch for HBASE-7467.
>
> You can use the tip of 0.94 codebase plus your patch.
> The following command should run all test cases:
>
> mvn clean test -P runAllTests > result.txt &
>
> Cheers
>
> On Wed, Jan 2, 2013 at 7:10 AM, Jean-Marc Spaggiari
> <jean-marc@spaggiari.org
>> wrote:
>
>> Hi,
>>
>> When I try to run the tests on 0.94.4RC I'm getting "hbase-default.xml
>> file seems to be for and old version of HBase (@@@VERSION@@@), this
>> version is 0.94.4"
>>
>> It seems I need to setup hbase.defaults.for.version.skip to true, but
>> on the test, the configuration is created even before we can access a
>> Before class. So it's failing right from the initialization.
>>
>> What's the right way to run the tests under 0.94.4RC? How can I skip this
>> test?
>>
>> Thanks,
>>
>> JM
>>
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Ted Yu <yu...@gmail.com>.
I guess you're testing your patch for HBASE-7467.
You can use the tip of 0.94 codebase plus your patch.
The following command should run all test cases:
mvn clean test -P runAllTests > result.txt &
Cheers
On Wed, Jan 2, 2013 at 7:10 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> Hi,
>
> When I try to run the tests on 0.94.4RC I'm getting "hbase-default.xml
> file seems to be for and old version of HBase (@@@VERSION@@@), this
> version is 0.94.4"
>
> It seems I need to setup hbase.defaults.for.version.skip to true, but
> on the test, the configuration is created even before we can access a
> Before class. So it's failing right from the initialization.
>
> What's the right way to run the tests under 0.94.4RC? How can I skip this
> test?
>
> Thanks,
>
> JM
>
Re: How to run HBase tests against 0.94? (seems to be for and old
version of HBase)
Posted by Nicolas Liochon <nk...@gmail.com>.
Hi Jean-Marc,
I'm not aware of any required magic, butI haven't tested the RC.
Have you tried to do a maven clean install -DskipTests?
Nicolas
On Wed, Jan 2, 2013 at 4:10 PM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:
> Hi,
>
> When I try to run the tests on 0.94.4RC I'm getting "hbase-default.xml
> file seems to be for and old version of HBase (@@@VERSION@@@), this
> version is 0.94.4"
>
> It seems I need to setup hbase.defaults.for.version.skip to true, but
> on the test, the configuration is created even before we can access a
> Before class. So it's failing right from the initialization.
>
> What's the right way to run the tests under 0.94.4RC? How can I skip this
> test?
>
> Thanks,
>
> JM
>