You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by David Medinets <da...@gmail.com> on 2013/11/13 02:30:21 UTC
Re: integration tests
With Accumulo v1.5 I ran "mvn clean verify -Daccumulo.it.forkCount=12". The
result was 30 failures in the Testing module. Is this OBE or significant?
Failed tests: interpreter(org.apache.accumulo.test.ShellServerTest):
HexScan present in root@miniInstance t> interpreter -l(..)
exporttableImporttable(org.apache.accumulo.test.ShellServerTest):
expected:<0> but was:<1>
groups(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<2>
listscans(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<1>
maxrow(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<2>
importDirectory(org.apache.accumulo.test.ShellServerTest): expected:<0>
but was:<3>
constraint(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<3>
renametable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<3>
listcompactions(org.apache.accumulo.test.ShellServerTest): expected:<0>
but was:<4>
classpath(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<4>
du(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<5>
grep(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<6>
help(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<6>
info(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<6>
iter(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
ping(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
user(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
debug(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
egrep(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<8>
merge(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<9>
sleep(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<9>
trace(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<9>
testPertableClasspath(org.apache.accumulo.test.ShellServerTest):
expected:<0> but was:<9>
setscaniterDeletescaniter(org.apache.accumulo.test.ShellServerTest):
expected:<0> but was:<10>
clearCls(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<10>
deletemany(org.apache.accumulo.test.ShellServerTest): expected:<10> but
was:<1>
deleterows(org.apache.accumulo.test.ShellServerTest)
execfile(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<12>
clonetable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<12>
notable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
was:<13>
Re: integration tests
Posted by Eric Newton <er...@gmail.com>.
The accumulo.it.forkCount changes the number of forks used for the failSafe
plugin, which runs the integration tests. These failures are from the
sureFire unit test runner, so forking isn't the problem.
If you are running "mvn verify" it should be running the integration tests,
and you should see some performance improvement. If you are just running
"mvn package" it will only run the unit tests.
The shellServerTest is unusual: when one test fails, the remaining unit
tests will fail.
I suspect that exporttableImporttable is environment sensitive. If you save
the logs from running that test, we might be able to figure out why.
-Eric
On Tue, Nov 12, 2013 at 11:47 PM, David Medinets
<da...@gmail.com>wrote:
> Great question, Mike. The tests completed successfully in 5 minutes without
> the fork count option. Then I tried with varying numbers of fork counts and
> eventually got back to 12 forks. And the tests still passed. <sigh>
> Technological High Jinks. I've run the fork count up to 48 without getting
> the tests to fail again. The execution time of the tests does not seem to
> change with the fork count.
>
>
> On Tue, Nov 12, 2013 at 10:45 PM, Mike Drob <md...@mdrob.com> wrote:
>
> > Do you get the same failures without the fork count option?
> > On Nov 12, 2013 8:30 PM, "David Medinets" <da...@gmail.com>
> > wrote:
> >
> > > With Accumulo v1.5 I ran "mvn clean verify -Daccumulo.it.forkCount=12".
> > The
> > > result was 30 failures in the Testing module. Is this OBE or
> significant?
> > >
> > > Failed tests: interpreter(org.apache.accumulo.test.ShellServerTest):
> > > HexScan present in root@miniInstance t> interpreter -l(..)
> > > exporttableImporttable(org.apache.accumulo.test.ShellServerTest):
> > > expected:<0> but was:<1>
> > > groups(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > > was:<2>
> > > listscans(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > > was:<1>
> > > maxrow(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > > was:<2>
> > > importDirectory(org.apache.accumulo.test.ShellServerTest):
> expected:<0>
> > > but was:<3>
> > > constraint(org.apache.accumulo.test.ShellServerTest): expected:<0>
> but
> > > was:<3>
> > > renametable(org.apache.accumulo.test.ShellServerTest): expected:<0>
> but
> > > was:<3>
> > > listcompactions(org.apache.accumulo.test.ShellServerTest):
> expected:<0>
> > > but was:<4>
> > > classpath(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > > was:<4>
> > > du(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<5>
> > > grep(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<6>
> > > help(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<6>
> > > info(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<6>
> > > iter(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<7>
> > > ping(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<7>
> > > user(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<7>
> > > debug(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<7>
> > > egrep(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<8>
> > > merge(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<9>
> > > sleep(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<9>
> > > trace(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<9>
> > > testPertableClasspath(org.apache.accumulo.test.ShellServerTest):
> > > expected:<0> but was:<9>
> > > setscaniterDeletescaniter(org.apache.accumulo.test.ShellServerTest):
> > > expected:<0> but was:<10>
> > > clearCls(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > > was:<10>
> > > deletemany(org.apache.accumulo.test.ShellServerTest): expected:<10>
> but
> > > was:<1>
> > > deleterows(org.apache.accumulo.test.ShellServerTest)
> > > execfile(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > > was:<12>
> > > clonetable(org.apache.accumulo.test.ShellServerTest): expected:<0>
> but
> > > was:<12>
> > > notable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > > was:<13>
> > >
> >
>
Re: integration tests
Posted by David Medinets <da...@gmail.com>.
Great question, Mike. The tests completed successfully in 5 minutes without
the fork count option. Then I tried with varying numbers of fork counts and
eventually got back to 12 forks. And the tests still passed. <sigh>
Technological High Jinks. I've run the fork count up to 48 without getting
the tests to fail again. The execution time of the tests does not seem to
change with the fork count.
On Tue, Nov 12, 2013 at 10:45 PM, Mike Drob <md...@mdrob.com> wrote:
> Do you get the same failures without the fork count option?
> On Nov 12, 2013 8:30 PM, "David Medinets" <da...@gmail.com>
> wrote:
>
> > With Accumulo v1.5 I ran "mvn clean verify -Daccumulo.it.forkCount=12".
> The
> > result was 30 failures in the Testing module. Is this OBE or significant?
> >
> > Failed tests: interpreter(org.apache.accumulo.test.ShellServerTest):
> > HexScan present in root@miniInstance t> interpreter -l(..)
> > exporttableImporttable(org.apache.accumulo.test.ShellServerTest):
> > expected:<0> but was:<1>
> > groups(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<2>
> > listscans(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<1>
> > maxrow(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<2>
> > importDirectory(org.apache.accumulo.test.ShellServerTest): expected:<0>
> > but was:<3>
> > constraint(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<3>
> > renametable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<3>
> > listcompactions(org.apache.accumulo.test.ShellServerTest): expected:<0>
> > but was:<4>
> > classpath(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<4>
> > du(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<5>
> > grep(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<6>
> > help(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<6>
> > info(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<6>
> > iter(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<7>
> > ping(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<7>
> > user(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<7>
> > debug(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<7>
> > egrep(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<8>
> > merge(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<9>
> > sleep(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<9>
> > trace(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<9>
> > testPertableClasspath(org.apache.accumulo.test.ShellServerTest):
> > expected:<0> but was:<9>
> > setscaniterDeletescaniter(org.apache.accumulo.test.ShellServerTest):
> > expected:<0> but was:<10>
> > clearCls(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<10>
> > deletemany(org.apache.accumulo.test.ShellServerTest): expected:<10> but
> > was:<1>
> > deleterows(org.apache.accumulo.test.ShellServerTest)
> > execfile(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<12>
> > clonetable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<12>
> > notable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> > was:<13>
> >
>
Re: integration tests
Posted by Mike Drob <md...@mdrob.com>.
Do you get the same failures without the fork count option?
On Nov 12, 2013 8:30 PM, "David Medinets" <da...@gmail.com> wrote:
> With Accumulo v1.5 I ran "mvn clean verify -Daccumulo.it.forkCount=12". The
> result was 30 failures in the Testing module. Is this OBE or significant?
>
> Failed tests: interpreter(org.apache.accumulo.test.ShellServerTest):
> HexScan present in root@miniInstance t> interpreter -l(..)
> exporttableImporttable(org.apache.accumulo.test.ShellServerTest):
> expected:<0> but was:<1>
> groups(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<2>
> listscans(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<1>
> maxrow(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<2>
> importDirectory(org.apache.accumulo.test.ShellServerTest): expected:<0>
> but was:<3>
> constraint(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<3>
> renametable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<3>
> listcompactions(org.apache.accumulo.test.ShellServerTest): expected:<0>
> but was:<4>
> classpath(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<4>
> du(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<5>
> grep(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<6>
> help(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<6>
> info(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<6>
> iter(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
> ping(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
> user(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
> debug(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<7>
> egrep(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<8>
> merge(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<9>
> sleep(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<9>
> trace(org.apache.accumulo.test.ShellServerTest): expected:<0> but was:<9>
> testPertableClasspath(org.apache.accumulo.test.ShellServerTest):
> expected:<0> but was:<9>
> setscaniterDeletescaniter(org.apache.accumulo.test.ShellServerTest):
> expected:<0> but was:<10>
> clearCls(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<10>
> deletemany(org.apache.accumulo.test.ShellServerTest): expected:<10> but
> was:<1>
> deleterows(org.apache.accumulo.test.ShellServerTest)
> execfile(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<12>
> clonetable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<12>
> notable(org.apache.accumulo.test.ShellServerTest): expected:<0> but
> was:<13>
>