You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2020/01/24 22:56:14 UTC

[GitHub] [accumulo] ctubbsii opened a new issue #1482: Broken tests in 1.x

ctubbsii opened a new issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482
 
 
   In 1.9 branch builds, I'm getting the following tests consistently failing:
   
   * org.apache.accumulo.test.RecoveryCompactionsAreFlushesIT.test
   * org.apache.accumulo.test.proxy.ProxyDurabilityIT.testDurability
   
   Both are timeouts. It's possible that the test timing needs to be tuned a bit, but it's also possible that there's something else going on that is preventing the tests from passing. I have not yet investigated.
   
   (These test failures are in addition to the long-time flakey replication ITs, which I omitted here)

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] ctubbsii edited a comment on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
ctubbsii edited a comment on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-578334735
 
 
   On https://github.com/apache/accumulo/pull/1481#issuecomment-578291978, @milleruntime mentioned that VerifySerialRecoveryIT was also timing out on 1.x builds.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] milleruntime commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-579303618
 
 
   The only non replication test I am now seeing consistently fail is RollWALPerformanceIT.  This test was dropped in 2.x so maybe we should just drop it since it is nondeterministic. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] asfgit closed issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
asfgit closed issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] ctubbsii commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
ctubbsii commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-579431898
 
 
   It was removed from 2.x in 9d78365d8f4d7a97a7ca4f104fa107e1f900e5f9 because it was added to the accumulo-testing repo in apache/accumulo-testing#90 ; the accumulo-testing repo is only applicable to the 2.x code. We left the testing code for 1.x where it was. So... I'm not sure if we should remove it or not. I'm okay with leaving it for now as long as it passes regularly in CI.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] ctubbsii commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
ctubbsii commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-578334735
 
 
   On #1481, @milleruntime mentioned that VerifySerialRecoveryIT was also timing out on 1.x builds.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] milleruntime commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-579918538
 
 
   Ah right.  I thought this was one of the tests we ended up just dropping.  This one is probably affected by the increase in recovery time with the 45 second cache.  It will probably need to be re-written.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] milleruntime commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-578909489
 
 
   I think adding 2 minutes to the timeout for these 3 tests is appropriate.  They are all doing recovery, which now basically has a 45 second waiting period since the recovery cache change here: 828a3219fd4234dfa045c8a63e02285170afda96
   
   Once I merge #1483 I will increase the timeout for these tests in 1.10 and master.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] milleruntime commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-578886613
 
 
   I opened #1483 which should fix a few of the recovery tests.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] ctubbsii commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
ctubbsii commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-579462053
 
 
   For this issue, I'm going to review all our default timeouts on my laptop... which I think has reasonable specs, and bump any that consistently fail. We should be able to run ITs on reasonable developer hardware. For reference, my laptop has an Intel i7-5500U CPU, 8G RAM, and an SSD.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] milleruntime commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-578905713
 
 
   > I opened #1483 which should fix a few of the recovery tests.
   
   I saw those 3 tests pass on my branch with the timeout.factor=3.  Here were the times I got:
   ```
   [INFO] Running org.apache.accumulo.test.proxy.ProxyDurabilityIT
   [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 190.034 s - in org.apache.accumulo.test.proxy.ProxyDurabilityIT
   [INFO] Running org.apache.accumulo.test.RecoveryCompactionsAreFlushesIT
   [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 100.596 s - in org.apache.accumulo.test.RecoveryCompactionsAreFlushesIT
   [INFO] Running org.apache.accumulo.test.VerifySerialRecoveryIT
   [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 174.864 s - in org.apache.accumulo.test.VerifySerialRecoveryIT
   ```
   Running Ubuntu 18 VM on EC2 m4.2xlarge

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [accumulo] Manno15 commented on issue #1482: Broken tests in 1.x

Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #1482: Broken tests in 1.x
URL: https://github.com/apache/accumulo/issues/1482#issuecomment-578436468
 
 
   I can do some investigating as well this week. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services