You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/08/17 14:29:32 UTC
[GitHub] [pulsar] lhotari opened a new issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
lhotari opened a new issue #11690:
URL: https://github.com/apache/pulsar/issues/11690
<!---
Instructions for reporting a flaky test using this issue template:
1. Replace [test class] in title and body with the test class name
2. Replace [test method] in title and body with the test method that failed. Multiple methods are flaky, remove the content that refers to the test method.
3. Replace "url here" with a url to an example failure. In the Github Actions workflow run logs, you can right click on the line number to copy a link to the line. Example of such url is https://github.com/apache/pulsar/pull/8892/checks?check_run_id=1531075794#step:9:377 . The logs are available for a limited amount of time (usually for a few weeks).
4. Replace "relevant parts of the exception stacktrace here" with the a few lines of the stack trace that shows at leat the exception message and the line of test code where the stacktrace occured.
5. Replace "full exception stacktrace here" with the full exception stacktrace from logs. This section will be hidded by default.
6. Remove all unused fields / content to unclutter the reported issue. Remove this comment too.
-->
LockManagerTest is flaky. The revalidateLockOnDifferentSession test method fails sporadically.
[example failure](https://github.com/apache/pulsar/pull/11681/checks?check_run_id=3348683996#step:9:4714)
```
Error: Tests run: 12, Failures: 1, Errors: 0, Skipped: 7, Time elapsed: 1.52 s <<< FAILURE! - in org.apache.pulsar.metadata.LockManagerTest
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.264 s <<< FAILURE!
java.util.NoSuchElementException: No value present
at java.base/java.util.Optional.get(Optional.java:148)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:229)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-904405479
[recent failure](https://github.com/apache/pulsar/pull/11706/checks?check_run_id=3408265551#step:8:4748)
```
Error: Tests run: 12, Failures: 1, Errors: 0, Skipped: 7, Time elapsed: 1.802 s <<< FAILURE! - in org.apache.pulsar.metadata.LockManagerTest
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.273 s <<< FAILURE!
java.util.concurrent.CompletionException: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-527025516274 is already locked
at java.base/java.util.concurrent.CompletableFuture.reportJoin(CompletableFuture.java:412)
at java.base/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2044)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:224)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-527025516274 is already locked
at org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl.lambda$acquireWithNoRevalidation$8(ResourceLockImpl.java:178)
at java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:986)
at java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:970)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$storePut$16(ZKMetadataStore.java:257)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-905216759
there's a mitigation for this flaky test in #11771 by using a solution which cleans up state between test retries. please review
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-904553977
[recent failure](https://github.com/apache/pulsar/pull/11758/checks?check_run_id=3408040594#step:8:1447)
```
Error: Tests run: 12, Failures: 1, Errors: 0, Skipped: 7, Time elapsed: 2.013 s <<< FAILURE! - in org.apache.pulsar.metadata.LockManagerTest
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.392 s <<< FAILURE!
java.util.NoSuchElementException: No value present
at java.base/java.util.Optional.get(Optional.java:148)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:229)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari edited a comment on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari edited a comment on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-904405935
[another](https://github.com/apache/pulsar/pull/11706/checks?check_run_id=3408265551#step:8:3099)
```
Error: Tests run: 12, Failures: 1, Errors: 0, Skipped: 7, Time elapsed: 1.643 s <<< FAILURE! - in org.apache.pulsar.metadata.LockManagerTest
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.353 s <<< FAILURE!
java.util.NoSuchElementException: No value present
at java.base/java.util.Optional.get(Optional.java:148)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:229)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-905201482
again
```
Error: Tests run: 12, Failures: 1, Errors: 0, Skipped: 7, Time elapsed: 1.961 s <<< FAILURE! - in org.apache.pulsar.metadata.LockManagerTest
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.313 s <<< FAILURE!
java.util.concurrent.CompletionException: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-2505731787631 is already locked
at java.base/java.util.concurrent.CompletableFuture.reportJoin(CompletableFuture.java:412)
at java.base/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2044)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:224)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-2505731787631 is already locked
at org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl.lambda$acquireWithNoRevalidation$8(ResourceLockImpl.java:178)
at java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:986)
at java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:970)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$storePut$16(ZKMetadataStore.java:257)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-904406477
also
```
Error: Tests run: 12, Failures: 1, Errors: 0, Skipped: 7, Time elapsed: 1.67 s <<< FAILURE! - in org.apache.pulsar.metadata.LockManagerTest
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.289 s <<< FAILURE!
java.lang.AssertionError: expected [false] but found [true]
at org.testng.Assert.fail(Assert.java:99)
at org.testng.Assert.failNotEquals(Assert.java:1037)
at org.testng.Assert.assertFalse(Assert.java:67)
at org.testng.Assert.assertFalse(Assert.java:77)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:226)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-901605587
yet another
```
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.28 s <<< FAILURE!
java.util.concurrent.CompletionException: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-1415246702016 is already locked
at java.base/java.util.concurrent.CompletableFuture.reportJoin(CompletableFuture.java:412)
at java.base/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2044)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:224)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-1415246702016 is already locked
at org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl.lambda$acquireWithNoRevalidation$8(ResourceLockImpl.java:178)
at java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:986)
at java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:970)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$storePut$16(ZKMetadataStore.java:257)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-904405935
another
```
Error: Tests run: 12, Failures: 1, Errors: 0, Skipped: 7, Time elapsed: 1.643 s <<< FAILURE! - in org.apache.pulsar.metadata.LockManagerTest
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.353 s <<< FAILURE!
java.util.NoSuchElementException: No value present
at java.base/java.util.Optional.get(Optional.java:148)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:229)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari closed issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari closed issue #11690:
URL: https://github.com/apache/pulsar/issues/11690
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-905766899
the solution in #11771 doesn't seem to help. The issue persists. Here's logs from a failed test run: https://gist.github.com/lhotari/5f0176f52a409795ae9134c34efc0f7a .
There are logs for the cleanup taking place, but the log gets filled up with lines such as
```
17:49:56.812 WARN [TestNG-method=revalidateLockOnDifferentSession-1-SendThread(127.0.0.1:39133)] o.a.z.ClientCnxn@1294 - An exception was thrown while closing send thread for session 0x1000007f30d0003.
org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1000007f30d0003, likely server has closed socket
at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.3.jar:3.6.3]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar:3.6.3]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) [zookeeper-3.6.3.jar:3.6.3]
17:49:56.913 INFO [TestNG-method=revalidateLockOnDifferentSession-1-EventThread] o.a.p.m.i.ZKSessionWatcher@120 - Got ZK session watch event: WatchedEvent state:Closed type:None path:null
17:49:56.921 WARN [TestNG-method=revalidateLockOnDifferentSession-1-SendThread(127.0.0.1:39133)] o.a.z.ClientCnxn@1294 - An exception was thrown while closing send thread for session 0x1000007f30d0002.
org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1000007f30d0002, likely server has closed socket
at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.3.jar:3.6.3]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar:3.6.3]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) [zookeeper-3.6.3.jar:3.6.3]
17:49:57.022 INFO [TestNG-method=revalidateLockOnDifferentSession-1-EventThread] o.a.p.m.i.ZKSessionWatcher@120 - Got ZK session watch event: WatchedEvent state:Closed type:None path:null
~~~~~~~~~ SKIPPED -- [TestClass name=class org.apache.pulsar.metadata.LockManagerTest].revalidateLockOnDifferentSession([ZooKeeper, 127.0.0.1:39133])-------
17:49:57.024 INFO [main] o.a.p.t.TestRetrySupport@70 - Detected test failure in test LockManagerTest.revalidateLockOnDifferentSession, currentSetupNumber=1
17:49:57.025 INFO [main] o.a.p.t.TestRetrySupport@53 - Previous test run has failed before LockManagerTest.revalidateLockOnDifferentSession, failedSetupNumber=1. Running cleanup and setup.
17:49:57.038 INFO [main] o.a.p.m.TestZKServer@81 - Stopped test ZK server
17:49:57.062 WARN [main] o.a.z.s.ServerCnxnFactory@309 - maxCnxns is not configured, using default value 0.
17:49:57.067 INFO [main] o.a.p.m.TestZKServer@65 - Started test ZK server on port 44143
17:49:57.081 INFO [main] o.a.p.m.TestZKServer@134 - ZK Server UP
17:49:57.081 INFO [main] o.a.p.t.TestRetrySupport@61 - State cleanup finished.
------- Starting test [TestClass name=class org.apache.pulsar.metadata.LockManagerTest].revalidateLockOnDifferentSession([ZooKeeper, 127.0.0.1:39133])-------
17:49:57.092 WARN [TestNG-method=revalidateLockOnDifferentSession-1-SendThread(127.0.0.1:39133)] o.a.z.ClientCnxn@1300 - Session 0x0 for sever localhost/127.0.0.1:39133, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:?]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:777) ~[?:?]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344) ~[zookeeper-3.6.3.jar:3.6.3]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) [zookeeper-3.6.3.jar:3.6.3]
17:49:58.195 WARN [TestNG-method=revalidateLockOnDifferentSession-1-SendThread(127.0.0.1:39133)] o.a.z.ClientCnxn@1300 - Session 0x0 for sever localhost/127.0.0.1:39133, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:?]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:777) ~[?:?]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344) ~[zookeeper-3.6.3.jar:3.6.3]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) [zookeeper-3.6.3.jar:3.6.3]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-905815283
#11778 mitigates the issue with retries.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-910094698
summary reports for LockManagerTest failures in markdown format:
https://github.com/lhotari/pulsar-flakes/blob/master/2021-08-25-to-2021-09-01/1630481590725/org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession.md
https://github.com/lhotari/pulsar-flakes/blob/master/2021-08-25-to-2021-09-01/1630481590725/org.apache.pulsar.metadata.LockManagerTest.revalidateLockWithinSameSession.md
https://github.com/lhotari/pulsar-flakes/blob/master/2021-08-25-to-2021-09-01/1630481590725/org.apache.pulsar.metadata.LockManagerTest.updateValue.md
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-901604585
Another [recent failure](https://github.com/apache/pulsar/pull/11706/checks?check_run_id=3364849405#step:9:8501):
```
Error: revalidateLockOnDifferentSession(org.apache.pulsar.metadata.LockManagerTest) Time elapsed: 0.258 s <<< FAILURE!
java.util.concurrent.CompletionException: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-1574122810330 is already locked
at java.base/java.util.concurrent.CompletableFuture.reportJoin(CompletableFuture.java:412)
at java.base/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2044)
at org.apache.pulsar.metadata.LockManagerTest.revalidateLockOnDifferentSession(LockManagerTest.java:224)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.pulsar.metadata.api.MetadataStoreException$LockBusyException: Resource at /key-1574122810330 is already locked
at org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl.lambda$acquireWithNoRevalidation$8(ResourceLockImpl.java:178)
at java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:986)
at java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:970)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$storePut$16(ZKMetadataStore.java:257)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lhotari commented on issue #11690: Flaky-test: LockManagerTest.revalidateLockOnDifferentSession
Posted by GitBox <gi...@apache.org>.
lhotari commented on issue #11690:
URL: https://github.com/apache/pulsar/issues/11690#issuecomment-1029206431
also reported as #13910
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org