You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2022/12/14 15:22:00 UTC
[jira] [Comment Edited] (CALCITE-5433) Druid tests hang/fail intermittently in CI
[ https://issues.apache.org/jira/browse/CALCITE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17647532#comment-17647532 ]
Stamatis Zampetakis edited comment on CALCITE-5433 at 12/14/22 3:21 PM:
------------------------------------------------------------------------
By using [async-profiler|https://github.com/jvm-profiling-tools/async-profiler] as an agent I got some interesting flamegraphs ([^async-profiler-framegraphs.zip]) from the CI.
The results are more readable in the html format but for search purposes I outline below the stacktraces from the two threads that are causing the hang/deadlock (copy-pasted from the .html file).
+Thread-10005+
{noformat}
f(1,8259,1180,3,'[ForkJoinPool-1-worker-0 tid=10005]')
f(2,8259,1180,1,'java/util/concurrent/ForkJoinWorkerThread.run')
f(3,8259,1180,1,'java/util/concurrent/ForkJoinPool.runWorker')
f(4,8259,1180,1,'java/util/concurrent/ForkJoinPool$WorkQueue.runTask')
f(5,8259,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(6,8259,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(7,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(8,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(9,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(10,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(11,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(12,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(13,8259,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(14,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(15,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(16,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(17,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(18,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(19,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.invokeAll')
f(20,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.joinConcurrentTasksInReverseOrderToEnableWorkStealing')
f(21,8259,1180,1,'java/util/concurrent/ForkJoinTask.join')
f(22,8259,1180,1,'java/util/concurrent/ForkJoinTask.doJoin')
f(23,8259,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(24,8259,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(25,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(26,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(27,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(28,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(29,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(30,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(31,8259,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(32,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(33,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(34,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(35,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(36,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(37,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(38,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(39,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.invokeTestMethod')
f(40,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(41,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$371/176882086.execute')
f(42,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.lambda$invokeTestMethod$7')
f(43,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(44,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(45,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.invoke')
f(46,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.chainAndInvoke')
f(47,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.proceed')
f(48,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$InterceptedInvocation.proceed')
f(49,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$$Lambda$356/881910388.apply')
f(50,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.lambda$invoke$0')
f(51,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall$$Lambda$150/1089418272.apply')
f(52,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0')
f(53,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$149/1769190683.apply')
f(54,8259,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestMethod')
f(55,8259,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestableMethod')
f(56,8259,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.intercept')
f(57,8259,1180,1,'org/junit/jupiter/engine/extension/SameThreadTimeoutInvocation.proceed')
f(58,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$ValidatingInvocation.proceed')
f(59,8259,1180,1,'org/junit/jupiter/engine/execution/MethodInvocation.proceed')
f(60,8259,1180,1,'org/junit/platform/commons/util/ReflectionUtils.invokeMethod')
f(61,8259,1180,1,'java/lang/reflect/Method.invoke')
f(62,8259,1180,1,'sun/reflect/DelegatingMethodAccessorImpl.invoke')
f(63,8259,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke')
f(64,8259,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke0')
f(65,8259,1180,1,'org/apache/calcite/test/DruidAdapter2IT.testAggOverStringToLong')
f(66,8259,1180,1,'org/apache/calcite/test/CalciteAssert$AssertQuery.queryContains')
f(67,8259,1180,1,'org/apache/calcite/test/CalciteAssert$AssertQuery.withConnection')
f(68,8259,1180,1,'org/apache/calcite/test/CalciteAssert$AssertQuery.createConnection')
f(69,8259,1180,1,'org/apache/calcite/test/ConnectionFactories$MapConnectionFactory.createConnection')
f(70,8259,1180,1,'java/sql/DriverManager.<clinit>')
f(71,8259,1180,1,'java/sql/DriverManager.loadInitialDrivers')
f(72,8259,1180,1,'java/security/AccessController.doPrivileged')
f(73,8259,1180,1,'java/sql/DriverManager$2.run')
f(74,8259,1180,1,'java/sql/DriverManager$2.run')
f(75,8259,1180,1,'java/util/ServiceLoader$1.next')
f(76,8259,1180,1,'java/util/ServiceLoader$LazyIterator.next')
f(77,8259,1180,1,'java/util/ServiceLoader$LazyIterator.nextService')
f(78,8259,1180,1,'java/lang/Class.newInstance')
f(79,8259,1180,1,'java/lang/reflect/Constructor.newInstance')
f(80,8259,1180,1,'sun/reflect/DelegatingConstructorAccessorImpl.newInstance')
f(81,8259,1180,1,'sun/reflect/NativeConstructorAccessorImpl.newInstance')
f(82,8259,1180,1,'sun/reflect/NativeConstructorAccessorImpl.newInstance0')
f(83,8259,1180,3,'/usr/lib/x86_64-linux-gnu/libc.so.6')
{noformat}
+Thread-10004+
{noformat}
f(1,9439,1180,3,'[ForkJoinPool-1-worker-1 tid=10004]')
f(2,9439,1180,1,'java/util/concurrent/ForkJoinWorkerThread.run')
f(3,9439,1180,1,'java/util/concurrent/ForkJoinPool.runWorker')
f(4,9439,1180,1,'java/util/concurrent/ForkJoinPool$WorkQueue.runTask')
f(5,9439,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(6,9439,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(7,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(8,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(9,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(10,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(11,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(12,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(13,9439,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(14,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(15,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(16,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(17,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(18,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(19,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.invokeAll')
f(20,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.joinConcurrentTasksInReverseOrderToEnableWorkStealing')
f(21,9439,1180,1,'java/util/concurrent/ForkJoinTask.join')
f(22,9439,1180,1,'java/util/concurrent/ForkJoinTask.doJoin')
f(23,9439,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(24,9439,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(25,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(26,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(27,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(28,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(29,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(30,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(31,9439,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(32,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(33,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(34,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(35,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(36,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(37,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.invokeAll')
f(38,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.joinConcurrentTasksInReverseOrderToEnableWorkStealing')
f(39,9439,1180,1,'java/util/concurrent/ForkJoinTask.join')
f(40,9439,1180,1,'java/util/concurrent/ForkJoinTask.doJoin')
f(41,9439,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(42,9439,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(43,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(44,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(45,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(46,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(47,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(48,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(49,9439,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(50,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(51,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(52,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(53,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(54,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(55,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(56,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(57,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.invokeTestMethod')
f(58,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(59,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$371/176882086.execute')
f(60,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.lambda$invokeTestMethod$7')
f(61,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(62,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(63,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.invoke')
f(64,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.chainAndInvoke')
f(65,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.proceed')
f(66,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$InterceptedInvocation.proceed')
f(67,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$$Lambda$356/881910388.apply')
f(68,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.lambda$invoke$0')
f(69,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall$$Lambda$150/1089418272.apply')
f(70,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0')
f(71,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$149/1769190683.apply')
f(72,9439,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestMethod')
f(73,9439,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestableMethod')
f(74,9439,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.intercept')
f(75,9439,1180,1,'org/junit/jupiter/engine/extension/SameThreadTimeoutInvocation.proceed')
f(76,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$ValidatingInvocation.proceed')
f(77,9439,1180,1,'org/junit/jupiter/engine/execution/MethodInvocation.proceed')
f(78,9439,1180,1,'org/junit/platform/commons/util/ReflectionUtils.invokeMethod')
f(79,9439,1180,1,'java/lang/reflect/Method.invoke')
f(80,9439,1180,1,'sun/reflect/DelegatingMethodAccessorImpl.invoke')
f(81,9439,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke')
f(82,9439,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke0')
f(83,9439,1180,1,'org/apache/calcite/test/DruidDateRangeRulesTest.testFilterWithCast')
f(84,9439,1180,1,'org/apache/calcite/test/DruidDateRangeRulesTest$Fixture2.<init>')
f(85,9439,1180,1,'org/apache/calcite/test/RexImplicationCheckerFixtures$Fixture.<init>')
f(86,9439,1180,1,'org/apache/calcite/tools/Frameworks.withPrepare')
f(87,9439,1180,1,'org/apache/calcite/tools/Frameworks.withPrepare')
f(88,9439,1180,1,'org/apache/calcite/tools/Frameworks$$Lambda$513/1762026656.get')
f(89,9439,1180,1,'com/google/common/base/Suppliers$NonSerializableMemoizingSupplier.get')
f(90,9439,1180,1,'org/apache/calcite/tools/Frameworks$$Lambda$512/1724407685.get')
f(91,9439,1180,1,'org/apache/calcite/jdbc/Driver.<clinit>')
f(92,9439,1180,1,'org/apache/calcite/avatica/UnregisteredDriver.register')
f(93,9439,1180,3,'/usr/lib/x86_64-linux-gnu/libc.so.6')
{noformat}
was (Author: zabetak):
By using [async-profiler|https://github.com/jvm-profiling-tools/async-profiler] as an agent I got some interesting flamegraphs ([^async-profiler-framegraphs.zip]) from the CI.
The results are more readable in the html format but for search purposes I outline below the stacktraces from the two threads that are causing the hang/deadlock.
+Thread-10005+
{noformat}
f(1,8259,1180,3,'[ForkJoinPool-1-worker-0 tid=10005]')
f(2,8259,1180,1,'java/util/concurrent/ForkJoinWorkerThread.run')
f(3,8259,1180,1,'java/util/concurrent/ForkJoinPool.runWorker')
f(4,8259,1180,1,'java/util/concurrent/ForkJoinPool$WorkQueue.runTask')
f(5,8259,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(6,8259,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(7,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(8,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(9,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(10,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(11,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(12,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(13,8259,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(14,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(15,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(16,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(17,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(18,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(19,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.invokeAll')
f(20,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.joinConcurrentTasksInReverseOrderToEnableWorkStealing')
f(21,8259,1180,1,'java/util/concurrent/ForkJoinTask.join')
f(22,8259,1180,1,'java/util/concurrent/ForkJoinTask.doJoin')
f(23,8259,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(24,8259,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(25,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(26,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(27,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(28,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(29,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(30,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(31,8259,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(32,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(33,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(34,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(35,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(36,8259,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(37,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(38,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(39,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.invokeTestMethod')
f(40,8259,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(41,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$371/176882086.execute')
f(42,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.lambda$invokeTestMethod$7')
f(43,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(44,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(45,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.invoke')
f(46,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.chainAndInvoke')
f(47,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.proceed')
f(48,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$InterceptedInvocation.proceed')
f(49,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$$Lambda$356/881910388.apply')
f(50,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.lambda$invoke$0')
f(51,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall$$Lambda$150/1089418272.apply')
f(52,8259,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0')
f(53,8259,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$149/1769190683.apply')
f(54,8259,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestMethod')
f(55,8259,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestableMethod')
f(56,8259,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.intercept')
f(57,8259,1180,1,'org/junit/jupiter/engine/extension/SameThreadTimeoutInvocation.proceed')
f(58,8259,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$ValidatingInvocation.proceed')
f(59,8259,1180,1,'org/junit/jupiter/engine/execution/MethodInvocation.proceed')
f(60,8259,1180,1,'org/junit/platform/commons/util/ReflectionUtils.invokeMethod')
f(61,8259,1180,1,'java/lang/reflect/Method.invoke')
f(62,8259,1180,1,'sun/reflect/DelegatingMethodAccessorImpl.invoke')
f(63,8259,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke')
f(64,8259,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke0')
f(65,8259,1180,1,'org/apache/calcite/test/DruidAdapter2IT.testAggOverStringToLong')
f(66,8259,1180,1,'org/apache/calcite/test/CalciteAssert$AssertQuery.queryContains')
f(67,8259,1180,1,'org/apache/calcite/test/CalciteAssert$AssertQuery.withConnection')
f(68,8259,1180,1,'org/apache/calcite/test/CalciteAssert$AssertQuery.createConnection')
f(69,8259,1180,1,'org/apache/calcite/test/ConnectionFactories$MapConnectionFactory.createConnection')
f(70,8259,1180,1,'java/sql/DriverManager.<clinit>')
f(71,8259,1180,1,'java/sql/DriverManager.loadInitialDrivers')
f(72,8259,1180,1,'java/security/AccessController.doPrivileged')
f(73,8259,1180,1,'java/sql/DriverManager$2.run')
f(74,8259,1180,1,'java/sql/DriverManager$2.run')
f(75,8259,1180,1,'java/util/ServiceLoader$1.next')
f(76,8259,1180,1,'java/util/ServiceLoader$LazyIterator.next')
f(77,8259,1180,1,'java/util/ServiceLoader$LazyIterator.nextService')
f(78,8259,1180,1,'java/lang/Class.newInstance')
f(79,8259,1180,1,'java/lang/reflect/Constructor.newInstance')
f(80,8259,1180,1,'sun/reflect/DelegatingConstructorAccessorImpl.newInstance')
f(81,8259,1180,1,'sun/reflect/NativeConstructorAccessorImpl.newInstance')
f(82,8259,1180,1,'sun/reflect/NativeConstructorAccessorImpl.newInstance0')
f(83,8259,1180,3,'/usr/lib/x86_64-linux-gnu/libc.so.6')
{noformat}
+Thread-10004+
{noformat}
f(1,9439,1180,3,'[ForkJoinPool-1-worker-1 tid=10004]')
f(2,9439,1180,1,'java/util/concurrent/ForkJoinWorkerThread.run')
f(3,9439,1180,1,'java/util/concurrent/ForkJoinPool.runWorker')
f(4,9439,1180,1,'java/util/concurrent/ForkJoinPool$WorkQueue.runTask')
f(5,9439,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(6,9439,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(7,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(8,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(9,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(10,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(11,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(12,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(13,9439,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(14,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(15,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(16,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(17,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(18,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(19,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.invokeAll')
f(20,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.joinConcurrentTasksInReverseOrderToEnableWorkStealing')
f(21,9439,1180,1,'java/util/concurrent/ForkJoinTask.join')
f(22,9439,1180,1,'java/util/concurrent/ForkJoinTask.doJoin')
f(23,9439,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(24,9439,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(25,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(26,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(27,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(28,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(29,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(30,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(31,9439,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(32,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(33,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(34,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(35,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(36,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(37,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.invokeAll')
f(38,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService.joinConcurrentTasksInReverseOrderToEnableWorkStealing')
f(39,9439,1180,1,'java/util/concurrent/ForkJoinTask.join')
f(40,9439,1180,1,'java/util/concurrent/ForkJoinTask.doJoin')
f(41,9439,1180,1,'java/util/concurrent/ForkJoinTask.doExec')
f(42,9439,1180,1,'java/util/concurrent/RecursiveAction.exec')
f(43,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ForkJoinPoolHierarchicalTestExecutorService$ExclusiveTask.compute')
f(44,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.execute')
f(45,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.executeRecursively')
f(46,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(47,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$248/1415988207.execute')
f(48,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$9')
f(49,9439,1180,1,'org/junit/platform/engine/support/hierarchical/Node.around')
f(50,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$249/557488662.invoke')
f(51,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$8')
f(52,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(53,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask$$Lambda$250/1307438350.execute')
f(54,9439,1180,1,'org/junit/platform/engine/support/hierarchical/NodeTestTask.lambda$executeRecursively$6')
f(55,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(56,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.execute')
f(57,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.invokeTestMethod')
f(58,9439,1180,1,'org/junit/platform/engine/support/hierarchical/ThrowableCollector.execute')
f(59,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$371/176882086.execute')
f(60,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor.lambda$invokeTestMethod$7')
f(61,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(62,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.invoke')
f(63,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.invoke')
f(64,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.chainAndInvoke')
f(65,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain.proceed')
f(66,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$InterceptedInvocation.proceed')
f(67,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$$Lambda$356/881910388.apply')
f(68,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker.lambda$invoke$0')
f(69,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall$$Lambda$150/1089418272.apply')
f(70,9439,1180,1,'org/junit/jupiter/engine/execution/InterceptingExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0')
f(71,9439,1180,1,'org/junit/jupiter/engine/descriptor/TestMethodTestDescriptor$$Lambda$149/1769190683.apply')
f(72,9439,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestMethod')
f(73,9439,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.interceptTestableMethod')
f(74,9439,1180,1,'org/junit/jupiter/engine/extension/TimeoutExtension.intercept')
f(75,9439,1180,1,'org/junit/jupiter/engine/extension/SameThreadTimeoutInvocation.proceed')
f(76,9439,1180,1,'org/junit/jupiter/engine/execution/InvocationInterceptorChain$ValidatingInvocation.proceed')
f(77,9439,1180,1,'org/junit/jupiter/engine/execution/MethodInvocation.proceed')
f(78,9439,1180,1,'org/junit/platform/commons/util/ReflectionUtils.invokeMethod')
f(79,9439,1180,1,'java/lang/reflect/Method.invoke')
f(80,9439,1180,1,'sun/reflect/DelegatingMethodAccessorImpl.invoke')
f(81,9439,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke')
f(82,9439,1180,1,'sun/reflect/NativeMethodAccessorImpl.invoke0')
f(83,9439,1180,1,'org/apache/calcite/test/DruidDateRangeRulesTest.testFilterWithCast')
f(84,9439,1180,1,'org/apache/calcite/test/DruidDateRangeRulesTest$Fixture2.<init>')
f(85,9439,1180,1,'org/apache/calcite/test/RexImplicationCheckerFixtures$Fixture.<init>')
f(86,9439,1180,1,'org/apache/calcite/tools/Frameworks.withPrepare')
f(87,9439,1180,1,'org/apache/calcite/tools/Frameworks.withPrepare')
f(88,9439,1180,1,'org/apache/calcite/tools/Frameworks$$Lambda$513/1762026656.get')
f(89,9439,1180,1,'com/google/common/base/Suppliers$NonSerializableMemoizingSupplier.get')
f(90,9439,1180,1,'org/apache/calcite/tools/Frameworks$$Lambda$512/1724407685.get')
f(91,9439,1180,1,'org/apache/calcite/jdbc/Driver.<clinit>')
f(92,9439,1180,1,'org/apache/calcite/avatica/UnregisteredDriver.register')
f(93,9439,1180,3,'/usr/lib/x86_64-linux-gnu/libc.so.6')
{noformat}
> Druid tests hang/fail intermittently in CI
> ------------------------------------------
>
> Key: CALCITE-5433
> URL: https://issues.apache.org/jira/browse/CALCITE-5433
> Project: Calcite
> Issue Type: Bug
> Affects Versions: 1.32.0
> Reporter: Stamatis Zampetakis
> Assignee: Stamatis Zampetakis
> Priority: Major
> Attachments: async-profiler-framegraphs.zip
>
>
> Some recent runs that were stuck: https://github.com/apache/calcite/actions/runs/3680040091/jobs/6225181295
> https://github.com/apache/calcite/actions/runs/3674545796/jobs/6212895531
> https://github.com/apache/calcite/actions/runs/3663488988/jobs/6193301119
> This is not a new problem and has been discussed in the following thread:
> https://lists.apache.org/thread/z67j2pnlxx7zpmlvqlrozc9omkvbqffh
--
This message was sent by Atlassian Jira
(v8.20.10#820010)