You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by "huangzhir (via GitHub)" <gi...@apache.org> on 2023/04/14 23:03:48 UTC

[GitHub] [kyuubi] huangzhir opened a new issue, #4713: [TEST] SchedulerPoolSuite has an issue: a false positive result

huangzhir opened a new issue, #4713:
URL: https://github.com/apache/kyuubi/issues/4713

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What kind of test improve?
   
   - [X] Fix flaky tests.
   - [X] Fix bug in tests.
   - [ ] Increase test coverage.
   - [ ] Other kinds of test improve.
   
   ### Describe the issues of the existing tests or improvements for new tests
   
   The SchedulerPoolSuite unit test has an issue. Although the test passes, it is a false positive. The log is as follows:
   ```
   - Scheduler pool
   Error: Exception in thread "pool-601-thread-2" java.lang.Error: org.apache.kyuubi.jdbc.hive.KyuubiSQLException: org.apache.kyuubi.shade.org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe (Write failed)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1155)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:750)
   Caused by: org.apache.kyuubi.jdbc.hive.KyuubiSQLException: org.apache.kyuubi.shade.org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe (Write failed)
   	at org.apache.kyuubi.jdbc.hive.KyuubiStatement.closeStatementIfNeeded(KyuubiStatement.java:167)
   	at org.apache.kyuubi.jdbc.hive.KyuubiStatement.closeClientOperation(KyuubiStatement.java:172)
   	at org.apache.kyuubi.jdbc.hive.KyuubiStatement.close(KyuubiStatement.java:183)
   	at org.apache.kyuubi.operation.JDBCTestHelper.$anonfun$withMultipleConnectionJdbcStatement$6(JDBCTestHelper.scala:70)
   	at org.apache.kyuubi.operation.JDBCTestHelper.$anonfun$withMultipleConnectionJdbcStatement$6$adapted(JDBCTestHelper.scala:70)
   	at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
   	at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
   	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
   	at org.apache.kyuubi.operation.JDBCTestHelper.withMultipleConnectionJdbcStatement(JDBCTestHelper.scala:70)
   	at org.apache.kyuubi.operation.JDBCTestHelper.withMultipleConnectionJdbcStatement$(JDBCTestHelper.scala:54)
   	at org.apache.kyuubi.engine.spark.SchedulerPoolSuite.withMultipleConnectionJdbcStatement(SchedulerPoolSuite.scala:28)
   	at org.apache.kyuubi.operation.JDBCTestHelper.withJdbcStatement(JDBCTestHelper.scala:123)
   	at org.apache.kyuubi.operation.JDBCTestHelper.withJdbcStatement$(JDBCTestHelper.scala:122)
   	at org.apache.kyuubi.engine.spark.SchedulerPoolSuite.withJdbcStatement(SchedulerPoolSuite.scala:28)
   	at org.apache.kyuubi.engine.spark.SchedulerPoolSuite.$anonfun$new$6(SchedulerPoolSuite.scala:90)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	... 2 more
   Caused by: org.apache.kyuubi.shade.org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe (Write failed)
   	at org.apache.kyuubi.shade.org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161)
   	at org.apache.kyuubi.shade.org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:501)
   	at org.apache.kyuubi.shade.org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37)
   	at org.apache.kyuubi.shade.org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73)
   	at org.apache.kyuubi.shade.org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
   	at org.apache.kyuubi.shade.org.apache.hive.service.rpc.thrift.TCLIService$Client.send_CloseOperation(TCLIService.java:515)
   	at org.apache.kyuubi.shade.org.apache.hive.service.rpc.thrift.TCLIService$Client.CloseOperation(TCLIService.java:507)
   	at sun.reflect.GeneratedMethodAccessor81.invoke(Unknown Source)
   	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.lang.reflect.Method.invoke(Method.java:498)
   	at org.apache.kyuubi.jdbc.hive.KyuubiConnection$SynchronizedHandler.invoke(KyuubiConnection.java:1287)
   	at com.sun.proxy.$Proxy39.CloseOperation(Unknown Source)
   	at org.apache.kyuubi.jdbc.hive.KyuubiStatement.closeStatementIfNeeded(KyuubiStatement.java:160)
   	... 17 more
   Caused by: java.net.SocketException: Broken pipe (Write failed)
   	at java.net.SocketOutputStream.socketWrite0(Native Method)
   	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   	at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
   	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
   	at org.apache.kyuubi.shade.org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:159)
   	... 29 more
   ```
   
   ### Are you willing to submit PR?
   
   - [X] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
   - [ ] No. I cannot submit a PR at this time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org


[GitHub] [kyuubi] pan3793 closed issue #4713: [TEST] SchedulerPoolSuite has an issue: a false positive result

Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 closed issue #4713: [TEST] SchedulerPoolSuite has an issue: a false positive result
URL: https://github.com/apache/kyuubi/issues/4713


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org


[GitHub] [kyuubi] github-actions[bot] commented on issue #4713: [TEST] SchedulerPoolSuite has an issue: a false positive result

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4713:
URL: https://github.com/apache/kyuubi/issues/4713#issuecomment-1509376904

   Hello @huangzhir,
   Thanks for finding the time to report the issue!
   We really appreciate the community's efforts to improve Apache Kyuubi.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org