You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Asif Khatri (Jira)" <ji...@apache.org> on 2023/03/27 06:37:00 UTC
[jira] [Assigned] (LIVY-973) Always close RSCClient's EventLoopGroup
[ https://issues.apache.org/jira/browse/LIVY-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Asif Khatri reassigned LIVY-973:
--------------------------------
Assignee: Asif Khatri
Description:
Livy server is going unresponsive after consuming/hitting the max configured open file descriptor limit. The issue observed with RSCClient's EventLoopGroup.
{{The `setFailure()` of a job promise before the `shutdownGracefully()` can end up in an `IllegalStateException` preventing the graceful shutdown: ``` java.lang.IllegalStateException: complete already: DefaultPromise@185d2680(failure: [java.io|http://java.io/].IOException: Child process exited with code 1.) at io.netty.util.concurrent.DefaultPromise.setFailure(DefaultPromise.java:112) at org.apache.livy.rsc.JobHandleImpl.setFailure(JobHandleImpl.java:101) at org.apache.livy.rsc.RSCClient.stop(RSCClient.java:264) at org.apache.livy.rsc.RSCClient.connectionError(RSCClient.java:171) at org.apache.livy.rsc.RSCClient.access$200(RSCClient.java:52) at org.apache.livy.rsc.RSCClient$1.onFailure(RSCClient.java:108) at org.apache.livy.rsc.Utils$2.operationComplete(Utils.java:108) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550) at io.netty.util.concurrent.DefaultPromise.access$200(DefaultPromise.java:35) at io.netty.util.concurrent.DefaultPromise$1.run(DefaultPromise.java:502) at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)}}
was:
Livy server is going unresponsive after consuming/hitting the max configured open file descriptor limit. The issue observed with RSCClient's EventLoopGroup.
> Always close RSCClient's EventLoopGroup
> ---------------------------------------
>
> Key: LIVY-973
> URL: https://issues.apache.org/jira/browse/LIVY-973
> Project: Livy
> Issue Type: Bug
> Components: Server
> Affects Versions: 0.6.0, 0.8.0
> Reporter: Asif Khatri
> Assignee: Asif Khatri
> Priority: Major
> Fix For: 0.8.0
>
>
> Livy server is going unresponsive after consuming/hitting the max configured open file descriptor limit. The issue observed with RSCClient's EventLoopGroup.
> {{The `setFailure()` of a job promise before the `shutdownGracefully()` can end up in an `IllegalStateException` preventing the graceful shutdown: ``` java.lang.IllegalStateException: complete already: DefaultPromise@185d2680(failure: [java.io|http://java.io/].IOException: Child process exited with code 1.) at io.netty.util.concurrent.DefaultPromise.setFailure(DefaultPromise.java:112) at org.apache.livy.rsc.JobHandleImpl.setFailure(JobHandleImpl.java:101) at org.apache.livy.rsc.RSCClient.stop(RSCClient.java:264) at org.apache.livy.rsc.RSCClient.connectionError(RSCClient.java:171) at org.apache.livy.rsc.RSCClient.access$200(RSCClient.java:52) at org.apache.livy.rsc.RSCClient$1.onFailure(RSCClient.java:108) at org.apache.livy.rsc.Utils$2.operationComplete(Utils.java:108) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550) at io.netty.util.concurrent.DefaultPromise.access$200(DefaultPromise.java:35) at io.netty.util.concurrent.DefaultPromise$1.run(DefaultPromise.java:502) at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)}}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)