You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "JOHN, BIBIN" <bj...@att.com> on 2020/01/09 05:15:55 UTC

java.net.BindException: Address already in use (Bind failed) with kafka-topics command

Could you please let me know why sometimes I am getting, below exception? Cluster is up and running. Kafka and ZK is running in same server. We also have jmx exporter configured for monitoring.

kafka-topics --zookeeper localhost:2181 --list
Error: Exception thrown by the agent : java.rmi.server.ExportException: Port already in use: 0; nested exception is:
        java.net.BindException: Address already in use (Bind failed)
sun.management.AgentConfigurationError: java.rmi.server.ExportException: Port already in use: 0; nested exception is:
        java.net.BindException: Address already in use (Bind failed)
        at sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:553)
        at sun.management.Agent.startLocalManagementAgent(Agent.java:137)
        at sun.management.Agent.startAgent(Agent.java:265)
        at sun.management.Agent.startAgent(Agent.java:452)
Caused by: java.rmi.server.ExportException: Port already in use: 0; nested exception is:
        java.net.BindException: Address already in use (Bind failed)
        at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:346)
        at sun.rmi.transport.tcp.TCPTransport.exportObject(TCPTransport.java:254)
        at sun.rmi.transport.tcp.TCPEndpoint.exportObject(TCPEndpoint.java:411)
        at sun.rmi.transport.LiveRef.exportObject(LiveRef.java:147)
        at sun.rmi.server.UnicastServerRef.exportObject(UnicastServerRef.java:236)
        at sun.management.jmxremote.ConnectorBootstrap$PermanentExporter.exportObject(ConnectorBootstrap.java:199)
        at javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:146)
        at javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:122)
        at javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java:404)
        at sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:550)
        ... 3 more
Caused by: java.net.BindException: Address already in use (Bind failed)
        at java.net.PlainSocketImpl.socketBind(Native Method)
        at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
        at java.net.ServerSocket.bind(ServerSocket.java:375)
        at java.net.ServerSocket.<init>(ServerSocket.java:237)
        at java.net.ServerSocket.<init>(ServerSocket.java:128)
        at sun.management.jmxremote.LocalRMIServerSocketFactory$1.<init>(LocalRMIServerSocketFactory.java:49)
        at sun.management.jmxremote.LocalRMIServerSocketFactory.createServerSocket(LocalRMIServerSocketFactory.java:49)
        at sun.rmi.transport.tcp.TCPEndpoint.newServerSocket(TCPEndpoint.java:666)
        at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:335)
        ... 12 more

Re: java.net.BindException: Address already in use (Bind failed) with kafka-topics command

Posted by kalai selvan <ka...@gmail.com>.
Hello,

Please refer the documentation for increasing the ephemeral ports. Mostly
it will solve the issue.


https://www.google.com/amp/s/www.cyberciti.biz/tips/linux-increase-outgoing-network-sockets-range.html/amp

Regards,
Kalai

On Thu, 9 Jan, 2020, 11:14 AM JOHN, BIBIN, <bj...@att.com> wrote:

> we don’t have mirrormaker configured in this cluster. Please find output
> of netstat command.
>
> netstat -an | wc -l
> 570322
>
>
> -----Original Message-----
> From: kalai selvan <ka...@gmail.com>
> Sent: Wednesday, January 8, 2020 11:41 PM
> To: users@kafka.apache.org
> Subject: Re: java.net.BindException: Address already in use (Bind failed)
> with kafka-topics command
>
> Hello,
>
> Looks like your server is running out of ephemeral ports. The below
> command confirms it is running out of ephemeral ports. We can restart the
> process to solve the issue.  Must probably root cause of the issue will be
> wrong configuration of mirror maker process / it is a bug.
>
> netstat -an | wc -l
>
> Regards,
> Kalai
>
> On Thu, 9 Jan, 2020, 10:46 AM JOHN, BIBIN, <bj...@att.com> wrote:
>
> > Could you please let me know why sometimes I am getting, below exception?
> > Cluster is up and running. Kafka and ZK is running in same server. We
> > also have jmx exporter configured for monitoring.
> >
> > kafka-topics --zookeeper localhost:2181 --list
> > Error: Exception thrown by the agent : java.rmi.server.ExportException:
> > Port already in use: 0; nested exception is:
> >         java.net.BindException: Address already in use (Bind failed)
> > sun.management.AgentConfigurationError: java.rmi.server.ExportException:
> > Port already in use: 0; nested exception is:
> >         java.net.BindException: Address already in use (Bind failed)
> >         at
> >
> sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:553)
> >         at sun.management.Agent.startLocalManagementAgent(Agent.java:137)
> >         at sun.management.Agent.startAgent(Agent.java:265)
> >         at sun.management.Agent.startAgent(Agent.java:452)
> > Caused by: java.rmi.server.ExportException: Port already in use: 0;
> > nested exception is:
> >         java.net.BindException: Address already in use (Bind failed)
> >         at
> sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:346)
> >         at
> > sun.rmi.transport.tcp.TCPTransport.exportObject(TCPTransport.java:254)
> >         at
> > sun.rmi.transport.tcp.TCPEndpoint.exportObject(TCPEndpoint.java:411)
> >         at sun.rmi.transport.LiveRef.exportObject(LiveRef.java:147)
> >         at
> > sun.rmi.server.UnicastServerRef.exportObject(UnicastServerRef.java:236)
> >         at
> >
> sun.management.jmxremote.ConnectorBootstrap$PermanentExporter.exportObject(ConnectorBootstrap.java:199)
> >         at
> >
> javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:146)
> >         at
> >
> javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:122)
> >         at
> >
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java:404)
> >         at
> >
> sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:550)
> >         ... 3 more
> > Caused by: java.net.BindException: Address already in use (Bind failed)
> >         at java.net.PlainSocketImpl.socketBind(Native Method)
> >         at java.net
> > .AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
> >         at java.net.ServerSocket.bind(ServerSocket.java:375)
> >         at java.net.ServerSocket.<init>(ServerSocket.java:237)
> >         at java.net.ServerSocket.<init>(ServerSocket.java:128)
> >         at
> >
> sun.management.jmxremote.LocalRMIServerSocketFactory$1.<init>(LocalRMIServerSocketFactory.java:49)
> >         at
> >
> sun.management.jmxremote.LocalRMIServerSocketFactory.createServerSocket(LocalRMIServerSocketFactory.java:49)
> >         at
> > sun.rmi.transport.tcp.TCPEndpoint.newServerSocket(TCPEndpoint.java:666)
> >         at
> sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:335)
> >         ... 12 more
> >
> >
>

RE: java.net.BindException: Address already in use (Bind failed) with kafka-topics command

Posted by "JOHN, BIBIN" <bj...@att.com>.
we don’t have mirrormaker configured in this cluster. Please find output of netstat command.

netstat -an | wc -l
570322


-----Original Message-----
From: kalai selvan <ka...@gmail.com> 
Sent: Wednesday, January 8, 2020 11:41 PM
To: users@kafka.apache.org
Subject: Re: java.net.BindException: Address already in use (Bind failed) with kafka-topics command

Hello,

Looks like your server is running out of ephemeral ports. The below command confirms it is running out of ephemeral ports. We can restart the process to solve the issue.  Must probably root cause of the issue will be wrong configuration of mirror maker process / it is a bug.

netstat -an | wc -l

Regards,
Kalai

On Thu, 9 Jan, 2020, 10:46 AM JOHN, BIBIN, <bj...@att.com> wrote:

> Could you please let me know why sometimes I am getting, below exception?
> Cluster is up and running. Kafka and ZK is running in same server. We 
> also have jmx exporter configured for monitoring.
>
> kafka-topics --zookeeper localhost:2181 --list
> Error: Exception thrown by the agent : java.rmi.server.ExportException:
> Port already in use: 0; nested exception is:
>         java.net.BindException: Address already in use (Bind failed)
> sun.management.AgentConfigurationError: java.rmi.server.ExportException:
> Port already in use: 0; nested exception is:
>         java.net.BindException: Address already in use (Bind failed)
>         at
> sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:553)
>         at sun.management.Agent.startLocalManagementAgent(Agent.java:137)
>         at sun.management.Agent.startAgent(Agent.java:265)
>         at sun.management.Agent.startAgent(Agent.java:452)
> Caused by: java.rmi.server.ExportException: Port already in use: 0; 
> nested exception is:
>         java.net.BindException: Address already in use (Bind failed)
>         at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:346)
>         at
> sun.rmi.transport.tcp.TCPTransport.exportObject(TCPTransport.java:254)
>         at
> sun.rmi.transport.tcp.TCPEndpoint.exportObject(TCPEndpoint.java:411)
>         at sun.rmi.transport.LiveRef.exportObject(LiveRef.java:147)
>         at
> sun.rmi.server.UnicastServerRef.exportObject(UnicastServerRef.java:236)
>         at
> sun.management.jmxremote.ConnectorBootstrap$PermanentExporter.exportObject(ConnectorBootstrap.java:199)
>         at
> javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:146)
>         at
> javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:122)
>         at
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java:404)
>         at
> sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:550)
>         ... 3 more
> Caused by: java.net.BindException: Address already in use (Bind failed)
>         at java.net.PlainSocketImpl.socketBind(Native Method)
>         at java.net
> .AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
>         at java.net.ServerSocket.bind(ServerSocket.java:375)
>         at java.net.ServerSocket.<init>(ServerSocket.java:237)
>         at java.net.ServerSocket.<init>(ServerSocket.java:128)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory$1.<init>(LocalRMIServerSocketFactory.java:49)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory.createServerSocket(LocalRMIServerSocketFactory.java:49)
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newServerSocket(TCPEndpoint.java:666)
>         at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:335)
>         ... 12 more
>
>

Re: java.net.BindException: Address already in use (Bind failed) with kafka-topics command

Posted by kalai selvan <ka...@gmail.com>.
Hello,

Looks like your server is running out of ephemeral ports. The below command
confirms it is running out of ephemeral ports. We can restart the process
to solve the issue.  Must probably root cause of the issue will be wrong
configuration of mirror maker process / it is a bug.

netstat -an | wc -l

Regards,
Kalai

On Thu, 9 Jan, 2020, 10:46 AM JOHN, BIBIN, <bj...@att.com> wrote:

> Could you please let me know why sometimes I am getting, below exception?
> Cluster is up and running. Kafka and ZK is running in same server. We also
> have jmx exporter configured for monitoring.
>
> kafka-topics --zookeeper localhost:2181 --list
> Error: Exception thrown by the agent : java.rmi.server.ExportException:
> Port already in use: 0; nested exception is:
>         java.net.BindException: Address already in use (Bind failed)
> sun.management.AgentConfigurationError: java.rmi.server.ExportException:
> Port already in use: 0; nested exception is:
>         java.net.BindException: Address already in use (Bind failed)
>         at
> sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:553)
>         at sun.management.Agent.startLocalManagementAgent(Agent.java:137)
>         at sun.management.Agent.startAgent(Agent.java:265)
>         at sun.management.Agent.startAgent(Agent.java:452)
> Caused by: java.rmi.server.ExportException: Port already in use: 0; nested
> exception is:
>         java.net.BindException: Address already in use (Bind failed)
>         at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:346)
>         at
> sun.rmi.transport.tcp.TCPTransport.exportObject(TCPTransport.java:254)
>         at
> sun.rmi.transport.tcp.TCPEndpoint.exportObject(TCPEndpoint.java:411)
>         at sun.rmi.transport.LiveRef.exportObject(LiveRef.java:147)
>         at
> sun.rmi.server.UnicastServerRef.exportObject(UnicastServerRef.java:236)
>         at
> sun.management.jmxremote.ConnectorBootstrap$PermanentExporter.exportObject(ConnectorBootstrap.java:199)
>         at
> javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:146)
>         at
> javax.management.remote.rmi.RMIJRMPServerImpl.export(RMIJRMPServerImpl.java:122)
>         at
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java:404)
>         at
> sun.management.jmxremote.ConnectorBootstrap.startLocalConnectorServer(ConnectorBootstrap.java:550)
>         ... 3 more
> Caused by: java.net.BindException: Address already in use (Bind failed)
>         at java.net.PlainSocketImpl.socketBind(Native Method)
>         at java.net
> .AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
>         at java.net.ServerSocket.bind(ServerSocket.java:375)
>         at java.net.ServerSocket.<init>(ServerSocket.java:237)
>         at java.net.ServerSocket.<init>(ServerSocket.java:128)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory$1.<init>(LocalRMIServerSocketFactory.java:49)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory.createServerSocket(LocalRMIServerSocketFactory.java:49)
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newServerSocket(TCPEndpoint.java:666)
>         at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:335)
>         ... 12 more
>
>