You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Lukas Banduch <lu...@aixigo.de> on 2016/02/19 13:11:31 UTC
Kafka 0.9.0.0 on Solaris 5.10 not running
Hi,
I'm desperately trying to run Kafka 0.9.0.0 on Solaris 5.10 (Kafka 0.8.2
is working fine). I use 1 Broker with default configuration just as in
the quickstart guide.
The Broker is not working and I see SocketTimeoutExceptions in the
controller.log.
Kafka is running on Java 1.8, Filesystem is ufs
Exception from controller.log:
[2016-02-19 11:59:23,274] WARN [Controller-0-to-broker-0-send-thread],
Controller 0's connection to broker Node(0, srvs010.ac.aixigo.de, 9093)
was unsuccessful (kafka.controller.RequestSendThread)
java.net.SocketTimeoutException: Failed to connect within 30000 ms
at
kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:228)
at
kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:172)
at
kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:171)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
The entire logs are attatched.
Thanks in advance
<https://dict.leo.org/ende/index_en.html#/search=desperately&searchLoc=0&resultOrder=basic&multiwordShowSingle=on>
--
aixigo AG - einfach. besser. beraten
Karl-Friedrich-Straße 68, 52072 Aachen, Germany
fon: +49 (0)241 559709-364, fax: +49 (0)241 559709-99
eMail: lukas.banduch@aixigo.de, web: http://www.aixigo.de
Amtsgericht Aachen - HRB 8057
Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
Vors. des Aufsichtsrates: Prof. Dr. Rüdiger von Nitzsch
Re: Kafka 0.9.0.0 on Solaris 5.10 not running
Posted by Marcus Gründler <ma...@aixigo.de>.
Hi Ismael,
Yes, producers (and consumers) work just fine on 0.8.2.
We see the exceptions even without any producer/consumers. The problem can be reproduced easily - I just start the following scripts an wait for 30 seconds:
bin/kafka-zookeeper-start.sh path/to/zkconf
bin/kafka-server-start.sh path/to/server.properties
Nothing else is running at this point - we just wait and see the SocketTimeoutException every 30 seconds. As I mentioned before, this only happens on Solaris, on Linux and MacOS everything is fine.
Regards, Marcus
--
aixigo AG - einfach. besser. beraten
Karl-Friedrich-Straße 68, 52072 Aachen, Germany
fon: +49 (0)241 559709-43, fax: +49 (0)241 559709-99
eMail: marcus.gruendler@aixigo.de, web: http://www.aixigo.de
Amtsgericht Aachen - HRB 8057
Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
Vors. des Aufsichtsrates: Prof. Dr. Rüdiger von Nitzsch
> Am 22.02.2016 um 17:32 schrieb Ismael Juma <is...@juma.me.uk>:
>
> Hi Marcus,
>
> One thing that changed in 0.9.0.0 is that we now use `NetworkClient` for
> inter-broker communication. `NetworkClient` is also used by the new Java
> producer and consumer. Does the Java producer in 0.8.2 work fine for you?
>
> Ismael
>
> On Mon, Feb 22, 2016 at 3:06 PM, Marcus Gründler <marcus.gruendler@aixigo.de
>> wrote:
>
>> Hi All,
>>
>> the same happens for Kafka 0.9.0.1. The controller is unable to setup a
>> connection on the local machine. I tried to set the following
>> configurations in config/server.properties
>>
>> host.name=localhost
>> advertised.host.name=localhost
>> controller.socket.timeout.ms=245000
>>
>> without any luck. The SocketTimeoutExceptions can be observed every 30
>> seconds in the controller.log. At every exception I can see another TCP
>> TIME_WAIT entry in netstat | grep 9092.
>>
>> It seems that there ist some new behavior in the connection code between
>> controller and broker that has changed since 0.8.2.
>>
>> Does anybody have an idea on how to fix it?
>>
>> Regards, Marcus
>>
>>
>>> Am 19.02.2016 um 13:11 schrieb Lukas Banduch <lu...@aixigo.de>:
>>>
>>> Hi,
>>>
>>> I'm desperately trying to run Kafka 0.9.0.0 on Solaris 5.10 (Kafka 0.8.2
>> is working fine). I use 1 Broker with default configuration just as in the
>> quickstart guide.
>>> The Broker is not working and I see SocketTimeoutExceptions in the
>> controller.log.
>>>
>>> Kafka is running on Java 1.8,B Filesystem is ufs
>>>
>>> Exception from controller.log:
>>>
>>> [2016-02-19 11:59:23,274] WARN [Controller-0-to-broker-0-send-thread],
>> Controller 0's connection to broker Node(0, srvs010.ac.aixigo.de, 9093)
>> was unsuccessful (kafka.controller.RequestSendThread)
>>> java.net.SocketTimeoutException: Failed to connect within 30000 ms
>>> B B B at
>> kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:228)
>>> B B B at
>> kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:172)
>>> B B B at
>> kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:171)
>>> B B B at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
>>>
>>> The entire logs are attatched.
>>>
>>> Thanks in advance
>>>
>>> --
>>> aixigo AG - einfach. besser. beraten
>>> Karl-Friedrich-StraC e 68, 52072 Aachen, Germany
>>> fon: +49 (0)241 559709-364, fax: +49 (0)241 559709-99
>>> eMail:
>>> lukas.banduch@aixigo.de, web: http://www.aixigo.de
>>>
>>>
>>> Amtsgericht Aachen - HRB 8057
>>> Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
>>> Vors. des Aufsichtsrates: Prof. Dr. RC
>>>
>>> <controller.log.2016-02-19-11><server.log.2016-02-19-11>
>>
>> --
>>
>> aixigo AG - einfach. besser. beraten
>> Karl-Friedrich-Straße 68, 52072 Aachen, Germany
>> fon: +49 (0)241 559709-43, fax: +49 (0)241 559709-99
>> eMail: marcus.gruendler@aixigo.de, web: http://www.aixigo.de
>>
>> Amtsgericht Aachen - HRB 8057
>> Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
>> Vors. des Aufsichtsrates: Prof. Dr. Rüdiger von Nitzsch
>>
>>
Re: Kafka 0.9.0.0 on Solaris 5.10 not running
Posted by Ismael Juma <is...@juma.me.uk>.
Hi Marcus,
One thing that changed in 0.9.0.0 is that we now use `NetworkClient` for
inter-broker communication. `NetworkClient` is also used by the new Java
producer and consumer. Does the Java producer in 0.8.2 work fine for you?
Ismael
On Mon, Feb 22, 2016 at 3:06 PM, Marcus Gründler <marcus.gruendler@aixigo.de
> wrote:
> Hi All,
>
> the same happens for Kafka 0.9.0.1. The controller is unable to setup a
> connection on the local machine. I tried to set the following
> configurations in config/server.properties
>
> host.name=localhost
> advertised.host.name=localhost
> controller.socket.timeout.ms=245000
>
> without any luck. The SocketTimeoutExceptions can be observed every 30
> seconds in the controller.log. At every exception I can see another TCP
> TIME_WAIT entry in netstat | grep 9092.
>
> It seems that there ist some new behavior in the connection code between
> controller and broker that has changed since 0.8.2.
>
> Does anybody have an idea on how to fix it?
>
> Regards, Marcus
>
>
> > Am 19.02.2016 um 13:11 schrieb Lukas Banduch <lu...@aixigo.de>:
> >
> > Hi,
> >
> > I'm desperately trying to run Kafka 0.9.0.0 on Solaris 5.10 (Kafka 0.8.2
> is working fine). I use 1 Broker with default configuration just as in the
> quickstart guide.
> > The Broker is not working and I see SocketTimeoutExceptions in the
> controller.log.
> >
> > Kafka is running on Java 1.8,B Filesystem is ufs
> >
> > Exception from controller.log:
> >
> > [2016-02-19 11:59:23,274] WARN [Controller-0-to-broker-0-send-thread],
> Controller 0's connection to broker Node(0, srvs010.ac.aixigo.de, 9093)
> was unsuccessful (kafka.controller.RequestSendThread)
> > java.net.SocketTimeoutException: Failed to connect within 30000 ms
> > B B B at
> kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:228)
> > B B B at
> kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:172)
> > B B B at
> kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:171)
> > B B B at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
> >
> > The entire logs are attatched.
> >
> > Thanks in advance
> >
> > --
> > aixigo AG - einfach. besser. beraten
> > Karl-Friedrich-StraC e 68, 52072 Aachen, Germany
> > fon: +49 (0)241 559709-364, fax: +49 (0)241 559709-99
> > eMail:
> > lukas.banduch@aixigo.de, web: http://www.aixigo.de
> >
> >
> > Amtsgericht Aachen - HRB 8057
> > Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
> > Vors. des Aufsichtsrates: Prof. Dr. RC
> >
> > <controller.log.2016-02-19-11><server.log.2016-02-19-11>
>
> --
>
> aixigo AG - einfach. besser. beraten
> Karl-Friedrich-Straße 68, 52072 Aachen, Germany
> fon: +49 (0)241 559709-43, fax: +49 (0)241 559709-99
> eMail: marcus.gruendler@aixigo.de, web: http://www.aixigo.de
>
> Amtsgericht Aachen - HRB 8057
> Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
> Vors. des Aufsichtsrates: Prof. Dr. Rüdiger von Nitzsch
>
>
Re: Kafka 0.9.0.0 on Solaris 5.10 not running
Posted by Marcus Gründler <ma...@aixigo.de>.
Hi All,
the same happens for Kafka 0.9.0.1. The controller is unable to setup a connection on the local machine. I tried to set the following configurations in config/server.properties
host.name=localhost
advertised.host.name=localhost
controller.socket.timeout.ms=245000
without any luck. The SocketTimeoutExceptions can be observed every 30 seconds in the controller.log. At every exception I can see another TCP TIME_WAIT entry in netstat | grep 9092.
It seems that there ist some new behavior in the connection code between controller and broker that has changed since 0.8.2.
Does anybody have an idea on how to fix it?
Regards, Marcus
> Am 19.02.2016 um 13:11 schrieb Lukas Banduch <lu...@aixigo.de>:
>
> Hi,
>
> I'm desperately trying to run Kafka 0.9.0.0 on Solaris 5.10 (Kafka 0.8.2 is working fine). I use 1 Broker with default configuration just as in the quickstart guide.
> The Broker is not working and I see SocketTimeoutExceptions in the controller.log.
>
> Kafka is running on Java 1.8,B Filesystem is ufs
>
> Exception from controller.log:
>
> [2016-02-19 11:59:23,274] WARN [Controller-0-to-broker-0-send-thread], Controller 0's connection to broker Node(0, srvs010.ac.aixigo.de, 9093) was unsuccessful (kafka.controller.RequestSendThread)
> java.net.SocketTimeoutException: Failed to connect within 30000 ms
> B B B at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:228)
> B B B at kafka.controller.RequestSendThread.liftedTree1$1(ControllerChannelManager.scala:172)
> B B B at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:171)
> B B B at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
>
> The entire logs are attatched.
>
> Thanks in advance
>
> --
> aixigo AG - einfach. besser. beraten
> Karl-Friedrich-StraC e 68, 52072 Aachen, Germany
> fon: +49 (0)241 559709-364, fax: +49 (0)241 559709-99
> eMail:
> lukas.banduch@aixigo.de, web: http://www.aixigo.de
>
>
> Amtsgericht Aachen - HRB 8057
> Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
> Vors. des Aufsichtsrates: Prof. Dr. RC
>
> <controller.log.2016-02-19-11><server.log.2016-02-19-11>
--
aixigo AG - einfach. besser. beraten
Karl-Friedrich-Straße 68, 52072 Aachen, Germany
fon: +49 (0)241 559709-43, fax: +49 (0)241 559709-99
eMail: marcus.gruendler@aixigo.de, web: http://www.aixigo.de
Amtsgericht Aachen - HRB 8057
Vorstand: Erich Borsch, Christian Friedrich, Tobias Haustein
Vors. des Aufsichtsrates: Prof. Dr. Rüdiger von Nitzsch