You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by wei <sw...@gmail.com> on 2017/03/02 22:44:54 UTC
how to produce/consume kafka through ssh tunnel
We have kafka setup on staging environment, when debug the consumer we want
to directly listen to the kafka on staging environment. I set tunnel but it
seems i can't produce or consume from my local machine. I can create topic
though. I have no problem to produce/consumer on other machine in staging
environment.
kafka version: kafka_2.12-0.10.2.0
kafka setup: port 9090/9091 on host 192.168.10.110 on staging environment
zookeeper: port 2181 on 192.168.10.58
tunnelling: -L 9090:192.168.10.110:9090 -L 9091:192.168.10.110:9091 -L 2181:
192.168.10.58:2181
$ bin/kafka-console-producer.sh --broker-list localhost:9091 --topic test
test msg
[2017-03-02 14:43:21,414] ERROR Error when sending message to topic test
with key: null, value: 8 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for
test-0: 1503 ms has passed since batch creation plus linger time
Re: how to produce/consume kafka through ssh tunnel
Posted by Daniel Aparecido Martins Rosa <da...@daniel.eti.br>.
Hi wei,
I´m having the similar problem, but though VPN IPSec. If you solve this
problem, let me know please. I´ll do the same.
Thanks,
2017-03-02 19:44 GMT-03:00 wei <sw...@gmail.com>:
> We have kafka setup on staging environment, when debug the consumer we want
> to directly listen to the kafka on staging environment. I set tunnel but it
> seems i can't produce or consume from my local machine. I can create topic
> though. I have no problem to produce/consumer on other machine in staging
> environment.
>
> kafka version: kafka_2.12-0.10.2.0
> kafka setup: port 9090/9091 on host 192.168.10.110 on staging environment
> zookeeper: port 2181 on 192.168.10.58
> tunnelling: -L 9090:192.168.10.110:9090 -L 9091:192.168.10.110:9091 -L
> 2181:
> 192.168.10.58:2181
>
> $ bin/kafka-console-producer.sh --broker-list localhost:9091 --topic test
> test msg
> [2017-03-02 14:43:21,414] ERROR Error when sending message to topic test
> with key: null, value: 8 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for
> test-0: 1503 ms has passed since batch creation plus linger time
>