You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Wang LongTian <lo...@outlook.com> on 2016/12/03 11:53:22 UTC

How to connect Modbus, DNP or IEC61850 data to Kafka

Dear all gurus,
I'm new to Kafka and I'm going to connect the real time data steaming from power system supervision and control devices to Kafka via different communication protocols for example Modbus, DNP or IEC61850 and next to Storm processing system. 
I'm wondering how can I get these data via Kafka and I don't know whether that's supported or not.

Any suggestion and hint are warmly welcomed!

Regards, 
Long Tian

How to collect connect metrcs

Posted by Will Du <wi...@gmail.com>.

Hi folks,
How I can collect Kafka connect metrics from Confluent? Are there any API to use?
In addition, if one file is very big, can multiple task working on the same file simultaneously?

Thanks，
Will

Re: How to connect Modbus, DNP or IEC61850 data to Kafka

Posted by ha...@confluent.io.

If the data volumes are low or you just want a quick prototype as a proof of concept you could use existing tools like node-red to connect the various input protocols with Kafka as an output protocol. For example install from http://nodered.org then install node-red-contrib-modbus, then install node-red-contrib-rdkafka, connect and configure the inputs and outputs and you will have data flow. Same with just about any serial, TCP, or UDP based protocol.

If you want something higher performance or industrial strength you can find commercial or open source Kafka Connectors or write your own native Kafka Connector for each input protocol. There are over 150 Kafka Connectors already built (search for "kafka-connect-*" in github) and see the following connector landing page for more info on Kafka Connect https://www.confluent.io/product/connectors/

-hans

Sent from my iPhone
> On Dec 3, 2016, at 3:53 AM, Wang LongTian <lo...@outlook.com> wrote:
> 
> Dear all gurus,
> I'm new to Kafka and I'm going to connect the real time data steaming from power system supervision and control devices to Kafka via different communication protocols for example Modbus, DNP or IEC61850 and next to Storm processing system. 
> I'm wondering how can I get these data via Kafka and I don't know whether that's supported or not.
> 
> Any suggestion and hint are warmly welcomed!
> 
> Regards, 
> Long Tian
> 
>