You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by vishnu murali <vi...@gmail.com> on 2020/05/12 06:27:13 UTC

Custom Connector

Hi Guys,

i am trying to create a new connector for my own purpose.

Is there any guide or document which show how to create a own connector and
use?

Re: Custom Connector

Posted by Tom Bentley <tb...@redhat.com>.

Hi Vishnu,

I'm no expert on the Connector ecosystem, but I'm not aware of any source
connector which does that for some arbitrary (i.e. configurable) HTTP
endpoint. I suppose that's due to the difficulty of making it configurable
over the space of all endpoint behaviour (e.g. http methods, request paths,
request parameters, responses, errors etc). If you have no requirements on
the HTTP side it could be that an HTTP proxy is a better option for you (a
web search for "kafka http proxy" yields multiple options, but the
confluent one is most popular). On the other hand, if you have requirements
on the HTTP interaction (e.g. http methods, request paths, request
parameters, responses, errors etc) then writing your own connector is
probably the best option.

Kind regards,

Tom

On Tue, May 12, 2020 at 9:11 AM vishnu murali <vi...@gmail.com>
wrote:

> Thanks Tom
>
> I am  receiving data from  one Rest Endpoint and post that data from
> endpoint to topic.
>
>
> Is it possible or any other connector available for that?
>
> On Tue, May 12, 2020, 13:24 Tom Bentley <tb...@redhat.com> wrote:
>
> > Hi Vishnu,
> >
> > These are probably a good place to start:
> > 1. https://docs.confluent.io/current/connect/devguide.html
> > 2.
> >
> >
> https://www.confluent.io/blog/create-dynamic-kafka-connect-source-connectors/
> >
> > Cheers,
> >
> > Tom
> >
> >
> > On Tue, May 12, 2020 at 7:34 AM vishnu murali <
> vishnumurali9762@gmail.com>
> > wrote:
> >
> > > Hi Guys,
> > >
> > > i am trying to create a new connector for my own purpose.
> > >
> > > Is there any guide or document which show how to create a own connector
> > and
> > > use?
> > >
> >
>

Re: Custom Connector

Posted by vishnu murali <vi...@gmail.com>.

Thanks Tom

I am  receiving data from  one Rest Endpoint and post that data from
endpoint to topic.


Is it possible or any other connector available for that?

On Tue, May 12, 2020, 13:24 Tom Bentley <tb...@redhat.com> wrote:

> Hi Vishnu,
>
> These are probably a good place to start:
> 1. https://docs.confluent.io/current/connect/devguide.html
> 2.
>
> https://www.confluent.io/blog/create-dynamic-kafka-connect-source-connectors/
>
> Cheers,
>
> Tom
>
>
> On Tue, May 12, 2020 at 7:34 AM vishnu murali <vi...@gmail.com>
> wrote:
>
> > Hi Guys,
> >
> > i am trying to create a new connector for my own purpose.
> >
> > Is there any guide or document which show how to create a own connector
> and
> > use?
> >
>

Re: Custom Connector

Posted by Tom Bentley <tb...@redhat.com>.

Hi Vishnu,

These are probably a good place to start:
1. https://docs.confluent.io/current/connect/devguide.html
2.
https://www.confluent.io/blog/create-dynamic-kafka-connect-source-connectors/

Cheers,

Tom

On Tue, May 12, 2020 at 7:34 AM vishnu murali <vi...@gmail.com>
wrote:

> Hi Guys,
>
> i am trying to create a new connector for my own purpose.
>
> Is there any guide or document which show how to create a own connector and
> use?
>