You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Taha Arif <ta...@gmail.com> on 2017/11/07 20:31:06 UTC

Using Kafka to access APIs.

Hello,


I want to build a project that accesses the Gdax websocket in a real time
stream, and push that data into Kafka to reformat it and prep it for a ML
model.

*Can I use Kafka to access GDAX's API and pull data from it in realtime?*

or

*Should I pull data from their API to a text file in real time and use
kafka to read that text file as it changes?*


 Also!

*Please clarify for my sanity, Kafka is not a language, it is a set of APIs
that can be used from any language?*

Thanks
*\\Taha*

Re: Using Kafka to access APIs.

Posted by Ted Yu <yu...@gmail.com>.

I think how to use GDAX's API is orthogonal to using Kafka.

Kafka client has support for Java and Python.

On Tue, Nov 7, 2017 at 12:31 PM, Taha Arif <ta...@gmail.com> wrote:

> Hello,
>
>
> I want to build a project that accesses the Gdax websocket in a real time
> stream, and push that data into Kafka to reformat it and prep it for a ML
> model.
>
> *Can I use Kafka to access GDAX's API and pull data from it in realtime?*
>
> or
>
> *Should I pull data from their API to a text file in real time and use
> kafka to read that text file as it changes?*
>
>
>  Also!
>
> *Please clarify for my sanity, Kafka is not a language, it is a set of APIs
> that can be used from any language?*
>
> Thanks
> *\\Taha*
>