You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jagannath Bilgi <js...@yahoo.com.INVALID> on 2018/05/03 18:22:26 UTC
Kafka-connect
Hi Team,
Trying to load data from Cassandra to Kafka using kafka-connect. Tried results from Google search. However unable to complete successfully.
Could you please help me in resolving this.
Note : trying to deploy using Docker.
Thanks and regards
Jagannath S Bilgi
Re: Fw: Re: Kafka-connect
Posted by Burton Williams <bu...@gmail.com>.
good to see that you've got it figured out, almost. Is there data in
Cassandra? did you check that? I have never used the Cassandra connector,
so i don't know if you've set it up correctly. you'll have to start by
checking at the source for data. Thats all I can help with at this point.
Sorry
-B
On Wed, May 9, 2018 at 3:29 AM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Thank you Williams.
> Tried in different way and able to add Cassandra connector.
> However unable to fetch data in console. Below are details.
> {"name": "packs2","config" : { "tasks.max": "1", "connector.class" :
> "com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceConnector",
> "connect.cassandra.contact.points" : "localhost",
> "connect.cassandra.port" : 9042, "connect.cassandra.username" :
> "cassandra", "connect.cassandra.password" : "cassandra", "connect.cassandra.consistency.level"
> : "LOCAL_ONE", "connect.cassandra.key.space" : "blog",
> "connect.cassandra.import.mode" : "incremental",
> "connect.cassandra.kcql" : "INSERT INTO test_topic SELECT event_data,
> event_ts FROM pack_events IGNORE event_ts PK event_ts WITHUNWRAP
> INCREMENTALMODE=TIMESTAMP", "connect.cassandra.initial.offset" :
> "2018-01-22 00:00:00.0000000Z", "connect.cassandra.import.poll.interval"
> : 1000 }}
> root@0299b340104c:/confluent-4.1.0# curl localhost:8083/connectors["
> packs2"]root@0299b340104c:/confluent-4.1.0#
> kafka-console-consumer --bootstrap-server localhost:9092 --topic
> test_topic (no output)
> connect log[2018-05-08 05:13:07,996] INFO Connector packs2 start of poll
> queue size for pack_events is: 0 (com.datamountaineer.
> streamreactor.connect.cassandra.source.CassandraSourceTask:138)[2018-05-08
> 05:13:07,996] INFO Connector packs2 query SELECT event_data,event_ts FROM
> blog.pack_events WHERE event_ts > ? AND event_ts <= ? ALLOW FILTERING
> executing with bindings (2018-01-22T00:00:00Z, 2018-01-22T00:08:25Z).
> (com.datamountaineer.streamreactor.connect.cassandra.source.
> CassandraTableReader:174)[2018-05-08 05:13:07,998] INFO Connector packs2
> end of poll queue size for pack_events is: 0 (com.datamountaineer.
> streamreactor.connect.cassandra.source.CassandraSourceTask:164)[2018-05-08
> 05:13:07,999] INFO Connector packs2 processing results for
> blog.pack_events. (com.datamountaineer.streamreactor.connect.
> cassandra.source.CassandraTableReader:217)[2018-05-08 05:13:07,999] INFO
> Connector packs2 processed 0 row(-s) into test_topic topic for table
> pack_events (com.datamountaineer.streamreactor.connect.cassandra.source.
> CassandraTableReader:251)
> cassandra Datacqlsh:blog> select * from pack_events;
> event_id | event_ts | event_data----------+---------
> ------------------------+--------------- 500 | 2018-01-22
> 20:28:50.869000+0000 | {"foo":"bar"} 501 | 2018-05-08
> 20:28:50.869000+0000 | {"foo":"bar"}(2 rows)
>
> No change in result even after removing offset property
> Please review and advise
> Thanks and regards
> Jagannath S Bilgi
>
>
>
> On Tuesday, May 8, 2018, 9:30:18 PM GMT+5:30, Burton Williams <
> burton.b.williams@gmail.com> wrote:
>
> Its clear you're not setting up your docker image correctly. Can you draw
> out your directory structure that you build the docker image from? and
> provide the contents of your Dockerfile
>
> -B
>
> On Sat, May 5, 2018 at 12:55 PM, Jagannath Bilgi <jsbilgi@yahoo.com.invalid
> >
> wrote:
>
> > Thank you.
> > However that is command prompt.
> > Tried below options. However none of them worked.
> > ./bin/zookeeper-server-start.sh config/zookeeper.properties sh
> > ./bin/zookeeper-server-start.sh config/zookeeper.properties (it fails
> > with bin/kafka-run-class.sh not found) Included kafka installation
> > directory to path
> > Thanks and regards
> > Jagannath S Bilgi
> >
> >
> > On Saturday, May 5, 2018, 4:36:09 PM GMT+5:30, Burton Williams <
> > burton.b.williams@gmail.com> wrote:
> >
> > Your ZK path is incorrect. It has a `#` vs a '/' in it. Try changing
> that.
> >
> > -B
> >
> > On Fri, May 4, 2018 at 12:41 AM, Jagannath Bilgi
> <jsbilgi@yahoo.com.invalid
> > >
> > wrote:
> >
> > > Hi Williams,
> > >
> > > Thank you for quick reply.
> > >
> > > I am new to Kafka and stream processing. Wanted to implement solution
> > > through docker. It is expected to contain Zookeeper, Kafka,
> > Kafkka-Connect
> > > and Cassandra.
> > >
> > > Tried example from Getting started with the Kafka Connect Cassandra
> > Source
> > > <https://medium.com/walmartlabs/getting-started-
> with-the-kafka-connect-
> > cassandra-source-e6e06ec72e97>
> > >
> > > Unable to proceed further as getting below error while starting kafka.
> > >
> > > root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh
> > > config/server.properties
> > > -sh: bin/zookeeper-server-start.sh: not found
> > >
> > > Below is uname -a output
> > > Linux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018
> > > x86_64 GNU/Linux
> > >
> > >
> > > Thanks and regards
> > >
> > > Jagannath S Bilgi
> > >
> > >
> > >
> > > ----- Forwarded Message -----
> > > *From:* Jagannath Bilgi <js...@yahoo.com>
> > > *To:* "users@kafka.apache.org" <us...@kafka.apache.org>
> > > *Sent:* Friday, May 4, 2018, 9:58:53 AM GMT+5:30
> > > *Subject:* Re: Kafka-connect
> > >
> > > Hi Williams,
> > >
> > > Thank you for quick reply.
> > >
> > > Wanted to implement solution through docker. It is expected to contain
> > > Zookeeper, Kafka, Kafkka-Connect and Cassandra.
> > >
> > > Tried example in Getting started with the Kafka Connect Cassandra
> Source
> > > <https://medium.com/walmartlabs/getting-started-
> with-the-kafka-connect-
> > cassandra-source-e6e06ec72e97>
> > >
> > > Getting below error while starting kafka.
> > >
> > > [image: Inline image]
> > >
> > >
> > > [image: Inline image]
> > >
> > > Thanks and regards
> > >
> > > Jagannath S Bilgi
> > >
> > >
> > > On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <
> > > burton.b.williams@gmail.com> wrote:
> > >
> > >
> > > whats in docker? kafka? kafka-connnect? Did you try setting up outside
> > of a
> > > container first?
> > >
> > > -B
> > >
> > > On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi
> > <jsbilgi@yahoo.com.invalid
> > > >
> > > wrote:
> > >
> > > > Hi Team,
> > > > Trying to load data from Cassandra to Kafka using kafka-connect.
> Tried
> > > > results from Google search. However unable to complete successfully.
> > > >
> > > > Could you please help me in resolving this.
> > > > Note : trying to deploy using Docker.
> > > > Thanks and regards
> > > >
> > > > Jagannath S Bilgi
> > > >
> > >
> >
> >
>
>
Re: Fw: Re: Kafka-connect
Posted by Jagannath Bilgi <js...@yahoo.com.INVALID>.
Thank you Williams.
Tried in different way and able to add Cassandra connector.
However unable to fetch data in console. Below are details.
{"name": "packs2","config" : { "tasks.max": "1", "connector.class" : "com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceConnector", "connect.cassandra.contact.points" : "localhost", "connect.cassandra.port" : 9042, "connect.cassandra.username" : "cassandra", "connect.cassandra.password" : "cassandra", "connect.cassandra.consistency.level" : "LOCAL_ONE", "connect.cassandra.key.space" : "blog", "connect.cassandra.import.mode" : "incremental", "connect.cassandra.kcql" : "INSERT INTO test_topic SELECT event_data, event_ts FROM pack_events IGNORE event_ts PK event_ts WITHUNWRAP INCREMENTALMODE=TIMESTAMP", "connect.cassandra.initial.offset" : "2018-01-22 00:00:00.0000000Z", "connect.cassandra.import.poll.interval" : 1000 }}
root@0299b340104c:/confluent-4.1.0# curl localhost:8083/connectors["packs2"]root@0299b340104c:/confluent-4.1.0#
kafka-console-consumer --bootstrap-server localhost:9092 --topic test_topic (no output)
connect log[2018-05-08 05:13:07,996] INFO Connector packs2 start of poll queue size for pack_events is: 0 (com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceTask:138)[2018-05-08 05:13:07,996] INFO Connector packs2 query SELECT event_data,event_ts FROM blog.pack_events WHERE event_ts > ? AND event_ts <= ? ALLOW FILTERING executing with bindings (2018-01-22T00:00:00Z, 2018-01-22T00:08:25Z). (com.datamountaineer.streamreactor.connect.cassandra.source.CassandraTableReader:174)[2018-05-08 05:13:07,998] INFO Connector packs2 end of poll queue size for pack_events is: 0 (com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceTask:164)[2018-05-08 05:13:07,999] INFO Connector packs2 processing results for blog.pack_events. (com.datamountaineer.streamreactor.connect.cassandra.source.CassandraTableReader:217)[2018-05-08 05:13:07,999] INFO Connector packs2 processed 0 row(-s) into test_topic topic for table pack_events (com.datamountaineer.streamreactor.connect.cassandra.source.CassandraTableReader:251)
cassandra Datacqlsh:blog> select * from pack_events;
event_id | event_ts | event_data----------+---------------------------------+--------------- 500 | 2018-01-22 20:28:50.869000+0000 | {"foo":"bar"} 501 | 2018-05-08 20:28:50.869000+0000 | {"foo":"bar"}(2 rows)
No change in result even after removing offset property
Please review and advise
Thanks and regards
Jagannath S Bilgi
On Tuesday, May 8, 2018, 9:30:18 PM GMT+5:30, Burton Williams <bu...@gmail.com> wrote:
Its clear you're not setting up your docker image correctly. Can you draw
out your directory structure that you build the docker image from? and
provide the contents of your Dockerfile
-B
On Sat, May 5, 2018 at 12:55 PM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Thank you.
> However that is command prompt.
> Tried below options. However none of them worked.
> ./bin/zookeeper-server-start.sh config/zookeeper.properties sh
> ./bin/zookeeper-server-start.sh config/zookeeper.properties (it fails
> with bin/kafka-run-class.sh not found) Included kafka installation
> directory to path
> Thanks and regards
> Jagannath S Bilgi
>
>
> On Saturday, May 5, 2018, 4:36:09 PM GMT+5:30, Burton Williams <
> burton.b.williams@gmail.com> wrote:
>
> Your ZK path is incorrect. It has a `#` vs a '/' in it. Try changing that.
>
> -B
>
> On Fri, May 4, 2018 at 12:41 AM, Jagannath Bilgi <jsbilgi@yahoo.com.invalid
> >
> wrote:
>
> > Hi Williams,
> >
> > Thank you for quick reply.
> >
> > I am new to Kafka and stream processing. Wanted to implement solution
> > through docker. It is expected to contain Zookeeper, Kafka,
> Kafkka-Connect
> > and Cassandra.
> >
> > Tried example from Getting started with the Kafka Connect Cassandra
> Source
> > <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-
> cassandra-source-e6e06ec72e97>
> >
> > Unable to proceed further as getting below error while starting kafka.
> >
> > root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh
> > config/server.properties
> > -sh: bin/zookeeper-server-start.sh: not found
> >
> > Below is uname -a output
> > Linux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018
> > x86_64 GNU/Linux
> >
> >
> > Thanks and regards
> >
> > Jagannath S Bilgi
> >
> >
> >
> > ----- Forwarded Message -----
> > *From:* Jagannath Bilgi <js...@yahoo.com>
> > *To:* "users@kafka.apache.org" <us...@kafka.apache.org>
> > *Sent:* Friday, May 4, 2018, 9:58:53 AM GMT+5:30
> > *Subject:* Re: Kafka-connect
> >
> > Hi Williams,
> >
> > Thank you for quick reply.
> >
> > Wanted to implement solution through docker. It is expected to contain
> > Zookeeper, Kafka, Kafkka-Connect and Cassandra.
> >
> > Tried example in Getting started with the Kafka Connect Cassandra Source
> > <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-
> cassandra-source-e6e06ec72e97>
> >
> > Getting below error while starting kafka.
> >
> > [image: Inline image]
> >
> >
> > [image: Inline image]
> >
> > Thanks and regards
> >
> > Jagannath S Bilgi
> >
> >
> > On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <
> > burton.b.williams@gmail.com> wrote:
> >
> >
> > whats in docker? kafka? kafka-connnect? Did you try setting up outside
> of a
> > container first?
> >
> > -B
> >
> > On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi
> <jsbilgi@yahoo.com.invalid
> > >
> > wrote:
> >
> > > Hi Team,
> > > Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> > > results from Google search. However unable to complete successfully.
> > >
> > > Could you please help me in resolving this.
> > > Note : trying to deploy using Docker.
> > > Thanks and regards
> > >
> > > Jagannath S Bilgi
> > >
> >
>
>
Re: Fw: Re: Kafka-connect
Posted by Burton Williams <bu...@gmail.com>.
Its clear you're not setting up your docker image correctly. Can you draw
out your directory structure that you build the docker image from? and
provide the contents of your Dockerfile
-B
On Sat, May 5, 2018 at 12:55 PM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Thank you.
> However that is command prompt.
> Tried below options. However none of them worked.
> ./bin/zookeeper-server-start.sh config/zookeeper.properties sh
> ./bin/zookeeper-server-start.sh config/zookeeper.properties (it fails
> with bin/kafka-run-class.sh not found) Included kafka installation
> directory to path
> Thanks and regards
> Jagannath S Bilgi
>
>
> On Saturday, May 5, 2018, 4:36:09 PM GMT+5:30, Burton Williams <
> burton.b.williams@gmail.com> wrote:
>
> Your ZK path is incorrect. It has a `#` vs a '/' in it. Try changing that.
>
> -B
>
> On Fri, May 4, 2018 at 12:41 AM, Jagannath Bilgi <jsbilgi@yahoo.com.invalid
> >
> wrote:
>
> > Hi Williams,
> >
> > Thank you for quick reply.
> >
> > I am new to Kafka and stream processing. Wanted to implement solution
> > through docker. It is expected to contain Zookeeper, Kafka,
> Kafkka-Connect
> > and Cassandra.
> >
> > Tried example from Getting started with the Kafka Connect Cassandra
> Source
> > <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-
> cassandra-source-e6e06ec72e97>
> >
> > Unable to proceed further as getting below error while starting kafka.
> >
> > root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh
> > config/server.properties
> > -sh: bin/zookeeper-server-start.sh: not found
> >
> > Below is uname -a output
> > Linux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018
> > x86_64 GNU/Linux
> >
> >
> > Thanks and regards
> >
> > Jagannath S Bilgi
> >
> >
> >
> > ----- Forwarded Message -----
> > *From:* Jagannath Bilgi <js...@yahoo.com>
> > *To:* "users@kafka.apache.org" <us...@kafka.apache.org>
> > *Sent:* Friday, May 4, 2018, 9:58:53 AM GMT+5:30
> > *Subject:* Re: Kafka-connect
> >
> > Hi Williams,
> >
> > Thank you for quick reply.
> >
> > Wanted to implement solution through docker. It is expected to contain
> > Zookeeper, Kafka, Kafkka-Connect and Cassandra.
> >
> > Tried example in Getting started with the Kafka Connect Cassandra Source
> > <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-
> cassandra-source-e6e06ec72e97>
> >
> > Getting below error while starting kafka.
> >
> > [image: Inline image]
> >
> >
> > [image: Inline image]
> >
> > Thanks and regards
> >
> > Jagannath S Bilgi
> >
> >
> > On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <
> > burton.b.williams@gmail.com> wrote:
> >
> >
> > whats in docker? kafka? kafka-connnect? Did you try setting up outside
> of a
> > container first?
> >
> > -B
> >
> > On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi
> <jsbilgi@yahoo.com.invalid
> > >
> > wrote:
> >
> > > Hi Team,
> > > Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> > > results from Google search. However unable to complete successfully.
> > >
> > > Could you please help me in resolving this.
> > > Note : trying to deploy using Docker.
> > > Thanks and regards
> > >
> > > Jagannath S Bilgi
> > >
> >
>
>
Re: Fw: Re: Kafka-connect
Posted by Jagannath Bilgi <js...@yahoo.com.INVALID>.
Thank you.
However that is command prompt.
Tried below options. However none of them worked.
./bin/zookeeper-server-start.sh config/zookeeper.properties sh ./bin/zookeeper-server-start.sh config/zookeeper.properties (it fails with bin/kafka-run-class.sh not found) Included kafka installation directory to path
Thanks and regards
Jagannath S Bilgi
On Saturday, May 5, 2018, 4:36:09 PM GMT+5:30, Burton Williams <bu...@gmail.com> wrote:
Your ZK path is incorrect. It has a `#` vs a '/' in it. Try changing that.
-B
On Fri, May 4, 2018 at 12:41 AM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Hi Williams,
>
> Thank you for quick reply.
>
> I am new to Kafka and stream processing. Wanted to implement solution
> through docker. It is expected to contain Zookeeper, Kafka, Kafkka-Connect
> and Cassandra.
>
> Tried example from Getting started with the Kafka Connect Cassandra Source
> <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-cassandra-source-e6e06ec72e97>
>
> Unable to proceed further as getting below error while starting kafka.
>
> root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh
> config/server.properties
> -sh: bin/zookeeper-server-start.sh: not found
>
> Below is uname -a output
> Linux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018
> x86_64 GNU/Linux
>
>
> Thanks and regards
>
> Jagannath S Bilgi
>
>
>
> ----- Forwarded Message -----
> *From:* Jagannath Bilgi <js...@yahoo.com>
> *To:* "users@kafka.apache.org" <us...@kafka.apache.org>
> *Sent:* Friday, May 4, 2018, 9:58:53 AM GMT+5:30
> *Subject:* Re: Kafka-connect
>
> Hi Williams,
>
> Thank you for quick reply.
>
> Wanted to implement solution through docker. It is expected to contain
> Zookeeper, Kafka, Kafkka-Connect and Cassandra.
>
> Tried example in Getting started with the Kafka Connect Cassandra Source
> <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-cassandra-source-e6e06ec72e97>
>
> Getting below error while starting kafka.
>
> [image: Inline image]
>
>
> [image: Inline image]
>
> Thanks and regards
>
> Jagannath S Bilgi
>
>
> On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <
> burton.b.williams@gmail.com> wrote:
>
>
> whats in docker? kafka? kafka-connnect? Did you try setting up outside of a
> container first?
>
> -B
>
> On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi <jsbilgi@yahoo.com.invalid
> >
> wrote:
>
> > Hi Team,
> > Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> > results from Google search. However unable to complete successfully.
> >
> > Could you please help me in resolving this.
> > Note : trying to deploy using Docker.
> > Thanks and regards
> >
> > Jagannath S Bilgi
> >
>
Re: Fw: Re: Kafka-connect
Posted by Burton Williams <bu...@gmail.com>.
Your ZK path is incorrect. It has a `#` vs a '/' in it. Try changing that.
-B
On Fri, May 4, 2018 at 12:41 AM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Hi Williams,
>
> Thank you for quick reply.
>
> I am new to Kafka and stream processing. Wanted to implement solution
> through docker. It is expected to contain Zookeeper, Kafka, Kafkka-Connect
> and Cassandra.
>
> Tried example from Getting started with the Kafka Connect Cassandra Source
> <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-cassandra-source-e6e06ec72e97>
>
> Unable to proceed further as getting below error while starting kafka.
>
> root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh
> config/server.properties
> -sh: bin/zookeeper-server-start.sh: not found
>
> Below is uname -a output
> Linux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018
> x86_64 GNU/Linux
>
>
> Thanks and regards
>
> Jagannath S Bilgi
>
>
>
> ----- Forwarded Message -----
> *From:* Jagannath Bilgi <js...@yahoo.com>
> *To:* "users@kafka.apache.org" <us...@kafka.apache.org>
> *Sent:* Friday, May 4, 2018, 9:58:53 AM GMT+5:30
> *Subject:* Re: Kafka-connect
>
> Hi Williams,
>
> Thank you for quick reply.
>
> Wanted to implement solution through docker. It is expected to contain
> Zookeeper, Kafka, Kafkka-Connect and Cassandra.
>
> Tried example in Getting started with the Kafka Connect Cassandra Source
> <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-cassandra-source-e6e06ec72e97>
>
> Getting below error while starting kafka.
>
> [image: Inline image]
>
>
> [image: Inline image]
>
> Thanks and regards
>
> Jagannath S Bilgi
>
>
> On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <
> burton.b.williams@gmail.com> wrote:
>
>
> whats in docker? kafka? kafka-connnect? Did you try setting up outside of a
> container first?
>
> -B
>
> On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi <jsbilgi@yahoo.com.invalid
> >
> wrote:
>
> > Hi Team,
> > Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> > results from Google search. However unable to complete successfully.
> >
> > Could you please help me in resolving this.
> > Note : trying to deploy using Docker.
> > Thanks and regards
> >
> > Jagannath S Bilgi
> >
>
Re: Fw: Re: Kafka-connect
Posted by Christos Vasilakis <cv...@gmail.com>.
from a quick glance noticed that the path name contains an ‘`#’ character
instead of ‘/‘ causing the ‘not found’ error.
Hope that helps
On Fri, May 4, 2018 at 7:41 AM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Hi Williams,
>
> Thank you for quick reply.
>
> I am new to Kafka and stream processing. Wanted to implement solution
> through docker. It is expected to contain Zookeeper, Kafka, Kafkka-Connect
> and Cassandra.
>
> Tried example from Getting started with the Kafka Connect Cassandra Source
> <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-cassandra-source-e6e06ec72e97>
>
> Unable to proceed further as getting below error while starting kafka.
>
> root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh
> config/server.properties
> -sh: bin/zookeeper-server-start.sh: not found
>
> Below is uname -a output
> Linux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018
> x86_64 GNU/Linux
>
>
> Thanks and regards
>
> Jagannath S Bilgi
>
>
>
> ----- Forwarded Message -----
> *From:* Jagannath Bilgi <js...@yahoo.com>
> *To:* "users@kafka.apache.org" <us...@kafka.apache.org>
> *Sent:* Friday, May 4, 2018, 9:58:53 AM GMT+5:30
> *Subject:* Re: Kafka-connect
>
> Hi Williams,
>
> Thank you for quick reply.
>
> Wanted to implement solution through docker. It is expected to contain
> Zookeeper, Kafka, Kafkka-Connect and Cassandra.
>
> Tried example in Getting started with the Kafka Connect Cassandra Source
> <https://medium.com/walmartlabs/getting-started-with-the-kafka-connect-cassandra-source-e6e06ec72e97>
>
> Getting below error while starting kafka.
>
> [image: Inline image]
>
>
> [image: Inline image]
>
> Thanks and regards
>
> Jagannath S Bilgi
>
>
> On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <
> burton.b.williams@gmail.com> wrote:
>
>
> whats in docker? kafka? kafka-connnect? Did you try setting up outside of a
> container first?
>
> -B
>
> On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi <jsbilgi@yahoo.com.invalid
> >
> wrote:
>
> > Hi Team,
> > Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> > results from Google search. However unable to complete successfully.
> >
> > Could you please help me in resolving this.
> > Note : trying to deploy using Docker.
> > Thanks and regards
> >
> > Jagannath S Bilgi
> >
>
Fw: Re: Kafka-connect
Posted by Jagannath Bilgi <js...@yahoo.com.INVALID>.
Hi Williams,
Thank you for quick reply.
I am new to Kafka and stream processing. Wanted to implement solution through docker. It is expected to contain Zookeeper, Kafka, Kafkka-Connect and Cassandra.
Tried example from Getting started with the Kafka Connect Cassandra Source
Unable to proceed further as getting below error while starting kafka.
root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh config/server.properties-sh: bin/zookeeper-server-start.sh: not found
Below is uname -a outputLinux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018 x86_64 GNU/Linux
Thanks and regards
Jagannath S Bilgi
----- Forwarded Message ----- From: Jagannath Bilgi <js...@yahoo.com>To: "users@kafka.apache.org" <us...@kafka.apache.org>Sent: Friday, May 4, 2018, 9:58:53 AM GMT+5:30Subject: Re: Kafka-connect
Hi Williams,
Thank you for quick reply.
Wanted to implement solution through docker. It is expected to contain Zookeeper, Kafka, Kafkka-Connect and Cassandra.
Tried example in Getting started with the Kafka Connect Cassandra Source
Getting below error while starting kafka.
Thanks and regards
Jagannath S Bilgi
On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <bu...@gmail.com> wrote:
whats in docker? kafka? kafka-connnect? Did you try setting up outside of a
container first?
-B
On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Hi Team,
> Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> results from Google search. However unable to complete successfully.
>
> Could you please help me in resolving this.
> Note : trying to deploy using Docker.
> Thanks and regards
>
> Jagannath S Bilgi
>
Re: Kafka-connect
Posted by Jagannath Bilgi <js...@yahoo.com.INVALID>.
Hi Williams,
Thank you for quick reply.
Wanted to implement solution through docker. It is expected to contain Zookeeper, Kafka, Kafkka-Connect and Cassandra.
Tried example in Getting started with the Kafka Connect Cassandra Source
Getting below error while starting kafka.
Thanks and regards
Jagannath S Bilgi
On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <bu...@gmail.com> wrote:
whats in docker? kafka? kafka-connnect? Did you try setting up outside of a
container first?
-B
On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Hi Team,
> Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> results from Google search. However unable to complete successfully.
>
> Could you please help me in resolving this.
> Note : trying to deploy using Docker.
> Thanks and regards
>
> Jagannath S Bilgi
>
Re: Kafka-connect
Posted by Burton Williams <bu...@gmail.com>.
whats in docker? kafka? kafka-connnect? Did you try setting up outside of a
container first?
-B
On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi <js...@yahoo.com.invalid>
wrote:
> Hi Team,
> Trying to load data from Cassandra to Kafka using kafka-connect. Tried
> results from Google search. However unable to complete successfully.
>
> Could you please help me in resolving this.
> Note : trying to deploy using Docker.
> Thanks and regards
>
> Jagannath S Bilgi
>