You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Seshadri, Balaji" <Ba...@dish.com> on 2013/05/16 21:44:50 UTC

WebMethods consumer for Kafka.

Hi,

I'm trying to write webMethods consumer for Kafka and I get the following error when I try to integrate.

java.lang.NullPointerException
                at org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:360)
                at org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331)
                at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377)
                at org.I0Itec.zkclient.ZkConnection.connect(ZkConnection.java:64)
                at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:872)
                at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98)
                at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84)
                at kafka.consumer.ZookeeperConsumerConnector.connectZk(ZookeeperConsumerConnector.scala:154)
                at kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:112)
                at kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:64)
                at kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:66)
                at kafka.consumer.Consumer$.createJavaConsumerConnector(ConsumerConnector.scala:100)
                at kafka.consumer.Consumer.createJavaConsumerConnector(ConsumerConnector.scala)
                at com.dish.des.kafka.KafkaTopicConsumer.<init>(KafkaTopicConsumer.java:44)
                at MyConsumer.utils.getMessages(utils.java:58)
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                at java.lang.reflect.Method.invoke(Method.java:597)
                at com.wm.app.b2b.server.JavaService.baseInvoke(JavaService.java:439)
                at com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:643)
                at com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
                at com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:44)
                at com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:243)
                at com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:51)
                at com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:171)
                at com.wm.app.b2b.server.ACLManager.process(ACLManager.java:276)
                at com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:30)
                at com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:363)
                at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:547)
                at com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:386)
                at com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:234)
                at com.wm.app.b2b.server.comm.DefaultServerRequestHandler.handleMessage(DefaultServerRequestHandler.java:119)
                at com.wm.app.b2b.server.HTTPMessageHandler.process(HTTPMessageHandler.java:160)
                at com.wm.app.b2b.server.HTTPDispatch.handleRequest(HTTPDispatch.java:181)
                at com.wm.app.b2b.server.Dispatch.run(Dispatch.java:354)
                at com.wm.util.pool.PooledThread.run(PooledThread.java:131)
                at java.lang.Thread.run(Thread.java:662)

Please let me know fix for this.

Thanks,

Balaji

RE: WebMethods consumer for Kafka.

Posted by Neha Narkhede <ne...@gmail.com>.
3.3.3 has known serious bugs. You should at least use 3.3.4. I am not aware
of a JMS bridge. Contributions are welcome :)

Thanks,
Neha
On May 17, 2013 8:36 AM, "Seshadri, Balaji" <Ba...@dish.com>
wrote:

> Hi Neha,
>
> I figured out it was issue with jar dependencies,I tried to use latest
> stable version of zookeeper(3.4.5) and it broke.
>
> It working fine now with 3.3.3.
>
> I have one more question :).
>
> Do you guys have JMS bridge to Kafka,because webMethods supports only
> properitery and JMS spec so hooking up Kafka as a trigger in webMethods is
> becoming an issue.
>
> Thanks,
>
> Balaji
>
> -----Original Message-----
> From: Neha Narkhede [mailto:neha.narkhede@gmail.com]
> Sent: Thursday, May 16, 2013 10:00 PM
> To: users@kafka.apache.org
> Subject: Re: WebMethods consumer for Kafka.
>
> It seems that the zookeeper host string is null or empty. Can you paste the
> code you used to instantiate the consumer?
>
> Thanks,
> Neha
> On May 16, 2013 12:45 PM, "Seshadri, Balaji" <Ba...@dish.com>
> wrote:
>
> > Hi,
> >
> > I'm trying to write webMethods consumer for Kafka and I get the following
> > error when I try to integrate.
> >
> > java.lang.NullPointerException
> >                 at
> > org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:360)
> >                 at
> > org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331)
> >                 at
> > org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377)
> >                 at
> > org.I0Itec.zkclient.ZkConnection.connect(ZkConnection.java:64)
> >                 at
> org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:872)
> >                 at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98)
> >                 at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84)
> >                 at
> >
> kafka.consumer.ZookeeperConsumerConnector.connectZk(ZookeeperConsumerConnector.scala:154)
> >                 at
> >
> kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:112)
> >                 at
> >
> kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:64)
> >                 at
> >
> kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:66)
> >                 at
> >
> kafka.consumer.Consumer$.createJavaConsumerConnector(ConsumerConnector.scala:100)
> >                 at
> >
> kafka.consumer.Consumer.createJavaConsumerConnector(ConsumerConnector.scala)
> >                 at
> > com.dish.des.kafka.KafkaTopicConsumer.<init>(KafkaTopicConsumer.java:44)
> >                 at MyConsumer.utils.getMessages(utils.java:58)
> >                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> >                 at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >                 at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >                 at java.lang.reflect.Method.invoke(Method.java:597)
> >                 at
> > com.wm.app.b2b.server.JavaService.baseInvoke(JavaService.java:439)
> >                 at
> >
> com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:643)
> >                 at
> >
> com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
> >                 at
> >
> com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:44)
> >                 at
> >
> com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:243)
> >                 at
> >
> com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:51)
> >                 at
> >
> com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:171)
> >                 at
> > com.wm.app.b2b.server.ACLManager.process(ACLManager.java:276)
> >                 at
> >
> com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:30)
> >                 at
> > com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:363)
> >                 at
> > com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:547)
> >                 at
> > com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:386)
> >                 at
> > com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:234)
> >                 at
> >
> com.wm.app.b2b.server.comm.DefaultServerRequestHandler.handleMessage(DefaultServerRequestHandler.java:119)
> >                 at
> >
> com.wm.app.b2b.server.HTTPMessageHandler.process(HTTPMessageHandler.java:160)
> >                 at
> > com.wm.app.b2b.server.HTTPDispatch.handleRequest(HTTPDispatch.java:181)
> >                 at com.wm.app.b2b.server.Dispatch.run(Dispatch.java:354)
> >                 at
> com.wm.util.pool.PooledThread.run(PooledThread.java:131)
> >                 at java.lang.Thread.run(Thread.java:662)
> >
> > Please let me know fix for this.
> >
> > Thanks,
> >
> > Balaji
> >
>

RE: WebMethods consumer for Kafka.

Posted by "Seshadri, Balaji" <Ba...@dish.com>.
Hi Neha,

I figured out it was issue with jar dependencies,I tried to use latest stable version of zookeeper(3.4.5) and it broke.

It working fine now with 3.3.3.

I have one more question :).

Do you guys have JMS bridge to Kafka,because webMethods supports only properitery and JMS spec so hooking up Kafka as a trigger in webMethods is becoming an issue.

Thanks,

Balaji

-----Original Message-----
From: Neha Narkhede [mailto:neha.narkhede@gmail.com] 
Sent: Thursday, May 16, 2013 10:00 PM
To: users@kafka.apache.org
Subject: Re: WebMethods consumer for Kafka.

It seems that the zookeeper host string is null or empty. Can you paste the
code you used to instantiate the consumer?

Thanks,
Neha
On May 16, 2013 12:45 PM, "Seshadri, Balaji" <Ba...@dish.com>
wrote:

> Hi,
>
> I'm trying to write webMethods consumer for Kafka and I get the following
> error when I try to integrate.
>
> java.lang.NullPointerException
>                 at
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:360)
>                 at
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331)
>                 at
> org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377)
>                 at
> org.I0Itec.zkclient.ZkConnection.connect(ZkConnection.java:64)
>                 at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:872)
>                 at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98)
>                 at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84)
>                 at
> kafka.consumer.ZookeeperConsumerConnector.connectZk(ZookeeperConsumerConnector.scala:154)
>                 at
> kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:112)
>                 at
> kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:64)
>                 at
> kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:66)
>                 at
> kafka.consumer.Consumer$.createJavaConsumerConnector(ConsumerConnector.scala:100)
>                 at
> kafka.consumer.Consumer.createJavaConsumerConnector(ConsumerConnector.scala)
>                 at
> com.dish.des.kafka.KafkaTopicConsumer.<init>(KafkaTopicConsumer.java:44)
>                 at MyConsumer.utils.getMessages(utils.java:58)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>                 at
> com.wm.app.b2b.server.JavaService.baseInvoke(JavaService.java:439)
>                 at
> com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:643)
>                 at
> com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
>                 at
> com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:44)
>                 at
> com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:243)
>                 at
> com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:51)
>                 at
> com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:171)
>                 at
> com.wm.app.b2b.server.ACLManager.process(ACLManager.java:276)
>                 at
> com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:30)
>                 at
> com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:363)
>                 at
> com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:547)
>                 at
> com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:386)
>                 at
> com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:234)
>                 at
> com.wm.app.b2b.server.comm.DefaultServerRequestHandler.handleMessage(DefaultServerRequestHandler.java:119)
>                 at
> com.wm.app.b2b.server.HTTPMessageHandler.process(HTTPMessageHandler.java:160)
>                 at
> com.wm.app.b2b.server.HTTPDispatch.handleRequest(HTTPDispatch.java:181)
>                 at com.wm.app.b2b.server.Dispatch.run(Dispatch.java:354)
>                 at com.wm.util.pool.PooledThread.run(PooledThread.java:131)
>                 at java.lang.Thread.run(Thread.java:662)
>
> Please let me know fix for this.
>
> Thanks,
>
> Balaji
>

Re: WebMethods consumer for Kafka.

Posted by Neha Narkhede <ne...@gmail.com>.
It seems that the zookeeper host string is null or empty. Can you paste the
code you used to instantiate the consumer?

Thanks,
Neha
On May 16, 2013 12:45 PM, "Seshadri, Balaji" <Ba...@dish.com>
wrote:

> Hi,
>
> I'm trying to write webMethods consumer for Kafka and I get the following
> error when I try to integrate.
>
> java.lang.NullPointerException
>                 at
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:360)
>                 at
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331)
>                 at
> org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377)
>                 at
> org.I0Itec.zkclient.ZkConnection.connect(ZkConnection.java:64)
>                 at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:872)
>                 at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98)
>                 at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84)
>                 at
> kafka.consumer.ZookeeperConsumerConnector.connectZk(ZookeeperConsumerConnector.scala:154)
>                 at
> kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:112)
>                 at
> kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:64)
>                 at
> kafka.javaapi.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:66)
>                 at
> kafka.consumer.Consumer$.createJavaConsumerConnector(ConsumerConnector.scala:100)
>                 at
> kafka.consumer.Consumer.createJavaConsumerConnector(ConsumerConnector.scala)
>                 at
> com.dish.des.kafka.KafkaTopicConsumer.<init>(KafkaTopicConsumer.java:44)
>                 at MyConsumer.utils.getMessages(utils.java:58)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>                 at
> com.wm.app.b2b.server.JavaService.baseInvoke(JavaService.java:439)
>                 at
> com.wm.app.b2b.server.invoke.InvokeManager.process(InvokeManager.java:643)
>                 at
> com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(ReservationProcessor.java:46)
>                 at
> com.wm.app.b2b.server.invoke.StatisticsProcessor.process(StatisticsProcessor.java:44)
>                 at
> com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(ServiceCompletionImpl.java:243)
>                 at
> com.wm.app.b2b.server.invoke.ValidateProcessor.process(ValidateProcessor.java:51)
>                 at
> com.wm.app.b2b.server.invoke.PipelineProcessor.process(PipelineProcessor.java:171)
>                 at
> com.wm.app.b2b.server.ACLManager.process(ACLManager.java:276)
>                 at
> com.wm.app.b2b.server.invoke.DispatchProcessor.process(DispatchProcessor.java:30)
>                 at
> com.wm.app.b2b.server.AuditLogManager.process(AuditLogManager.java:363)
>                 at
> com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:547)
>                 at
> com.wm.app.b2b.server.invoke.InvokeManager.invoke(InvokeManager.java:386)
>                 at
> com.wm.app.b2b.server.ServiceManager.invoke(ServiceManager.java:234)
>                 at
> com.wm.app.b2b.server.comm.DefaultServerRequestHandler.handleMessage(DefaultServerRequestHandler.java:119)
>                 at
> com.wm.app.b2b.server.HTTPMessageHandler.process(HTTPMessageHandler.java:160)
>                 at
> com.wm.app.b2b.server.HTTPDispatch.handleRequest(HTTPDispatch.java:181)
>                 at com.wm.app.b2b.server.Dispatch.run(Dispatch.java:354)
>                 at com.wm.util.pool.PooledThread.run(PooledThread.java:131)
>                 at java.lang.Thread.run(Thread.java:662)
>
> Please let me know fix for this.
>
> Thanks,
>
> Balaji
>