You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by abdul hameed pathan <ab...@gmail.com> on 2015/04/23 15:15:17 UTC

NoClassDefFoundError at producer end

Hi,

we are getting NoClassDefFoundError at our producer end. We are using only
syn producer. we have 3 data producer systems whose using same
kafka.javaapi.producer.Producer instance.Bellow is the maven dependency
                              <dependency>
                                   <groupId>org.apache.kafka</groupId>
                                   <artifactId>kafka_2.10</artifactId>
                                   <version>0.8.2.1</version>
                             </dependency>

Bellow is the stack trace of exception.

Exception in thread "ActiveMQ Session Task-1749"
java.lang.NoClassDefFoundError:
kafka/producer/async/DefaultEventHandler$$anonfun$dispatchSerializedData$3
at
kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:99)
at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72)
at kafka.producer.Producer.send(Producer.scala:77)
at kafka.javaapi.producer.Producer.send(Producer.scala:33)
at
com.snapdeal.services.requeue.impl.RequeueServiceImpl.producerSend(RequeueServiceImpl.java:107)
at
com.snapdeal.services.requeue.impl.RequeueServiceImpl.requeueToKafka(RequeueServiceImpl.java:86)
at
com.snapdeal.services.requeue.impl.RequeueServiceImpl.requeue(RequeueServiceImpl.java:71)
at
com.snapdeal.services.indexer.impl.IndexerCatalogServiceImpl.indexCatalogInfo(IndexerCatalogServiceImpl.java:344)
at
com.snapdeal.services.indexer.impl.SupcIndexerServiceImpl.index(SupcIndexerServiceImpl.java:63)
at
com.snapdeal.indexer.listener.impl.InventoryUpdateQueueListener.index(InventoryUpdateQueueListener.java:73)
at
com.snapdeal.indexer.listener.AbstractQueueListenerService.callIndex(AbstractQueueListenerService.java:82)
at
com.snapdeal.indexer.listener.impl.InventoryUpdateQueueListener.onMessage(InventoryUpdateQueueListener.java:92)
at
org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1298)
at
org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:131)
at
org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:202)
at
org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at
org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)




00:00:15,525#
[requestId=142967906333580768|appIdent=SearchAdmin|appIP=30.0.0.165|apiVariantId=null]
ERROR [HttpSender] - Error http to : http:
//
internal-catalog-lb-mw-2086838461.ap-southeast-1.elb.amazonaws.com:8080/service/product/getPOGDetailListByIdList
java.net.SocketException: Too many open files
        at java.net.Socket.createImpl(Socket.java:447)
        at java.net.Socket.getImpl(Socket.java:510)
        at java.net.Socket.setSoTimeout(Socket.java:1105)
        at
org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:116)
        at
org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
        at
org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:144)
        at
org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:131)
        at
org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
        at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
        at
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
        at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
        at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)

Could you please help us to resolve these two issue?
Regards,
Abdul Hameed
+919599216373

Re: NoClassDefFoundError at producer end

Posted by Gwen Shapira <gs...@cloudera.com>.
Since it is a runtime error, Maven dependency is less relevant than
what you have in your class path (unless you built a shaded uber-jar).

You'll need Scala runtime and zkclient jar in the classpath, can you
check that you have those around?

On Thu, Apr 23, 2015 at 6:15 AM, abdul hameed pathan
<ab...@gmail.com> wrote:
> Hi,
>
> we are getting NoClassDefFoundError at our producer end. We are using only
> syn producer. we have 3 data producer systems whose using same
> kafka.javaapi.producer.Producer instance.Bellow is the maven dependency
>                               <dependency>
>                                    <groupId>org.apache.kafka</groupId>
>                                    <artifactId>kafka_2.10</artifactId>
>                                    <version>0.8.2.1</version>
>                              </dependency>
>
> Bellow is the stack trace of exception.
>
> Exception in thread "ActiveMQ Session Task-1749"
> java.lang.NoClassDefFoundError:
> kafka/producer/async/DefaultEventHandler$$anonfun$dispatchSerializedData$3
> at
> kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:99)
> at
> kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72)
> at kafka.producer.Producer.send(Producer.scala:77)
> at kafka.javaapi.producer.Producer.send(Producer.scala:33)
> at
> com.snapdeal.services.requeue.impl.RequeueServiceImpl.producerSend(RequeueServiceImpl.java:107)
> at
> com.snapdeal.services.requeue.impl.RequeueServiceImpl.requeueToKafka(RequeueServiceImpl.java:86)
> at
> com.snapdeal.services.requeue.impl.RequeueServiceImpl.requeue(RequeueServiceImpl.java:71)
> at
> com.snapdeal.services.indexer.impl.IndexerCatalogServiceImpl.indexCatalogInfo(IndexerCatalogServiceImpl.java:344)
> at
> com.snapdeal.services.indexer.impl.SupcIndexerServiceImpl.index(SupcIndexerServiceImpl.java:63)
> at
> com.snapdeal.indexer.listener.impl.InventoryUpdateQueueListener.index(InventoryUpdateQueueListener.java:73)
> at
> com.snapdeal.indexer.listener.AbstractQueueListenerService.callIndex(AbstractQueueListenerService.java:82)
> at
> com.snapdeal.indexer.listener.impl.InventoryUpdateQueueListener.onMessage(InventoryUpdateQueueListener.java:92)
> at
> org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1298)
> at
> org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:131)
> at
> org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:202)
> at
> org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> at
> org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> 00:00:15,525#
> [requestId=142967906333580768|appIdent=SearchAdmin|appIP=30.0.0.165|apiVariantId=null]
> ERROR [HttpSender] - Error http to : http:
> //
> internal-catalog-lb-mw-2086838461.ap-southeast-1.elb.amazonaws.com:8080/service/product/getPOGDetailListByIdList
> java.net.SocketException: Too many open files
>         at java.net.Socket.createImpl(Socket.java:447)
>         at java.net.Socket.getImpl(Socket.java:510)
>         at java.net.Socket.setSoTimeout(Socket.java:1105)
>         at
> org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:116)
>         at
> org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
>         at
> org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:144)
>         at
> org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:131)
>         at
> org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
>         at
> org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
>         at
> org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
>         at
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
>         at
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
>         at
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
>
> Could you please help us to resolve these two issue?
> Regards,
> Abdul Hameed
> +919599216373