You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Kudumula, Surender" <su...@hpe.com> on 2015/11/25 16:54:14 UTC
kafka 0.8 producer issue
Hi all
I am trying to get the producer working. It was working before but now getting the following issue. I have created a new topic as well just in case if it was the issue with topic but still no luck. I have increased the message size in broker as iam trying to send atleast 3mb message here in byte array format. Any suggestion please???
2015-11-25 15:46:11 INFO Login:185 - TGT refresh sleeping until: Tue Dec 01 07:03:07 GMT 2015
2015-11-25 15:46:11 INFO KafkaProducer:558 - Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.
2015-11-25 15:46:12 ERROR RecordBatch:96 - Error executing user-provided callback on message for topic-partition ResponseTopic-0:
java.lang.NullPointerException
at com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(KafkaPDFAProducer.java:62)
at org.apache.kafka.clients.producer.internals.RecordBatch.done(RecordBatch.java:93)
at org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:285)
at org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:253)
at org.apache.kafka.clients.producer.internals.Sender.access$100(Sender.java:55)
at org.apache.kafka.clients.producer.internals.Sender$1.onComplete(Sender.java:328)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:237)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:209)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:140)
at java.lang.Thread.run(Thread.java:745)
RE: kafka 0.8 producer issue
Posted by "Kudumula, Surender" <su...@hpe.com>.
Hi prabhjot
I just realized its not producing to kafka that’s why iam getting this null pointer. In my localhost I can see kafka info/debug logs. But in HDP cluster I cannot see any exceptions. How should I configure the logger to show exceptions in kafka log files thanks
-----Original Message-----
From: Prabhjot Bharaj [mailto:prabhbharaj@gmail.com]
Sent: 25 November 2015 17:35
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: Re: kafka 0.8 producer issue
Hi,
From the information that you've provided, I think your callback is the culprit here. It is seen from the stacktrace:-
at com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(
KafkaPDFAProducer.java:62)
Please provide more information like a code snippet etc, so that we can tell more
Thanks,
Prabhjot
On Wed, Nov 25, 2015 at 9:24 PM, Kudumula, Surender < surender.kudumula@hpe.com> wrote:
> Hi all
> I am trying to get the producer working. It was working before but now
> getting the following issue. I have created a new topic as well just
> in case if it was the issue with topic but still no luck. I have
> increased the message size in broker as iam trying to send atleast 3mb
> message here in byte array format. Any suggestion please???
>
> 2015-11-25 15:46:11 INFO Login:185 - TGT refresh sleeping until: Tue
> Dec
> 01 07:03:07 GMT 2015
> 2015-11-25 15:46:11 INFO KafkaProducer:558 - Closing the Kafka
> producer with timeoutMillis = 9223372036854775807 ms.
> 2015-11-25 15:46:12 ERROR RecordBatch:96 - Error executing
> user-provided callback on message for topic-partition ResponseTopic-0:
> java.lang.NullPointerException
> at
> com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(KafkaPDFAProducer.java:62)
> at
> org.apache.kafka.clients.producer.internals.RecordBatch.done(RecordBatch.java:93)
> at
> org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:285)
> at
> org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:253)
> at
> org.apache.kafka.clients.producer.internals.Sender.access$100(Sender.java:55)
> at
> org.apache.kafka.clients.producer.internals.Sender$1.onComplete(Sender.java:328)
> at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:237)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:209)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:140)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
--
---------------------------------------------------------
"There are only 10 types of people in the world: Those who understand binary, and those who don't"
RE: kafka 0.8 producer issue
Posted by "Kudumula, Surender" <su...@hpe.com>.
Hi prabhjot
I just realized its not producing to kafka that’s why iam getting this null pointer. In my localhost I can see kafka info/debug logs. But in HDP cluster I cannot see any exceptions. How should I configure the logger to show exceptions in kafka log files thanks
-----Original Message-----
From: Prabhjot Bharaj [mailto:prabhbharaj@gmail.com]
Sent: 25 November 2015 17:35
To: users@kafka.apache.org
Cc: dev@kafka.apache.org
Subject: Re: kafka 0.8 producer issue
Hi,
From the information that you've provided, I think your callback is the culprit here. It is seen from the stacktrace:-
at com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(
KafkaPDFAProducer.java:62)
Please provide more information like a code snippet etc, so that we can tell more
Thanks,
Prabhjot
On Wed, Nov 25, 2015 at 9:24 PM, Kudumula, Surender < surender.kudumula@hpe.com> wrote:
> Hi all
> I am trying to get the producer working. It was working before but now
> getting the following issue. I have created a new topic as well just
> in case if it was the issue with topic but still no luck. I have
> increased the message size in broker as iam trying to send atleast 3mb
> message here in byte array format. Any suggestion please???
>
> 2015-11-25 15:46:11 INFO Login:185 - TGT refresh sleeping until: Tue
> Dec
> 01 07:03:07 GMT 2015
> 2015-11-25 15:46:11 INFO KafkaProducer:558 - Closing the Kafka
> producer with timeoutMillis = 9223372036854775807 ms.
> 2015-11-25 15:46:12 ERROR RecordBatch:96 - Error executing
> user-provided callback on message for topic-partition ResponseTopic-0:
> java.lang.NullPointerException
> at
> com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(KafkaPDFAProducer.java:62)
> at
> org.apache.kafka.clients.producer.internals.RecordBatch.done(RecordBatch.java:93)
> at
> org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:285)
> at
> org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:253)
> at
> org.apache.kafka.clients.producer.internals.Sender.access$100(Sender.java:55)
> at
> org.apache.kafka.clients.producer.internals.Sender$1.onComplete(Sender.java:328)
> at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:237)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:209)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:140)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
--
---------------------------------------------------------
"There are only 10 types of people in the world: Those who understand binary, and those who don't"
Re: kafka 0.8 producer issue
Posted by Prabhjot Bharaj <pr...@gmail.com>.
Hi,
>From the information that you've provided, I think your callback is the
culprit here. It is seen from the stacktrace:-
at com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(
KafkaPDFAProducer.java:62)
Please provide more information like a code snippet etc, so that we can
tell more
Thanks,
Prabhjot
On Wed, Nov 25, 2015 at 9:24 PM, Kudumula, Surender <
surender.kudumula@hpe.com> wrote:
> Hi all
> I am trying to get the producer working. It was working before but now
> getting the following issue. I have created a new topic as well just in
> case if it was the issue with topic but still no luck. I have increased the
> message size in broker as iam trying to send atleast 3mb message here in
> byte array format. Any suggestion please???
>
> 2015-11-25 15:46:11 INFO Login:185 - TGT refresh sleeping until: Tue Dec
> 01 07:03:07 GMT 2015
> 2015-11-25 15:46:11 INFO KafkaProducer:558 - Closing the Kafka producer
> with timeoutMillis = 9223372036854775807 ms.
> 2015-11-25 15:46:12 ERROR RecordBatch:96 - Error executing user-provided
> callback on message for topic-partition ResponseTopic-0:
> java.lang.NullPointerException
> at
> com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(KafkaPDFAProducer.java:62)
> at
> org.apache.kafka.clients.producer.internals.RecordBatch.done(RecordBatch.java:93)
> at
> org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:285)
> at
> org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:253)
> at
> org.apache.kafka.clients.producer.internals.Sender.access$100(Sender.java:55)
> at
> org.apache.kafka.clients.producer.internals.Sender$1.onComplete(Sender.java:328)
> at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:237)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:209)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:140)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
--
---------------------------------------------------------
"There are only 10 types of people in the world: Those who understand
binary, and those who don't"
Re: kafka 0.8 producer issue
Posted by Prabhjot Bharaj <pr...@gmail.com>.
Hi,
>From the information that you've provided, I think your callback is the
culprit here. It is seen from the stacktrace:-
at com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(
KafkaPDFAProducer.java:62)
Please provide more information like a code snippet etc, so that we can
tell more
Thanks,
Prabhjot
On Wed, Nov 25, 2015 at 9:24 PM, Kudumula, Surender <
surender.kudumula@hpe.com> wrote:
> Hi all
> I am trying to get the producer working. It was working before but now
> getting the following issue. I have created a new topic as well just in
> case if it was the issue with topic but still no luck. I have increased the
> message size in broker as iam trying to send atleast 3mb message here in
> byte array format. Any suggestion please???
>
> 2015-11-25 15:46:11 INFO Login:185 - TGT refresh sleeping until: Tue Dec
> 01 07:03:07 GMT 2015
> 2015-11-25 15:46:11 INFO KafkaProducer:558 - Closing the Kafka producer
> with timeoutMillis = 9223372036854775807 ms.
> 2015-11-25 15:46:12 ERROR RecordBatch:96 - Error executing user-provided
> callback on message for topic-partition ResponseTopic-0:
> java.lang.NullPointerException
> at
> com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(KafkaPDFAProducer.java:62)
> at
> org.apache.kafka.clients.producer.internals.RecordBatch.done(RecordBatch.java:93)
> at
> org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:285)
> at
> org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:253)
> at
> org.apache.kafka.clients.producer.internals.Sender.access$100(Sender.java:55)
> at
> org.apache.kafka.clients.producer.internals.Sender$1.onComplete(Sender.java:328)
> at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:237)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:209)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:140)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
--
---------------------------------------------------------
"There are only 10 types of people in the world: Those who understand
binary, and those who don't"
Re: kafka 0.8 producer issue
Posted by Raju Bairishetti <ra...@gmail.com>.
For setting up logs for kafka, we need to export KAFKA_LOG4J_OPS env
variable before starting the kafka servers. if log4j.properties is
presented in /etc/kafka/ directory then it will be directly picks otherwise
it uses tools-log4j.properties from /etc/kafka.
You can set the location of server logs by setting kafka.logs.dir in the
/etc/kafka/log4j properties.
On Thu, Nov 26, 2015 at 2:50 PM, Gaurav Agarwal <ga...@gmail.com>
wrote:
> Can u share the code that you are using to publish the message. Also can u
> whether a small message is.published
> On Nov 25, 2015 9:25 PM, "Kudumula, Surender" <su...@hpe.com>
> wrote:
>
> > Hi all
> > I am trying to get the producer working. It was working before but now
> > getting the following issue. I have created a new topic as well just in
> > case if it was the issue with topic but still no luck. I have increased
> the
> > message size in broker as iam trying to send atleast 3mb message here in
> > byte array format. Any suggestion please???
> >
> > 2015-11-25 15:46:11 INFO Login:185 - TGT refresh sleeping until: Tue Dec
> > 01 07:03:07 GMT 2015
> > 2015-11-25 15:46:11 INFO KafkaProducer:558 - Closing the Kafka producer
> > with timeoutMillis = 9223372036854775807 ms.
> > 2015-11-25 15:46:12 ERROR RecordBatch:96 - Error executing user-provided
> > callback on message for topic-partition ResponseTopic-0:
> > java.lang.NullPointerException
> > at
> >
> com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(KafkaPDFAProducer.java:62)
> > at
> >
> org.apache.kafka.clients.producer.internals.RecordBatch.done(RecordBatch.java:93)
> > at
> >
> org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:285)
> > at
> >
> org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:253)
> > at
> >
> org.apache.kafka.clients.producer.internals.Sender.access$100(Sender.java:55)
> > at
> >
> org.apache.kafka.clients.producer.internals.Sender$1.onComplete(Sender.java:328)
> > at
> > org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:237)
> > at
> > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:209)
> > at
> > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:140)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> >
> >
>
--
Thanks
Raju Bairishetti,
www.lazada.com
Re: kafka 0.8 producer issue
Posted by Gaurav Agarwal <ga...@gmail.com>.
Can u share the code that you are using to publish the message. Also can u
whether a small message is.published
On Nov 25, 2015 9:25 PM, "Kudumula, Surender" <su...@hpe.com>
wrote:
> Hi all
> I am trying to get the producer working. It was working before but now
> getting the following issue. I have created a new topic as well just in
> case if it was the issue with topic but still no luck. I have increased the
> message size in broker as iam trying to send atleast 3mb message here in
> byte array format. Any suggestion please???
>
> 2015-11-25 15:46:11 INFO Login:185 - TGT refresh sleeping until: Tue Dec
> 01 07:03:07 GMT 2015
> 2015-11-25 15:46:11 INFO KafkaProducer:558 - Closing the Kafka producer
> with timeoutMillis = 9223372036854775807 ms.
> 2015-11-25 15:46:12 ERROR RecordBatch:96 - Error executing user-provided
> callback on message for topic-partition ResponseTopic-0:
> java.lang.NullPointerException
> at
> com.hpe.ssmamp.kafka.KafkaPDFAProducer$1.onCompletion(KafkaPDFAProducer.java:62)
> at
> org.apache.kafka.clients.producer.internals.RecordBatch.done(RecordBatch.java:93)
> at
> org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:285)
> at
> org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:253)
> at
> org.apache.kafka.clients.producer.internals.Sender.access$100(Sender.java:55)
> at
> org.apache.kafka.clients.producer.internals.Sender$1.onComplete(Sender.java:328)
> at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:237)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:209)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:140)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>