You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Lakshmanan Muthuraman <la...@tokbox.com> on 2014/09/22 19:13:26 UTC
Log 4j Conversion Pattern not working kafka.producer.KafkaLog4jAppender
in Kafka.0.8.1.1
Hello ,
I am trying to use KafkaLog4jAppender to write to kafka and also a file
appender to write to a file. The conversion pattern works for the file, but
for the kafka appender it is not working
The output of the file appender is *2014-09-19T22:30:14.781Z INFO
com.test.poc.StartProgram Message1*But the Kafka appender has output as
*Message1*
Find below my log4j.properties file
log4j.rootCategory=INFO
log4j.appender.file=org.apache.log4j.DailyRollingFileAppender
log4j.appender.file.DatePattern='.'yyyy-MM-dd-HH
log4j.appender.file.File=logs/test.log
log4j.appender.file.layout=org.apache.log4j.PatternLayout
log4j.appender.file.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
%p %C %m%n
log4j.logger.com=INFO,file,KAFKA
#Kafka Appender
log4j.appender.KAFKA=kafka.producer.KafkaLog4jAppender
log4j.appender.KAFKA.layout=org.apache.log4j.PatternLayout
log4j.appender.KAFKA.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
%p %C %m%n
log4j.appender.KAFKA.ProducerType=async
log4j.appender.KAFKA.BrokerList=localhost:9092
log4j.appender.KAFKA.Topic=test`enter code here`
log4j.appender.KAFKA.Serializer=kafka.test.AppenderStringSerializer
Re: Log 4j Conversion Pattern not working
kafka.producer.KafkaLog4jAppender in Kafka.0.8.1.1
Posted by Joseph Lawson <jl...@roomkey.com>.
Excellent news!
________________________________________
From: Joe Stein <jo...@stealth.ly>
Sent: Monday, September 22, 2014 1:58 PM
To: users@kafka.apache.org
Subject: Re: Log 4j Conversion Pattern not working kafka.producer.KafkaLog4jAppender in Kafka.0.8.1.1
This should be fixed in 0.8.2
https://issues.apache.org/jira/browse/KAFKA-847 you can apply the v2 patch
https://issues.apache.org/jira/secure/attachment/12664646/KAFKA-847-v2.patch
backwards
if you want too.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Mon, Sep 22, 2014 at 1:56 PM, Joseph Lawson <jl...@roomkey.com> wrote:
> I don't think the log4j appender supports patterns :(
>
> On Sep 22, 2014 1:14 PM, Lakshmanan Muthuraman <la...@tokbox.com>
> wrote:
> Hello ,
>
> I am trying to use KafkaLog4jAppender to write to kafka and also a file
> appender to write to a file. The conversion pattern works for the file, but
> for the kafka appender it is not working
>
> The output of the file appender is *2014-09-19T22:30:14.781Z INFO
> com.test.poc.StartProgram Message1*But the Kafka appender has output as
> *Message1*
>
> Find below my log4j.properties file
>
> log4j.rootCategory=INFO
> log4j.appender.file=org.apache.log4j.DailyRollingFileAppender
> log4j.appender.file.DatePattern='.'yyyy-MM-dd-HH
> log4j.appender.file.File=logs/test.log
> log4j.appender.file.layout=org.apache.log4j.PatternLayout
>
> log4j.appender.file.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
> %p %C %m%n
>
> log4j.logger.com=INFO,file,KAFKA
> #Kafka Appender
> log4j.appender.KAFKA=kafka.producer.KafkaLog4jAppender
> log4j.appender.KAFKA.layout=org.apache.log4j.PatternLayout
>
> log4j.appender.KAFKA.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
> %p %C %m%n
>
> log4j.appender.KAFKA.ProducerType=async
> log4j.appender.KAFKA.BrokerList=localhost:9092
> log4j.appender.KAFKA.Topic=test`enter code here`
> log4j.appender.KAFKA.Serializer=kafka.test.AppenderStringSerializer
>
Re: Log 4j Conversion Pattern not working kafka.producer.KafkaLog4jAppender
in Kafka.0.8.1.1
Posted by Joe Stein <jo...@stealth.ly>.
This should be fixed in 0.8.2
https://issues.apache.org/jira/browse/KAFKA-847 you can apply the v2 patch
https://issues.apache.org/jira/secure/attachment/12664646/KAFKA-847-v2.patch
backwards
if you want too.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Mon, Sep 22, 2014 at 1:56 PM, Joseph Lawson <jl...@roomkey.com> wrote:
> I don't think the log4j appender supports patterns :(
>
> On Sep 22, 2014 1:14 PM, Lakshmanan Muthuraman <la...@tokbox.com>
> wrote:
> Hello ,
>
> I am trying to use KafkaLog4jAppender to write to kafka and also a file
> appender to write to a file. The conversion pattern works for the file, but
> for the kafka appender it is not working
>
> The output of the file appender is *2014-09-19T22:30:14.781Z INFO
> com.test.poc.StartProgram Message1*But the Kafka appender has output as
> *Message1*
>
> Find below my log4j.properties file
>
> log4j.rootCategory=INFO
> log4j.appender.file=org.apache.log4j.DailyRollingFileAppender
> log4j.appender.file.DatePattern='.'yyyy-MM-dd-HH
> log4j.appender.file.File=logs/test.log
> log4j.appender.file.layout=org.apache.log4j.PatternLayout
>
> log4j.appender.file.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
> %p %C %m%n
>
> log4j.logger.com=INFO,file,KAFKA
> #Kafka Appender
> log4j.appender.KAFKA=kafka.producer.KafkaLog4jAppender
> log4j.appender.KAFKA.layout=org.apache.log4j.PatternLayout
>
> log4j.appender.KAFKA.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
> %p %C %m%n
>
> log4j.appender.KAFKA.ProducerType=async
> log4j.appender.KAFKA.BrokerList=localhost:9092
> log4j.appender.KAFKA.Topic=test`enter code here`
> log4j.appender.KAFKA.Serializer=kafka.test.AppenderStringSerializer
>
Re: Log 4j Conversion Pattern not working
kafka.producer.KafkaLog4jAppender in Kafka.0.8.1.1
Posted by Joseph Lawson <jl...@roomkey.com>.
I don't think the log4j appender supports patterns :(
On Sep 22, 2014 1:14 PM, Lakshmanan Muthuraman <la...@tokbox.com> wrote:
Hello ,
I am trying to use KafkaLog4jAppender to write to kafka and also a file
appender to write to a file. The conversion pattern works for the file, but
for the kafka appender it is not working
The output of the file appender is *2014-09-19T22:30:14.781Z INFO
com.test.poc.StartProgram Message1*But the Kafka appender has output as
*Message1*
Find below my log4j.properties file
log4j.rootCategory=INFO
log4j.appender.file=org.apache.log4j.DailyRollingFileAppender
log4j.appender.file.DatePattern='.'yyyy-MM-dd-HH
log4j.appender.file.File=logs/test.log
log4j.appender.file.layout=org.apache.log4j.PatternLayout
log4j.appender.file.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
%p %C %m%n
log4j.logger.com=INFO,file,KAFKA
#Kafka Appender
log4j.appender.KAFKA=kafka.producer.KafkaLog4jAppender
log4j.appender.KAFKA.layout=org.apache.log4j.PatternLayout
log4j.appender.KAFKA.layout.ConversionPattern=%d{yyyy-MM-dd'T'HH:mm:ss.SSS'Z'}{UTC}
%p %C %m%n
log4j.appender.KAFKA.ProducerType=async
log4j.appender.KAFKA.BrokerList=localhost:9092
log4j.appender.KAFKA.Topic=test`enter code here`
log4j.appender.KAFKA.Serializer=kafka.test.AppenderStringSerializer