You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@eagle.apache.org by "kangqian@chinamobile.com" <ka...@chinamobile.com> on 2016/08/05 01:05:58 UTC
hbase-data-activity-monitoring for help
Dear professor:
I'm a developer on eagle, it's a great and useful system for me to monitor the data activity of various apache open-source tools. But I have a question when I try to input the hbase log into the eagle.
In page "http://eagle.apache.org/docs/hbase-data-activity-monitoring.html", step 2 of "How to add a Kafka log4j appender" tells me to add “KAFKA_HBASE_AUDIT” log4j appender to Security audit appender, I find the content need to add contains the following information:
log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HBASE_AUDIT.Topic=sandbox_hbase_security_log
log4j.appender.KAFKA_HBASE_AUDIT.BrokerList=sandbox.hortonworks.com:6667 (the kafka config??)
log4j.appender.KAFKA_HBASE_AUDIT.Layout=org.apache.log4j.PatternLayout
log4j.appender.KAFKA_HBASE_AUDIT.Layout.ConversionPattern=%d{ISO8601} %p %c: %m%n
log4j.appender.KAFKA_HBASE_AUDIT.ProducerType=async
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.GenericLogKeyer
log4j.appender.KAFKA_HDFS_AUDIT.KeyPattern=user=(\\w+),\\s+
Were the "KAFKA_HDFS_AUDIT" is right in the appender?
I'm looking forward to your reply!
Best Regards!
------------------------------------------------------
Kang qian
Re: hbase-data-activity-monitoring for help
Posted by Senthil Kumar <se...@gmail.com>.
Thanks Kang for trying out Apache Eagle.
Yes KAFKA_HBASE_AUDIT is correct log4J Appender which directly pushes your
log messages to Kafka Topic .. Also you should have Kafka and Scala library
in your hbase lib path to use KafkaLog4jAppender API .
-- Senthil
On Aug 5, 2016 8:04 AM, "kangqian@chinamobile.com" <ka...@chinamobile.com>
wrote:
> Dear professor:
> I'm a developer on eagle, it's a great and useful system for me to
> monitor the data activity of various apache open-source tools. But I have a
> question when I try to input the hbase log into the eagle.
> In page "http://eagle.apache.org/docs/hbase-data-activity-
> monitoring.html", step 2 of "How to add a Kafka log4j appender" tells
> me to add “KAFKA_HBASE_AUDIT” log4j appender to Security audit appender, I
> find the content need to add contains the following information:
> log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.
> kafka.KafkaLog4jAppender
> log4j.appender.KAFKA_HBASE_AUDIT.Topic=sandbox_hbase_
> security_log
> log4j.appender.KAFKA_HBASE_AUDIT.BrokerList=sandbox.
> hortonworks.com:6667 (the kafka config??)
> log4j.appender.KAFKA_HBASE_AUDIT.Layout=org.apache.log4j.
> PatternLayout
> log4j.appender.KAFKA_HBASE_AUDIT.Layout.ConversionPattern=%d{ISO8601}
> %p %c: %m%n
> log4j.appender.KAFKA_HBASE_AUDIT.ProducerType=async
> log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.
> eagle.log4j.kafka.hadoop.GenericLogKeyer
> log4j.appender.KAFKA_HDFS_AUDIT.KeyPattern=user=(\\w+),\\s+
>
> Were the "KAFKA_HDFS_AUDIT" is right in the appender?
> I'm looking forward to your reply!
>
>
>
> Best Regards!
> ------------------------------------------------------
> Kang qian
>