You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@eagle.apache.org by ha...@apache.org on 2015/12/14 11:57:52 UTC
incubator-eagle git commit: EAGLE-74. Delete unused doc for sandbox
Repository: incubator-eagle
Updated Branches:
refs/heads/master e362b6f33 -> eda2f96a8
EAGLE-74. Delete unused doc for sandbox
https://issues.apache.org/jira/browse/EAGLE-74
Author: qingwen220
Reviewer: haoch
Closes #20 from qingwen220:EAGLE-74
Project: http://git-wip-us.apache.org/repos/asf/incubator-eagle/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-eagle/commit/eda2f96a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-eagle/tree/eda2f96a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-eagle/diff/eda2f96a
Branch: refs/heads/master
Commit: eda2f96a879ad34ef8209c9cb508648a86fc0385
Parents: e362b6f
Author: Hao Chen <ha...@apache.org>
Authored: Mon Dec 14 18:56:12 2015 +0800
Committer: Hao Chen <ha...@apache.org>
Committed: Mon Dec 14 18:56:12 2015 +0800
----------------------------------------------------------------------
.../how-to-install-kafka-log4j-into-namenode.md | 51 --------------------
1 file changed, 51 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-eagle/blob/eda2f96a/eagle-assembly/src/main/docs/how-to-install-kafka-log4j-into-namenode.md
----------------------------------------------------------------------
diff --git a/eagle-assembly/src/main/docs/how-to-install-kafka-log4j-into-namenode.md b/eagle-assembly/src/main/docs/how-to-install-kafka-log4j-into-namenode.md
deleted file mode 100644
index a902a3e..0000000
--- a/eagle-assembly/src/main/docs/how-to-install-kafka-log4j-into-namenode.md
+++ /dev/null
@@ -1,51 +0,0 @@
-Install kafka log4j into namenode
-=================================
-
-Installation
-------------
-1. **Add eagle kafka log4j jars into hadoop namenode classpath**: append `$EAGLE_HOME/lib/log4jkafka/lib/*` into value of `$HADOOP_CLASSPATH` in `$HADOOP_CONF_DIR/hadoop-env.sh`
-2. **Change log4j configuration aside namenode**: Add **one** of following types of log4j configuration ("xml" or "properties") into `$HADOOP_CONF_DIR` and modify kafka related configuration like broker hosts, topic, queue size, batch size correspondingly.
- * **log4j.xml**: refer to [log4j-template.xml](https://github.xyz.com/eagle/eagle/blob/master/eagle-external/eagle-log4jkafka/src/main/resources/log4j-template.xml)
-
- <appender class=".eagle.kafka.producer.JKafkaLog4jAppender" name="KAFKA_HDFS_AUDIT">
- <param value="sandbox.hortonworks.com:6667" name="BrokerList"/>
- <param value=".eagle.kafka.hadoop.AuditLogKeyer" name="KeyClass"/>
- <param value="hdfs_audit_log" name="Topic"/>
- <layout class="org.apache.log4j.PatternLayout">
- <param value="%d{ISO8601} %p %c{2}: %m%n" name="ConversionPattern"/>
- </layout>
- </appender>
- <appender name="ASYNC_KAFKA_HDFS_AUDIT" class="org.apache.log4j.AsyncAppender">
- <param name="BufferSize" value="50"/>
- <param name="Blocking" value="false"/>
- <appender-ref ref="KAFKA_HDFS_AUDIT"/>
- </appender>
-
- * **log4j.properties**: refer to [log4j-template.properties](https://github.xyz.com/eagle/eagle/blob/master/eagle-external/eagle-log4jkafka/src/main/resources/log4j-template.properties)
-
- hdfs.audit.logger=INFO,console,DRFAAUDIT,KAFKA_HDFS_AUDIT
- log4j.appender.KAFKA_HDFS_AUDIT=eagle.log4j.kafka.KafkaLog4jAppender
- log4j.appender.KAFKA_HDFS_AUDIT.Topic=hdfs_audit_log
- log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
- log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=eagle.log4j.kafka.hadoop.AuditLogKeyer
- log4j.appender.KAFKA_HDFS_AUDIT.Layout=org.apache.log4j.PatternLayout
- log4j.appender.KAFKA_HDFS_AUDIT.Layout.ConversionPattern=%d{ISO8601} %p %c{2}: %m%n
- log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async
- log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=10
- log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=20
-
-3. **Restart name node**: Confirm the configuration is correct and restart name-node.
-4. **Validate it works**
- * Check name node is correctly started without log4j related exception.
- * Check whether log is flowing into kafka with kafka-console-consumer.sh
-
-Reference
----------
-1. Logj4 1.x configuration: https://logging.apache.org/log4j/1.2/manual.html
-2. Logj4 2.x configuration: http://logging.apache.org/log4j/2.x/manual/configuration.html
-3. Kafka producer configuration: https://kafka.apache.org/documentation.html#producerconfigs
-4. Hadoop configuration: http://wiki.apache.org/hadoop/HowToConfigure
-
-Q&A
----
-> TODO: Please add related questions and answers in here