You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@eagle.apache.org by yo...@apache.org on 2016/01/13 23:46:29 UTC
svn commit: r1724519 -
/incubator/eagle/site/docs/deployment-in-production.html
Author: yonzhang2012
Date: Wed Jan 13 22:46:28 2016
New Revision: 1724519
URL: http://svn.apache.org/viewvc?rev=1724519&view=rev
Log:
update eagle production setup
Modified:
incubator/eagle/site/docs/deployment-in-production.html
Modified: incubator/eagle/site/docs/deployment-in-production.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/deployment-in-production.html?rev=1724519&r1=1724518&r2=1724519&view=diff
==============================================================================
--- incubator/eagle/site/docs/deployment-in-production.html (original)
+++ incubator/eagle/site/docs/deployment-in-production.html Wed Jan 13 22:46:28 2016
@@ -182,7 +182,7 @@ Notice that Eagle requires you have full
<ul>
<li>Pre-requisites
<ul>
- <li>Hadoop Environment</li>
+ <li>Hadoop, HBase, Storm, Kafka, Zookeeper</li>
<li>Stream HDFS audit log data into Kafka</li>
</ul>
</li>
@@ -206,36 +206,38 @@ Notice that Eagle requires you have full
<ul>
<li>
- <p><strong>Hadoop Environment</strong></p>
-
+ <p><strong>Hadoop, HBase, Storm, Kafka, Zookeeper</strong></p>
+ <p>(Note: As Eagle itself uses HBase as storage it is strongly suggested that Eagle's Hadoop is separate from Hadoop to be monitored by Eagle)</P>
<ul>
<li>HDFS: 2.6.x</li>
<li>HBase: 0.98 or later</li>
<li>Storm: 0.9.3 or later</li>
<li>Kafka: 0.8.x or later</li>
+ <li>Zookeeper: 3.4.x or later</li>
<li>Java: 1.7.x</li>
</ul>
</li>
<li>
<p><strong>Stream HDFS audit log data (Only for HDFSAuditLog Monitoring)</strong></p>
-
+ <p>(Note: this HDFS audit log is from Hadoop to be monitored by Eagle)</p>
<ol>
<li>
- <p>Create a Kafka topic for importing audit log. Here is an example command to create topic sandbox_hdfs_audit_log.</p>
+ <p>Create a Kafka topic for importing audit log. Here is an example command to create topic mysite_hdfs_audit_log.</p>
<pre><code>$ cd <kafka-home>
-$ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
+$ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic mysite_hdfs_audit_log
</code></pre>
</li>
<li>
<p>Populate audit log into the Kafka topic created above, and refer to <a href="/docs/import-hdfs-auditLog.html">here</a> on How to do it.</p>
+ <p>(Note: in production it is strongly suggested to use logstash + filebeat to stream audit log)</p>
</li>
</ol>
</li>
</ul>
<h3 id="installation"><strong>Installation</strong></h3>
-
+<p>(Note: before editing configuration, refer to <a href="/docs/quick-start.html">here</a> to generate eagle binary bits)</p>
<ul>
<li>
<p>Step 1: Edit environment related configurations:</p>
@@ -325,7 +327,7 @@ $ bin/kafka-topics.sh --create --zookeep
<p>Create more policies with Eagle web <a href="/docs/tutorial/policy.html">tutorial</a></p>
</li>
<li>
- <p>Experience alerting with instructions on <a href="/docs/quick-start.html">Quick Starer</a></p>
+ <p>Experience alerting with instructions on <a href="/docs/quick-start.html">Quick Start</a></p>
</li>
<li>
<p>Enable resolver and classification functions of Eagle web <a href="/docs/tutorial/setup.html">tutorial</a></p>
@@ -348,8 +350,6 @@ $ bin/kafka-topics.sh --create --zookeep
<p>Stop eagle topologies</p>
<pre><code>$ bin/eagle-topology.sh --topology {topology-name} stop
-$ bin/eagle-topology.sh --topology {topology-name} stop
-$ bin/eagle-topology.sh --topology {topology-name} stop
</code></pre>
</li>
</ul>
@@ -411,4 +411,4 @@ Apache Eagle, Eagle, Apache, the Apache
});
</script>
</body>
-</html>
\ No newline at end of file
+</html>