You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@eagle.apache.org by ha...@apache.org on 2017/11/23 15:39:03 UTC
svn commit: r1816163 [1/3] - in /eagle/site: ./ docs/ docs/tutorial/
post/2015/10/27/
Author: hao
Date: Thu Nov 23 15:39:02 2017
New Revision: 1816163
URL: http://svn.apache.org/viewvc?rev=1816163&view=rev
Log:
Update v0.5.0
Modified:
eagle/site/docs/FAQ.html
eagle/site/docs/ambari-plugin-install.html
eagle/site/docs/cloudera-integration.html
eagle/site/docs/community.html
eagle/site/docs/configuration.html
eagle/site/docs/deployment-env.html
eagle/site/docs/deployment-in-docker.html
eagle/site/docs/deployment-in-production.html
eagle/site/docs/deployment-in-sandbox.html
eagle/site/docs/development-in-intellij.html
eagle/site/docs/development-in-macosx.html
eagle/site/docs/download-latest.html
eagle/site/docs/download.html
eagle/site/docs/hbase-auth-activity-monitoring.html
eagle/site/docs/hbase-data-activity-monitoring.html
eagle/site/docs/hdfs-auth-activity-monitoring.html
eagle/site/docs/hdfs-data-activity-monitoring.html
eagle/site/docs/hive-query-activity-monitoring.html
eagle/site/docs/import-hdfs-auditLog.html
eagle/site/docs/index.html
eagle/site/docs/installation.html
eagle/site/docs/jmx-metric-monitoring.html
eagle/site/docs/mapr-integration.html
eagle/site/docs/quick-start-0.3.0.html
eagle/site/docs/quick-start.html
eagle/site/docs/security.html
eagle/site/docs/serviceconfiguration.html
eagle/site/docs/terminology.html
eagle/site/docs/tutorial/classification.html
eagle/site/docs/tutorial/ldap.html
eagle/site/docs/tutorial/notificationplugin.html
eagle/site/docs/tutorial/policy.html
eagle/site/docs/tutorial/site-0.3.0.html
eagle/site/docs/tutorial/topologymanagement.html
eagle/site/docs/tutorial/userprofile.html
eagle/site/docs/usecases.html
eagle/site/feed.xml
eagle/site/index.html
eagle/site/post/2015/10/27/apache-eagle-announce-cn.html
Modified: eagle/site/docs/FAQ.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/FAQ.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/FAQ.html (original)
+++ eagle/site/docs/FAQ.html Thu Nov 23 15:39:02 2017
@@ -164,14 +164,16 @@
<p>Add the following line in host machineâs hosts file</p>
</blockquote>
- <pre><code>127.0.0.1 sandbox.hortonworks.com
+ <div class="highlighter-rouge"><pre class="highlight"><code>127.0.0.1 sandbox.hortonworks.com
</code></pre>
+ </div>
</li>
<li>
<p><strong>Q2. Not able to send data into kafka using kafka console producer</strong>:</p>
- <pre><code>/usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list localhost:6667 --topic sandbox_hdfs_audit_log
+ <div class="highlighter-rouge"><pre class="highlight"><code>/usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list localhost:6667 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
<blockquote>
<p>Apache Kafka broker are binding to host sandbox.hortonworks.com</p>
Modified: eagle/site/docs/ambari-plugin-install.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/ambari-plugin-install.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/ambari-plugin-install.html (original)
+++ eagle/site/docs/ambari-plugin-install.html Thu Nov 23 15:39:02 2017
@@ -168,8 +168,9 @@
<li>
<p>Create a Kafka<sup id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">1</a></sup> topic if you have not. Here is an example command.</p>
- <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
<li>
<p>Stream HDFS log data to Kafka, and refer to <a href="/docs/import-hdfs-auditLog.html">here</a> on how to do it .</p>
@@ -185,8 +186,9 @@
<li>
<p>Install Eagle Ambari plugin</p>
- <pre><code>$ /usr/hdp/current/eagle/bin/eagle-ambari.sh install
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/eagle/bin/eagle-ambari.sh install
</code></pre>
+ </div>
</li>
<li>
<p>Restart <a href="http://127.0.0.1:8000/">Ambari</a> click on disable and enable Ambari back.</p>
@@ -200,10 +202,11 @@
<li>
<p>Add Policies and meta data required by running the below script.</p>
- <pre><code>$ cd <eagle-home>
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ cd <eagle-home>
$ examples/sample-sensitivity-resource-create.sh
$ examples/sample-policy-create.sh
</code></pre>
+ </div>
</li>
</ol>
@@ -214,19 +217,19 @@ $ examples/sample-policy-create.sh
<div class="footnotes">
<ol>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
<li id="fn:STORM">
- <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
+ <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
</li>
<li id="fn:SPARK">
- <p><em>Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p>
+ <p><em>Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HBASE">
- <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:AMBARI">
- <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/cloudera-integration.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/cloudera-integration.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/cloudera-integration.html (original)
+++ eagle/site/docs/cloudera-integration.html Thu Nov 23 15:39:02 2017
@@ -168,8 +168,8 @@ This tutorial is to address these issues
<ul>
<li>Zookeeper (installed through Cloudera Manager)</li>
<li>Kafka (installed through Cloudera Manager)</li>
- <li>Storm (<code>0.9.x</code> or <code>0.10.x</code>, installed manually)</li>
- <li>Logstash (<code>2.X</code>, installed manually on NameNode)</li>
+ <li>Storm (<code class="highlighter-rouge">0.9.x</code> or <code class="highlighter-rouge">0.10.x</code>, installed manually)</li>
+ <li>Logstash (<code class="highlighter-rouge">2.X</code>, installed manually on NameNode)</li>
</ul>
<h3 id="kafka">Kafka</h3>
@@ -180,17 +180,18 @@ This tutorial is to address these issues
<ul>
<li>
- <p>Open Cloudera Manager and open âkafkaâ configuration, then set <code>âzookeeper Rootâ</code> to <code>â/â</code>.</p>
+ <p>Open Cloudera Manager and open âkafkaâ configuration, then set <code class="highlighter-rouge">âzookeeper Rootâ</code> to <code class="highlighter-rouge">â/â</code>.</p>
</li>
<li>
- <p>If Kafka cannot be started successfully, check kafkaâs log. If stack trace shows: <code>âjava.lang.OutOfMemoryError: Java heap spaceâ</code>. Increase heap size by setting <code>"KAFKA_HEAP_OPTS"</code>in <code>/bin/kafka-server-start.sh</code>.</p>
+ <p>If Kafka cannot be started successfully, check kafkaâs log. If stack trace shows: <code class="highlighter-rouge">âjava.lang.OutOfMemoryError: Java heap spaceâ</code>. Increase heap size by setting <code class="highlighter-rouge">"KAFKA_HEAP_OPTS"</code>in <code class="highlighter-rouge">/bin/kafka-server-start.sh</code>.</p>
</li>
</ul>
<p>Example:</p>
-<pre><code> export KAFKA_HEAP_OPTS="-Xmx2G -Xms2G"
+<div class="highlighter-rouge"><pre class="highlight"><code> export KAFKA_HEAP_OPTS="-Xmx2G -Xms2G"
</code></pre>
+</div>
<h4 id="verification">Verification</h4>
@@ -198,15 +199,17 @@ This tutorial is to address these issues
<li>Step1: create a kafka topic (here I created a topic called âtestâ, which will be used in logstash configuration file to receive hdfsAudit log messages from Cloudera.</li>
</ul>
-<pre><code>bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic test
+<div class="highlighter-rouge"><pre class="highlight"><code>bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic test
</code></pre>
+</div>
<ul>
<li>Step2: check if topic has been created successfully.</li>
</ul>
-<pre><code>bin/kafka-topics.sh --list --zookeeper 127.0.0.1:2181
+<div class="highlighter-rouge"><pre class="highlight"><code>bin/kafka-topics.sh --list --zookeeper 127.0.0.1:2181
</code></pre>
+</div>
<p>this command will show all created topics.</p>
@@ -214,9 +217,10 @@ This tutorial is to address these issues
<li>Step3: open two terminals, start âproducerâ and âconsumerâ separately.</li>
</ul>
-<pre><code>/usr/bin/kafka-console-producer --broker-list hostname:9092 --topic test
+<div class="highlighter-rouge"><pre class="highlight"><code>/usr/bin/kafka-console-producer --broker-list hostname:9092 --topic test
/usr/bin/kafka-console-consumer --zookeeper hostname:2181 --topic test
</code></pre>
+</div>
<ul>
<li>Step4: type in some message in producer. If consumer can receive the messages sent from producer, then kafka is working fine. Otherwise please check the configuration and logs to identify the root cause of issues.</li>
@@ -228,33 +232,36 @@ This tutorial is to address these issues
<p>You can follow <a href="https://www.elastic.co/downloads/logstash">logstash online doc</a> to download and install logstash on your machine:</p>
-<p>Or you can install it through <code>yum</code> if you are using centos:</p>
+<p>Or you can install it through <code class="highlighter-rouge">yum</code> if you are using centos:</p>
<ul>
<li>download and install the public signing key:</li>
</ul>
-<pre><code>rpm --import https://packages.elastic.co/GPG-KEY-elasticsearch
+<div class="highlighter-rouge"><pre class="highlight"><code>rpm --import https://packages.elastic.co/GPG-KEY-elasticsearch
</code></pre>
+</div>
<ul>
- <li>Add the following lines in <code>/etc/yum.repos.d/</code> directory in a file with a <code>.repo</code> suffix, for example <code>logstash.repo</code>.</li>
+ <li>Add the following lines in <code class="highlighter-rouge">/etc/yum.repos.d/</code> directory in a file with a <code class="highlighter-rouge">.repo</code> suffix, for example <code class="highlighter-rouge">logstash.repo</code>.</li>
</ul>
-<pre><code>[logstash-2.3]
+<div class="highlighter-rouge"><pre class="highlight"><code>[logstash-2.3]
name=Logstash repository for 2.3.x packages
baseurl=https://packages.elastic.co/logstash/2.3/centos
gpgcheck=1
gpgkey=https://packages.elastic.co/GPG-KEY-elasticsearch
enabled=1
</code></pre>
+</div>
<ul>
- <li>Then install it using <code>yum</code>:</li>
+ <li>Then install it using <code class="highlighter-rouge">yum</code>:</li>
</ul>
-<pre><code>yum install logstash
+<div class="highlighter-rouge"><pre class="highlight"><code>yum install logstash
</code></pre>
+</div>
<h4 id="create-conf-file">Create conf file</h4>
@@ -262,8 +269,9 @@ enabled=1
<h4 id="start-logstash">Start logstash</h4>
-<pre><code>bin/logstash -f conf/first-pipeline.conf
+<div class="highlighter-rouge"><pre class="highlight"><code>bin/logstash -f conf/first-pipeline.conf
</code></pre>
+</div>
<h4 id="verification-1">Verification</h4>
@@ -274,51 +282,55 @@ enabled=1
<h4 id="installation-1">Installation</h4>
-<p>Download Apache Storm from <a href="http://storm.apache.org/downloads.html">here</a>, the version you choose should be <code>0.10.x</code> or <code>0.9.x</code> release.
+<p>Download Apache Storm from <a href="http://storm.apache.org/downloads.html">here</a>, the version you choose should be <code class="highlighter-rouge">0.10.x</code> or <code class="highlighter-rouge">0.9.x</code> release.
Then follow <a href="http://storm.apache.org/releases/0.10.0/Setting-up-a-Storm-cluster.html">Apache Storm online doc</a>) to install Apache Storm on your cluster.</p>
-<p>In <code>/etc/profile</code>, add this:</p>
+<p>In <code class="highlighter-rouge">/etc/profile</code>, add this:</p>
-<pre><code>export PATH=$PATH:/opt/apache-storm-0.10.1/bin/
+<div class="highlighter-rouge"><pre class="highlight"><code>export PATH=$PATH:/opt/apache-storm-0.10.1/bin/
</code></pre>
+</div>
<p>save the profile and then type:</p>
-<pre><code>source /etc/profile
+<div class="highlighter-rouge"><pre class="highlight"><code>source /etc/profile
</code></pre>
+</div>
<p>to make it work.</p>
<h4 id="configuration-1">Configuration</h4>
-<p>In <code>storm/conf/storm.yaml</code>, change the hostname to your own host.</p>
+<p>In <code class="highlighter-rouge">storm/conf/storm.yaml</code>, change the hostname to your own host.</p>
<h4 id="start-apache-storm">Start Apache Storm</h4>
<p>In Termial, type:</p>
-<pre><code>$: storm nimbus
+<div class="highlighter-rouge"><pre class="highlight"><code>$: storm nimbus
$: storm supervisor
$: storm UI
</code></pre>
+</div>
<h4 id="verification-2">Verification</h4>
-<p>Open storm UI in your browser, default URL is : <code>http://hostname:8080/index.html</code>.</p>
+<p>Open storm UI in your browser, default URL is : <code class="highlighter-rouge">http://hostname:8080/index.html</code>.</p>
<h3 id="apache-eagle">Apache Eagle</h3>
<p>To download and install Apache Eagle, please refer to <a href="http://eagle.incubator.apache.org/docs/quick-start.html">Get Started with Sandbox.</a> .</p>
-<p>One thing need to mention is: in <code>â/bin/eagle-topology.shâ</code>, line 102:</p>
+<p>One thing need to mention is: in <code class="highlighter-rouge">â/bin/eagle-topology.shâ</code>, line 102:</p>
-<pre><code> storm_ui=http://localhost:8080
+<div class="highlighter-rouge"><pre class="highlight"><code> storm_ui=http://localhost:8080
</code></pre>
+</div>
<p>If you are not using the default port number, change this to your own Storm UI url.</p>
<p>I know it takes time to finish these configuration, but now it is time to have fun!
-Just try <code>HDFS Data Activity Monitoring</code> with <code>Demo</code> listed in <a href="http://eagle.incubator.apache.org/docs/hdfs-data-activity-monitoring.html">HDFS Data Activity Monitoring.</a></p>
+Just try <code class="highlighter-rouge">HDFS Data Activity Monitoring</code> with <code class="highlighter-rouge">Demo</code> listed in <a href="http://eagle.incubator.apache.org/docs/hdfs-data-activity-monitoring.html">HDFS Data Activity Monitoring.</a></p>
</div><!--end of loadcontent-->
Modified: eagle/site/docs/community.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/community.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/community.html (original)
+++ eagle/site/docs/community.html Thu Nov 23 15:39:02 2017
@@ -183,13 +183,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:user@eagle.apache.org">user@eagle.apache.org</a></td>
+ <td><a href="mailto:user@eagle.apache.org">user@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:user-subscribe@eagle.apache.org">subscribe</a></td>
- <td><a href="mailto:user-unsubscribe@eagle.apache.org">unsubscribe</a></td>
+ <td><a href="mailto:user-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a href="mailto:user-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a href="http://mail-archives.apache.org/mod_mbox/eagle-user/">eagle-user</a></td>
</tr>
<tr>
@@ -198,13 +198,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:dev@eagle.apache.org">dev@eagle.apache.org</a></td>
+ <td><a href="mailto:dev@eagle.apache.org">dev@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:dev-subscribe@eagle.apache.org">subscribe</a></td>
- <td><a href="mailto:dev-unsubscribe@eagle.apache.org">unsubscribe</a></td>
+ <td><a href="mailto:dev-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a href="mailto:dev-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a href="http://mail-archives.apache.org/mod_mbox/eagle-dev/">eagle-dev</a></td>
</tr>
<tr>
@@ -213,13 +213,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:issues@eagle.apache.org">issues@eagle.apache.org</a></td>
+ <td><a href="mailto:issues@eagle.apache.org">issues@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:issues-subscribe@eagle.apache.org">subscribe</a></td>
- <td><a href="mailto:issues-unsubscribe@eagle.apache.org">unsubscribe</a></td>
+ <td><a href="mailto:issues-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a href="mailto:issues-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a href="http://mail-archives.apache.org/mod_mbox/eagle-issues/">eagle-issues</a></td>
</tr>
<tr>
@@ -228,13 +228,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:commits@eagle.apache.org">commits@eagle.apache.org</a></td>
+ <td><a href="mailto:commits@eagle.apache.org">commits@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a href="mailto:commits-subscribe@eagle.apache.org">subscribe</a></td>
- <td><a href="mailto:commits-unsubscribe@eagle.apache.org">unsubscribe</a></td>
+ <td><a href="mailto:commits-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a href="mailto:commits-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a href="http://mail-archives.apache.org/mod_mbox/eagle-commits/">eagle-commits</a></td>
</tr>
</tbody>
@@ -317,7 +317,7 @@
<li><strong>Wechat</strong>: Apache_Eagle</li>
</ul>
-<h3 id="events-and-meetupshadoop">Events and Meetups<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup></h3>
+<h3 id="events-and-meetups">Events and Meetups<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup></h3>
<p><strong>Conferences</strong></p>
@@ -335,7 +335,7 @@
<div class="footnotes">
<ol>
<li id="fn:HADOOP">
- <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/configuration.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/configuration.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/configuration.html (original)
+++ eagle/site/docs/configuration.html Thu Nov 23 15:39:02 2017
@@ -156,7 +156,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left: -15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Application Configuration</h1>
- <p>Apache Eagle (called Eagle in the following) requires you to create a configuration file under <code>$EAGLE_HOME/conf/</code> for each application. Basically, there are some common properties shared, e.g., envContextConfig, eagleProps, and dynamicConfigSource. While dataSourceConfig differs from application to application.</p>
+ <p>Apache Eagle (called Eagle in the following) requires you to create a configuration file under <code class="highlighter-rouge">$EAGLE_HOME/conf/</code> for each application. Basically, there are some common properties shared, e.g., envContextConfig, eagleProps, and dynamicConfigSource. While dataSourceConfig differs from application to application.</p>
<p>In this page we take the following two application as examples</p>
@@ -610,22 +610,22 @@
<div class="footnotes">
<ol>
<li id="fn:HIVE">
- <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:STORM">
- <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
</li>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
<li id="fn:ZOOKEEPER">
- <p><em>All mentions of âzookeeperâ on this page represent Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âzookeeperâ on this page represent Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HBASE">
- <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:TOMCAT">
- <p><em>Apache Tomcat.</em> <a href="#fnref:TOMCAT" class="reversefootnote">↩</a></p>
+ <p><em>Apache Tomcat.</em> <a href="#fnref:TOMCAT" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/deployment-env.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/deployment-env.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/deployment-env.html (original)
+++ eagle/site/docs/deployment-env.html Thu Nov 23 15:39:02 2017
@@ -158,7 +158,7 @@
<h1 class="page-header" style="margin-top: 0px">Deploy Environment</h1>
<h3 id="setup-environment">Setup Environment</h3>
-<p>Apache Eagle (called Eagle in the following) as an analytics solution for identifying security and performance issues instantly, relies on streaming platform <code>Storm</code><sup id="fnref:STORM"><a href="#fn:STORM" class="footnote">1</a></sup> + <code>Kafka</code><sup id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">2</a></sup> to meet the realtime criteria, and persistence storage to store metadata and some metrics. As for the persistence storage, it supports three types of database: <code>HBase</code><sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">3</a></sup>, <code>Derby</code><sup id="fnref:DERBY"><a href="#fn:DERBY" class="footnote">4</a></sup>, and <code>Mysql</code></p>
+<p>Apache Eagle (called Eagle in the following) as an analytics solution for identifying security and performance issues instantly, relies on streaming platform <code class="highlighter-rouge">Storm</code><sup id="fnref:STORM"><a href="#fn:STORM" class="footnote">1</a></sup> + <code class="highlighter-rouge">Kafka</code><sup id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">2</a></sup> to meet the realtime criteria, and persistence storage to store metadata and some metrics. As for the persistence storage, it supports three types of database: <code class="highlighter-rouge">HBase</code><sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">3</a></sup>, <code class="highlighter-rouge">Derby</code><sup id="fnref:DERBY"><a href="#fn:DERBY" class="footnote">4</a></sup>, and <code class="highlighter-rouge">Mysql</code></p>
<p>To run monitoring applications, Eagle requires the following dependencies.</p>
@@ -226,22 +226,22 @@
<div class="footnotes">
<ol>
<li id="fn:STORM">
- <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
</li>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HBASE">
- <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:DERBY">
- <p><em>All mentions of âderbyâ on this page represent Apache Derby.</em> <a href="#fnref:DERBY" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âderbyâ on this page represent Apache Derby.</em> <a href="#fnref:DERBY" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HADOOP">
- <p><em>Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
+ <p><em>Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
</li>
<li id="fn:AMBARI">
- <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/deployment-in-docker.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/deployment-in-docker.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/deployment-in-docker.html (original)
+++ eagle/site/docs/deployment-in-docker.html Thu Nov 23 15:39:02 2017
@@ -166,13 +166,14 @@
<li>
<p>Pull latest eagle docker image from <a href="https://hub.docker.com/r/apacheeagle/sandbox/">docker hub</a> directly:</p>
- <pre><code>docker pull apacheeagle/sandbox
+ <div class="highlighter-rouge"><pre class="highlight"><code>docker pull apacheeagle/sandbox
</code></pre>
+ </div>
</li>
<li>
<p>Then run eagle docker image:</p>
- <pre><code>docker run -p 9099:9099 -p 8080:8080 -p 8744:8744 -p 2181:2181 -p 2888:2888 \
+ <div class="highlighter-rouge"><pre class="highlight"><code>docker run -p 9099:9099 -p 8080:8080 -p 8744:8744 -p 2181:2181 -p 2888:2888 \
-p 6667:6667 -p 60020:60020 -p 60030:60030 -p 60010:60010 -d --dns 127.0.0.1 \
--entrypoint /usr/local/serf/bin/start-serf-agent.sh -e KEYCHAIN= \
--env EAGLE_SERVER_HOST=sandbox.eagle.apache.org --name sandbox \
@@ -182,6 +183,7 @@ docker run -it --rm -e EXPECTED_HOST_COU
--link sandbox:ambariserver --entrypoint /bin/sh apacheeagle/sandbox:latest \
-c /tmp/install-cluster.sh
</code></pre>
+ </div>
</li>
</ul>
</li>
@@ -192,14 +194,16 @@ docker run -it --rm -e EXPECTED_HOST_COU
<li>
<p>Get latest source code of eagle.</p>
- <pre><code>git clone https://github.com/apache/eagle.git
+ <div class="highlighter-rouge"><pre class="highlight"><code>git clone https://github.com/apache/eagle.git
</code></pre>
+ </div>
</li>
<li>
<p>Then run eagle docker command.</p>
- <pre><code>cd eagle && ./eagle-docker boot
+ <div class="highlighter-rouge"><pre class="highlight"><code>cd eagle && ./eagle-docker boot
</code></pre>
+ </div>
</li>
</ul>
</li>
Modified: eagle/site/docs/deployment-in-production.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/deployment-in-production.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/deployment-in-production.html (original)
+++ eagle/site/docs/deployment-in-production.html Thu Nov 23 15:39:02 2017
@@ -184,9 +184,9 @@
<ul>
<li>
- <p>Edit <code>bin/eagle-env.sh</code></p>
+ <p>Edit <code class="highlighter-rouge">bin/eagle-env.sh</code></p>
- <pre><code> # TODO: make sure java version is 1.7.x
+ <div class="highlighter-rouge"><pre class="highlight"><code> # TODO: make sure java version is 1.7.x
export JAVA_HOME=
# TODO: Apache Storm nimbus host. Default is localhost
@@ -195,11 +195,12 @@
# TODO: EAGLE_SERVICE_HOST, default is `hostname -f`
export EAGLE_SERVICE_HOST=localhost
</code></pre>
+ </div>
</li>
<li>
- <p>Edit <code>conf/eagle-service.conf</code> to configure the database to use (for example: HBase<sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">1</a></sup>)</p>
+ <p>Edit <code class="highlighter-rouge">conf/eagle-service.conf</code> to configure the database to use (for example: HBase<sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">1</a></sup>)</p>
- <pre><code> # TODO: hbase.zookeeper.quorum in the format host1,host2,host3,...
+ <div class="highlighter-rouge"><pre class="highlight"><code> # TODO: hbase.zookeeper.quorum in the format host1,host2,host3,...
# default is "localhost"
hbase-zookeeper-quorum="localhost"
@@ -211,13 +212,14 @@
# default is "/hbase"
zookeeper-znode-parent="/hbase"
</code></pre>
+ </div>
</li>
</ul>
</li>
<li>
<p>Step 2: Install metadata for policies</p>
- <pre><code> $ cd <eagle-home>
+ <div class="highlighter-rouge"><pre class="highlight"><code> $ cd <eagle-home>
# start Eagle web service
$ bin/eagle-service.sh start
@@ -225,6 +227,7 @@
# import metadata after Eagle service is successfully started
$ bin/eagle-topology-init.sh
</code></pre>
+ </div>
</li>
</ul>
@@ -260,8 +263,9 @@
<li>
<p>Stop eagle service</p>
- <pre><code>$ bin/eagle-service.sh stop
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ bin/eagle-service.sh stop
</code></pre>
+ </div>
</li>
</ul>
@@ -272,13 +276,13 @@
<div class="footnotes">
<ol>
<li id="fn:HBASE">
- <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HADOOP">
- <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HIVE">
- <p><em>Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
+ <p><em>Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/deployment-in-sandbox.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/deployment-in-sandbox.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/deployment-in-sandbox.html (original)
+++ eagle/site/docs/deployment-in-sandbox.html Thu Nov 23 15:39:02 2017
@@ -201,21 +201,23 @@
<p><strong>Option 1</strong>: Download eagle jar from <a href="http://66.211.190.194/eagle-0.1.0.tar.gz">here</a>.</p>
</li>
<li>
- <p><strong>Option 2</strong>: Build form source code <a href="https://github.com/apache/eagle">eagle github</a>. After successful build, âeagle-xxx-bin.tar.gzâ will be generated under <code>./eagle-assembly/target</code></p>
+ <p><strong>Option 2</strong>: Build form source code <a href="https://github.com/apache/eagle">eagle github</a>. After successful build, âeagle-xxx-bin.tar.gzâ will be generated under <code class="highlighter-rouge">./eagle-assembly/target</code></p>
- <pre><code># installed npm is required before compiling
+ <div class="highlighter-rouge"><pre class="highlight"><code># installed npm is required before compiling
$ mvn clean install -DskipTests=true
</code></pre>
+ </div>
</li>
</ul>
</li>
<li>
<p><strong>Copy and extract the package to sandbox</strong></p>
- <pre><code>#extract
+ <div class="highlighter-rouge"><pre class="highlight"><code>#extract
$ tar -zxvf eagle-0.1.0-bin.tar.gz
$ mv eagle-0.1.0 /usr/hdp/current/eagle
</code></pre>
+ </div>
</li>
</ul>
@@ -229,9 +231,10 @@ $ mv eagle-0.1.0 /usr/hdp/current/eagle
<li>
<p><strong>Option 1</strong>: Install Eagle using command line</p>
- <pre><code>$ cd /usr/hdp/current/eagle
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ cd /usr/hdp/current/eagle
$ examples/eagle-sandbox-starter.sh
</code></pre>
+ </div>
</li>
<li>
<p><strong>Option 2</strong>: Install Eagle using <a href="/docs/ambari-plugin-install.html">Eagle Ambari plugin</a></p>
@@ -246,7 +249,7 @@ $ examples/eagle-sandbox-starter.sh
<li>
<p><strong>Step 1</strong>: Configure Advanced hadoop-log4j via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, and add below âKAFKA_HDFS_AUDITâ log4j appender to hdfs audit logging.</p>
- <pre><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <div class="highlighter-rouge"><pre class="highlight"><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -256,22 +259,25 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
#log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=1
#log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=1
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p>
- <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 4</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, and append the following command to it.</p>
- <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
+ <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -279,14 +285,15 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
<p><strong>Step 5</strong>: save the changes and restart the namenode.</p>
</li>
<li>
- <p><strong>Step 6</strong>: Check whether logs are flowing into topic <code>sandbox_hdfs_audit_log</code></p>
+ <p><strong>Step 6</strong>: Check whether logs are flowing into topic <code class="highlighter-rouge">sandbox_hdfs_audit_log</code></p>
- <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
</ul>
-<p>Now please login to Eagle web http://localhost:9099/eagle-service with account <code>admin/secret</code>, and try the sample demos on
+<p>Now please login to Eagle web http://localhost:9099/eagle-service with account <code class="highlighter-rouge">admin/secret</code>, and try the sample demos on
<a href="/docs/quick-start.html">Quick Starer</a></p>
<p>(If the NAT network is used in a virtual machine, itâs required to add port 9099 to forwarding ports)
@@ -300,19 +307,19 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
<div class="footnotes">
<ol>
<li id="fn:HADOOP">
- <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
</li>
<li id="fn:AMBARI">
- <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HBASE">
- <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:STORM">
- <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
</li>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/development-in-intellij.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/development-in-intellij.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/development-in-intellij.html (original)
+++ eagle/site/docs/development-in-intellij.html Thu Nov 23 15:39:02 2017
@@ -158,7 +158,7 @@
<h1 class="page-header" style="margin-top: 0px">Development in Intellij</h1>
<p>Apache Eagle (called Eagle in the following) can be developed in popular IDE, e.g. Intellij and Eclipse. Here we focus on development in Intellij.</p>
-<h3 id="prepare-hadoophadoop-environment">1. Prepare Hadoop<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup> environment</h3>
+<h3 id="1-prepare-hadoop-environment">1. Prepare Hadoop<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup> environment</h3>
<p>Normally HDP sandbox is needed for testing Hadoop monitoring. Please reference <a href="/docs/quick-start.html">Quick Start</a> for setting up HDP sandbox.</p>
@@ -185,7 +185,7 @@
</li>
</ul>
-<h3 id="start-eagle-web-service-in-intellij">2. Start Eagle web service in Intellij</h3>
+<h3 id="2-start-eagle-web-service-in-intellij">2. Start Eagle web service in Intellij</h3>
<p>Import source code into Intellij, and find eagle-webservice project. Intellij Ultimate supports launching J2EE server within Intellij. If you donât have
Intellij Ultimate version, Eclipse is another option.</p>
@@ -208,7 +208,7 @@ Intellij Ultimate version, Eclipse is an
<p>Configure Intellij for running Apache Tomcat server with eagle-service artifacts</p>
-<h3 id="start-topology-in-intellij">3. Start topology in Intellij</h3>
+<h3 id="3-start-topology-in-intellij">3. Start topology in Intellij</h3>
<ul>
<li><strong>Check topology configuration</strong></li>
@@ -237,19 +237,19 @@ Intellij Ultimate version, Eclipse is an
<div class="footnotes">
<ol>
<li id="fn:HADOOP">
- <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HBASE">
- <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:ZOOKEEPER">
- <p><em>Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p>
+ <p><em>Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p>
</li>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
<li id="fn:STORM">
- <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/development-in-macosx.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/development-in-macosx.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/development-in-macosx.html (original)
+++ eagle/site/docs/development-in-macosx.html Thu Nov 23 15:39:02 2017
@@ -159,7 +159,7 @@
<h2 id="how-to-setup-apache-eagle-development-environment-on-mac-osx">How to Setup Apache Eagle Development Environment on Mac OSX</h2>
<p><em>Apache Eagle will be called Eagle in the following.</em><br />
-This tutorial is based <code>Mac OS X</code>. It can be used as a reference guide for other OS like Linux or Windows as well. To save your time of jumping back and forth between different web pages, all necessary references will be pointed out.</p>
+This tutorial is based <code class="highlighter-rouge">Mac OS X</code>. It can be used as a reference guide for other OS like Linux or Windows as well. To save your time of jumping back and forth between different web pages, all necessary references will be pointed out.</p>
<h3 id="prerequisite">Prerequisite</h3>
@@ -169,8 +169,9 @@ This tutorial is based <code>Mac OS X</c
<p>Make sure you have HomeBrew installed on your mac. If not, please run:</p>
-<pre><code>$ ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
+<div class="highlighter-rouge"><pre class="highlight"><code>$ ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
</code></pre>
+</div>
<p>you can find more information about HomeBrew at http://brew.sh/ .</p>
@@ -180,9 +181,10 @@ This tutorial is based <code>Mac OS X</c
<p>Some core eagle modules are written with scala. To install Scala and SBT, just run:</p>
-<pre><code> $ brew install scala
+<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install scala
$ brew install sbt
</code></pre>
+</div>
<ul>
<li><strong>NPM</strong></li>
@@ -190,8 +192,9 @@ This tutorial is based <code>Mac OS X</c
<p>Eagle-webservice module uses npm. To install it, run:</p>
-<pre><code> $ brew install npm
+<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install npm
</code></pre>
+</div>
<ul>
<li><strong>Apache Maven</strong></li>
@@ -199,8 +202,9 @@ This tutorial is based <code>Mac OS X</c
<p>Eagle is built with maven:</p>
-<pre><code> $ brew install maven
+<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install maven
</code></pre>
+</div>
<ul>
<li>
@@ -210,8 +214,9 @@ This tutorial is based <code>Mac OS X</c
<li>
<p>Install HomeBrew Cask:</p>
- <pre><code>$ brew install caskroom/cask/brew-cask
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ brew install caskroom/cask/brew-cask
</code></pre>
+ </div>
</li>
<li>
<p>Next, install JDK via HomeBrew:</p>
@@ -224,15 +229,18 @@ This tutorial is based <code>Mac OS X</c
<p>you will see all available JDK versions and you can install multiple JDK versions in this way. For eagle please choose java7 to install:</p>
-<pre><code> $ brew cask install java7
+<div class="highlighter-rouge"><pre class="highlight"><code> $ brew cask install java7
</code></pre>
+</div>
-<p><strong>Note:</strong>
-- During this writing SBT has issue with JDK 8. This issue has been tested confirmed by using:
-- Java 1.8.0_66
-- Maven 3.3.9
-- Scala 2.11.7
-- Sbt 0.13.9</p>
+<p><strong>Note:</strong></p>
+<ul>
+ <li>During this writing SBT has issue with JDK 8. This issue has been tested confirmed by using:</li>
+ <li>Java 1.8.0_66</li>
+ <li>Maven 3.3.9</li>
+ <li>Scala 2.11.7</li>
+ <li>Sbt 0.13.9</li>
+</ul>
<p>you can find more information about HomeBrew Cask at <a href="http://caskroom.io">http://caskroom.io</a></p>
@@ -242,44 +250,53 @@ This tutorial is based <code>Mac OS X</c
<p>you can use Jenv to manage installed multiple Java versions. To install it:</p>
-<pre><code>$ brew install https://raw.githubusercontent.com/entrypass/jenv/homebrew/homebrew/jenv.rb
+<div class="highlighter-rouge"><pre class="highlight"><code>$ brew install https://raw.githubusercontent.com/entrypass/jenv/homebrew/homebrew/jenv.rb
</code></pre>
+</div>
<p>and make sure activate it automatically:</p>
-<pre><code>$ echo 'eval "$(jenv init -)"' >> ~/.bash_profile
+<div class="highlighter-rouge"><pre class="highlight"><code>$ echo 'eval "$(jenv init -)"' >> ~/.bash_profile
</code></pre>
+</div>
-<p><strong>Note:</strong>
-- There is a known issue at this writing: https://github.com/gcuisinier/jenv/wiki/Trouble-Shooting
-- Please make sure JENV_ROOT has been set before jenv init:
-- $ export JENV_ROOT=/usr/local/opt/jenv</p>
+<p><strong>Note:</strong></p>
+<ul>
+ <li>There is a known issue at this writing: https://github.com/gcuisinier/jenv/wiki/Trouble-Shooting</li>
+ <li>Please make sure JENV_ROOT has been set before jenv init:</li>
+ <li>$ export JENV_ROOT=/usr/local/opt/jenv</li>
+</ul>
<p>Now let Jenv manage JDK versions (remember In OSX all JVMs are located at /Library/Java/JavaVirtualMachines):</p>
-<pre><code>$ jenv add /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/
+<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv add /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/
$ jenv add /Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/
</code></pre>
+</div>
<p>and</p>
-<pre><code>$ jenv rehash
+<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv rehash
</code></pre>
+</div>
<p>You can see all managed JDK versions:</p>
-<pre><code>$ jenv versions
+<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv versions
</code></pre>
+</div>
<p>set global java version:</p>
-<pre><code>$ jenv global oracle64-1.8.0.66
+<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv global oracle64-1.8.0.66
</code></pre>
+</div>
<p>switch to your eagle home directory and set the local JDK version for eagle:</p>
-<pre><code>$ jenv local oracle64-1.7.0.80
+<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv local oracle64-1.7.0.80
</code></pre>
+</div>
<p>you can find more information about Jenv at https://github.com/rbenv/rbenv and http://hanxue-it.blogspot.com/2014/05/installing-java-8-managing-multiple.html.</p>
@@ -287,8 +304,9 @@ $ jenv add /Library/Java/JavaVirtualMach
<p>Go to Eagle home directory and run:</p>
-<pre><code>mvn -DskipTests clean package
+<div class="highlighter-rouge"><pre class="highlight"><code>mvn -DskipTests clean package
</code></pre>
+</div>
<p>Thatâs all. Now you have runnable eagle on your Mac. Have fun. :-)</p>
Modified: eagle/site/docs/download-latest.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/download-latest.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/download-latest.html (original)
+++ eagle/site/docs/download-latest.html Thu Nov 23 15:39:02 2017
@@ -157,58 +157,29 @@
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left: -15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Apache Eagle Latest Download</h1>
<blockquote>
- <p>Version <code>0.4.0-incubating</code> is the latest release and <code>0.5.0-SNAPSHOT</code> is under active development on <a href="https://github.com/apache/eagle/tree/master">master</a> branch.</p>
+ <p>Version <strong>0.5.0</strong> is the latest release and 0.5.0-SNAPSHOT is under active development on <a href="https://github.com/apache/eagle/tree/master">master</a> branch.</p>
<p>You can verify your download by following these <a href="https://www.apache.org/info/verification.html">procedures</a> and using these <a href="https://dist.apache.org/repos/dist/release/eagle/KEYS">KEYS</a>.</p>
</blockquote>
-<h1 id="snapshot">0.5.0-SNAPSHOT</h1>
-
-<blockquote>
- <p>The first GA version <code>v0.5.0</code> with fantastic improvements and features is coming soon!</p>
-</blockquote>
-
-<ul>
- <li>
- <p>Build from source code:</p>
-
- <pre><code> git clone https://github.com/apache/eagle.git
-</code></pre>
- </li>
- <li>Release notes for preview:
- <ul>
- <li><a href="https://cwiki.apache.org/confluence/display/EAG/Eagle+Version+0.5.0">Eagle 0.5.0 Release Notes</a></li>
- </ul>
- </li>
- <li>Documentation:
- <ul>
- <li><a href="/docs/latest/">Eagle 0.5.0 Documentations</a></li>
- </ul>
- </li>
-</ul>
-
-<h1 id="incubating">0.4.0-incubating</h1>
-
-<p><a href="http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.eagle%22%20AND%20a%3A%22eagle-parent%22"><img src="https://maven-badges.herokuapp.com/maven-central/org.apache.eagle/eagle-parent/badge.svg" alt="Eagle Latest Maven Release" /></a></p>
-
+<h1 id="050">0.5.0</h1>
<ul>
<li>Release notes:
<ul>
- <li><a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.4.0-incubating">Eagle 0.4.0 Release Notes</a></li>
+ <li><a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.5.0">Eagle 0.5.0 Release Notes</a></li>
</ul>
</li>
<li>Source download:
<ul>
- <li><a href="http://www.apache.org/dyn/closer.cgi?path=/eagle/apache-eagle-0.4.0-incubating">apache-eagle-0.4.0-incubating-src.tar.gz</a></li>
- <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.md5">apache-eagle-0.4.0-incubating-src.tar.gz.md5</a></li>
- <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.sha1">apache-eagle-0.4.0-incubating-src.tar.gz.sha1</a></li>
- <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.asc">apache-eagle-0.4.0-incubating-src.tar.gz.asc</a></li>
+ <li><a href="http://www.apache.org/dyn/closer.cgi?path=/incubator/eagle/apache-eagle-0.5.0-incubating">apache-eagle-0.5.0-src.tar.gz</a></li>
+ <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.md5">apache-eagle-0.5.0-src.tar.gz.md5</a></li>
+ <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.sha1">apache-eagle-0.5.0-src.tar.gz.sha1</a></li>
+ <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.asc">apache-eagle-0.5.0-src.tar.gz.asc</a></li>
</ul>
</li>
<li>Git revision:
<ul>
- <li>tag: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.4.0-incubating">v0.4.0-incubating</a></li>
- <li>commit: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=eac0f27958f2ed8c6842938dad0a995a87fd0715">eac0f27958f2ed8c6842938dad0a995a87fd0715</a></li>
+ <li>tag: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.5.0">v0.5.0</a></li>
</ul>
</li>
</ul>
@@ -216,6 +187,7 @@
<h1 id="previous-releases">Previous Releases</h1>
<ul>
+ <li><a href="/docs/download.html#0.4.0-incubating">Eagle 0.4.0-incubating</a></li>
<li><a href="/docs/download.html#0.3.0-incubating">Eagle 0.3.0-incubating</a></li>
</ul>
Modified: eagle/site/docs/download.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/download.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/download.html (original)
+++ eagle/site/docs/download.html Thu Nov 23 15:39:02 2017
@@ -160,7 +160,30 @@
<p>You can verify your download by following these <a href="https://www.apache.org/info/verification.html">procedures</a> and using these <a href="https://dist.apache.org/repos/dist/release/eagle/KEYS">KEYS</a>.</p>
</blockquote>
-<h1 id="incubating">0.4.0-incubating</h1>
+<h1 id="050">0.5.0</h1>
+<ul>
+ <li>Release notes:
+ <ul>
+ <li><a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.5.0">Eagle 0.5.0 Release Notes</a></li>
+ </ul>
+ </li>
+ <li>Source download:
+ <ul>
+ <li><a href="http://www.apache.org/dyn/closer.cgi?path=/incubator/eagle/apache-eagle-0.5.0-incubating">apache-eagle-0.5.0-src.tar.gz</a></li>
+ <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.md5">apache-eagle-0.5.0-src.tar.gz.md5</a></li>
+ <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.sha1">apache-eagle-0.5.0-src.tar.gz.sha1</a></li>
+ <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.asc">apache-eagle-0.5.0-src.tar.gz.asc</a></li>
+ </ul>
+ </li>
+ <li>Git revision:
+ <ul>
+ <li>tag: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.5.0">v0.5.0</a></li>
+ <li>commit: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=c930a7ab4a4fb78a1cbacd8f8419de3b5dbf1bd7">c930a7ab4a4fb78a1cbacd8f8419de3b5dbf1bd7</a></li>
+ </ul>
+ </li>
+</ul>
+
+<h1 id="040-incubating">0.4.0-incubating</h1>
<ul>
<li>Release notes:
<ul>
@@ -183,7 +206,7 @@
</li>
</ul>
-<h1 id="incubating-1">0.3.0-incubating</h1>
+<h1 id="030-incubating">0.3.0-incubating</h1>
<ul>
<li>Release notes:
Modified: eagle/site/docs/hbase-auth-activity-monitoring.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/hbase-auth-activity-monitoring.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/hbase-auth-activity-monitoring.html (original)
+++ eagle/site/docs/hbase-auth-activity-monitoring.html Thu Nov 23 15:39:02 2017
@@ -160,11 +160,11 @@
<p>Please follow below steps to enable HBase authorization auditing in HDP sandbox and Cloudera</p>
-<h4 id="in-hbase-sitexml">1. in hbase-site.xml</h4>
+<h4 id="1-in-hbase-sitexml">1. in hbase-site.xml</h4>
<p>Note: when testing in HDP sandbox, sometimes Apache Ranger will take over access controll for HBase, so maybe you need change that back to native hbase access controller, i.e. change com.xasecure.authorization.hbase.XaSecureAuthorizationCoprocessor to org.apache.hadoop.hbase.security.access.AccessController</p>
-<pre><code><property>
+<div class="highlighter-rouge"><pre class="highlight"><code><property>
<name>hbase.security.authorization</name>
<value>true</value>
</property>
@@ -177,10 +177,11 @@
<value>org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController</value>
</property>
</code></pre>
+</div>
-<h4 id="log4jproperties">2. log4j.properties</h4>
+<h4 id="2-log4jproperties">2. log4j.properties</h4>
-<pre><code>#
+<div class="highlighter-rouge"><pre class="highlight"><code>#
# Security audit appender
#
hbase.security.log.file=SecurityAuth.audit
@@ -196,6 +197,7 @@ log4j.category.SecurityLogger=${hbase.se
log4j.additivity.SecurityLogger=false
log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE
</code></pre>
+</div>
<hr />
@@ -204,7 +206,7 @@ log4j.logger.SecurityLogger.org.apache.h
<div class="footnotes">
<ol>
<li id="fn:HBASE">
- <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/hbase-data-activity-monitoring.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/hbase-data-activity-monitoring.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/hbase-data-activity-monitoring.html (original)
+++ eagle/site/docs/hbase-data-activity-monitoring.html Thu Nov 23 15:39:02 2017
@@ -174,15 +174,16 @@
<ol>
<li>
- <p>edit Advanced hbase-log4j via Ambari<sup id="fnref:AMBARI"><a href="#fn:AMBARI" class="footnote">3</a></sup> UI, and append below sentence to <code>Security audit appender</code></p>
+ <p>edit Advanced hbase-log4j via Ambari<sup id="fnref:AMBARI"><a href="#fn:AMBARI" class="footnote">3</a></sup> UI, and append below sentence to <code class="highlighter-rouge">Security audit appender</code></p>
- <pre><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS
+ <div class="highlighter-rouge"><pre class="highlight"><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS
</code></pre>
+ </div>
</li>
<li>
<p>edit Advanced hbase-site.xml</p>
- <pre><code> <property>
+ <div class="highlighter-rouge"><pre class="highlight"><code> <property>
<name>hbase.security.authorization</name>
<value>true</value>
</property>
@@ -197,6 +198,7 @@
<value>org.apache.hadoop.hbase.security.access.AccessController</value>
</property>
</code></pre>
+ </div>
</li>
<li>
<p>Save and restart HBase</p>
@@ -208,21 +210,22 @@
<h3 id="how-to-add-a-kafka-log4j-appender">How to add a Kafka log4j appender</h3>
<blockquote>
- <p>Notice: if you are willing to use sample logs under <code>eagle-security-hbase-security/test/resources/securityAuditLog</code>, please skip this part.</p>
+ <p>Notice: if you are willing to use sample logs under <code class="highlighter-rouge">eagle-security-hbase-security/test/resources/securityAuditLog</code>, please skip this part.</p>
</blockquote>
<ol>
<li>
- <p>create Kafka topic <code>sandbox_hbase_security_log</code></p>
+ <p>create Kafka topic <code class="highlighter-rouge">sandbox_hbase_security_log</code></p>
- <pre><code> $ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hbase_security_log
+ <div class="highlighter-rouge"><pre class="highlight"><code> $ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hbase_security_log
</code></pre>
+ </div>
</li>
<li>
- <p>add below âKAFKA_HBASE_AUDITâ log4j appender to <code>Security audit appender</code>
+ <p>add below âKAFKA_HBASE_AUDITâ log4j appender to <code class="highlighter-rouge">Security audit appender</code>
Please refer to http://goeagle.io/docs/import-hdfs-auditLog.html.</p>
- <pre><code> log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <div class="highlighter-rouge"><pre class="highlight"><code> log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HBASE_AUDIT.Topic=sandbox_hbase_security_log
log4j.appender.KAFKA_HBASE_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HBASE_AUDIT.Layout=org.apache.log4j.PatternLayout
@@ -231,18 +234,21 @@ Please refer to http://goeagle.io/docs/i
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.GenericLogKeyer
log4j.appender.KAFKA_HDFS_AUDIT.KeyPattern=user=(\\w+),\\s+
</code></pre>
+ </div>
</li>
<li>
<p>add the reference to KAFKA_HBASE_AUDIT to log4j appender</p>
- <pre><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS,KAFKA_HBASE_AUDIT
+ <div class="highlighter-rouge"><pre class="highlight"><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS,KAFKA_HBASE_AUDIT
</code></pre>
+ </div>
</li>
<li>
<p>add Eagle log4j appender jars into HBASE_CLASSPATH BY editing Advanced hbase-env via Ambari UI</p>
- <pre><code> export HBASE_CLASSPATH=${HBASE_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
+ <div class="highlighter-rouge"><pre class="highlight"><code> export HBASE_CLASSPATH=${HBASE_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
</code></pre>
+ </div>
</li>
<li>
<p>Save and restart HBase</p>
@@ -253,32 +259,36 @@ Please refer to http://goeagle.io/docs/i
<ol>
<li>
- <p>create tables (<code>skip if you do not use hbase</code>)</p>
+ <p>create tables (<code class="highlighter-rouge">skip if you do not use hbase</code>)</p>
- <pre><code> bin/eagle-service-init.sh
+ <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-service-init.sh
</code></pre>
+ </div>
</li>
<li>
<p>start Eagle service</p>
- <pre><code> bin/eagle-service.sh start
+ <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-service.sh start
</code></pre>
+ </div>
</li>
<li>
<p>import metadata</p>
- <pre><code> bin/eagle-topology-init.sh
+ <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-topology-init.sh
</code></pre>
+ </div>
</li>
<li>
<p>submit topology</p>
- <pre><code> bin/eagle-topology.sh --main org.apache.eagle.security.hbase.HbaseAuditLogProcessorMain --config conf/sandbox-hbaseSecurityLog-application.conf start
+ <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-topology.sh --main org.apache.eagle.security.hbase.HbaseAuditLogProcessorMain --config conf/sandbox-hbaseSecurityLog-application.conf start
</code></pre>
+ </div>
</li>
</ol>
-<p>(sample sensitivity data at <code>examples/sample-sensitivity-resource-create.sh</code>)</p>
+<p>(sample sensitivity data at <code class="highlighter-rouge">examples/sample-sensitivity-resource-create.sh</code>)</p>
<h3 id="q--a">Q & A</h3>
@@ -293,13 +303,13 @@ Please refer to http://goeagle.io/docs/i
<div class="footnotes">
<ol>
<li id="fn:HBASE">
- <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p>
</li>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
<li id="fn:AMBARI">
- <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/hdfs-auth-activity-monitoring.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/hdfs-auth-activity-monitoring.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/hdfs-auth-activity-monitoring.html (original)
+++ eagle/site/docs/hdfs-auth-activity-monitoring.html Thu Nov 23 15:39:02 2017
@@ -160,23 +160,25 @@
<h4 id="sample-authorization-logs">Sample authorization logs</h4>
-<pre><code>2016-06-08 02:55:07,742 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hdfs (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.protocol.ClientProtocol
+<div class="highlighter-rouge"><pre class="highlight"><code>2016-06-08 02:55:07,742 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hdfs (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.protocol.ClientProtocol
2016-06-08 02:55:35,304 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hdfs (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.server.protocol.NamenodeProtocol
2016-06-08 02:55:36,862 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hive (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.protocol.ClientProtocol
</code></pre>
+</div>
<p>Steps for enabling service-level authorization activity</p>
-<h4 id="enable-hdfs-authorization-security-in-core-sitexml">1. Enable HDFS Authorization Security in core-site.xml</h4>
+<h4 id="1-enable-hdfs-authorization-security-in-core-sitexml">1. Enable HDFS Authorization Security in core-site.xml</h4>
-<pre><code> <property>
+<div class="highlighter-rouge"><pre class="highlight"><code> <property>
<name>hadoop.security.authorization</name>
<value>true</value>
</property>
</code></pre>
+</div>
-<h4 id="enable-hdfs-security-log-in-log4jproperties">2. Enable HDFS security log in log4j.properties</h4>
-<pre><code>#
+<h4 id="2-enable-hdfs-security-log-in-log4jproperties">2. Enable HDFS security log in log4j.properties</h4>
+<div class="highlighter-rouge"><pre class="highlight"><code>#
#Security audit appender
#
hadoop.security.logger=INFO,DRFAS
@@ -190,6 +192,7 @@ log4j.appender.DRFAS.layout=org.apache.l
log4j.appender.DRFAS.layout.ConversionPattern=%d{ISO8601} %p %c: %m%n
log4j.appender.DRFAS.DatePattern=.yyyy-MM-dd
</code></pre>
+</div>
</div><!--end of loadcontent-->
</div>
Modified: eagle/site/docs/hdfs-data-activity-monitoring.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/hdfs-data-activity-monitoring.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/hdfs-data-activity-monitoring.html (original)
+++ eagle/site/docs/hdfs-data-activity-monitoring.html Thu Nov 23 15:39:02 2017
@@ -181,7 +181,7 @@
<li>
<p><strong>Step 1</strong>: Configure Advanced hdfs-log4j via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a><sup id="fnref:AMBARI"><a href="#fn:AMBARI" class="footnote">2</a></sup>, by adding below âKAFKA_HDFS_AUDITâ log4j appender to hdfs audit logging.</p>
- <pre><code> log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <div class="highlighter-rouge"><pre class="highlight"><code> log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -189,22 +189,25 @@
log4j.appender.KAFKA_HDFS_AUDIT.Layout.ConversionPattern=%d{ISO8601} %p %c{2}: %m%n
log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 2</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p>
- <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, and append the following command to it.</p>
- <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
+ <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -223,10 +226,11 @@
<ul>
<li>
- <p><strong>Step 7</strong>: Check whether logs from â/var/log/hadoop/hdfs/hdfs-audit.logâ are flowing into topic <code>sandbox_hdfs_audit_log</code></p>
+ <p><strong>Step 7</strong>: Check whether logs from â/var/log/hadoop/hdfs/hdfs-audit.logâ are flowing into topic <code class="highlighter-rouge">sandbox_hdfs_audit_log</code></p>
- <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log
+ <div class="highlighter-rouge"><pre class="highlight"><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
</ul>
@@ -260,13 +264,13 @@
<div class="footnotes">
<ol>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
<li id="fn:AMBARI">
- <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
</li>
<li id="fn:STORM">
- <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
+ <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/hive-query-activity-monitoring.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/hive-query-activity-monitoring.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/hive-query-activity-monitoring.html (original)
+++ eagle/site/docs/hive-query-activity-monitoring.html Thu Nov 23 15:39:02 2017
@@ -187,12 +187,13 @@
</li>
</ul>
-<pre><code>$ su hive
+<div class="highlighter-rouge"><pre class="highlight"><code>$ su hive
$ hive
$ set hive.execution.engine=mr;
$ use xademo;
$ select a.phone_number from customer_details a, call_detail_records b where a.phone_number=b.phone_number;
</code></pre>
+</div>
<p>From UI click on alert tab and you should see alert for your attempt to read restricted column.</p>
@@ -203,7 +204,7 @@ $ select a.phone_number from customer_de
<div class="footnotes">
<ol>
<li id="fn:HIVE">
- <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/import-hdfs-auditLog.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/import-hdfs-auditLog.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/import-hdfs-auditLog.html (original)
+++ eagle/site/docs/import-hdfs-auditLog.html Thu Nov 23 15:39:02 2017
@@ -169,9 +169,10 @@ install a <strong>namenode log4j Kafka a
<p>Here is an sample Kafka command to create topic âsandbox_hdfs_audit_logâ</p>
- <pre><code>cd <kafka-home>
+ <div class="highlighter-rouge"><pre class="highlight"><code>cd <kafka-home>
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
<li>
<p><strong>Step 2</strong>: Install Logstash-kafka plugin</p>
@@ -189,7 +190,7 @@ bin/kafka-topics.sh --create --zookeeper
<li>
<p><strong>Step 3</strong>: Create a Logstash configuration file under ${LOGSTASH_HOME}/conf. Here is a sample.</p>
- <pre><code> input {
+ <div class="highlighter-rouge"><pre class="highlight"><code> input {
file {
type => "hdp-nn-audit"
path => "/path/to/audit.log"
@@ -230,15 +231,17 @@ bin/kafka-topics.sh --create --zookeeper
}
}
</code></pre>
+ </div>
</li>
<li>
<p><strong>Step 4</strong>: Start Logstash</p>
- <pre><code>bin/logstash -f conf/sample.conf
+ <div class="highlighter-rouge"><pre class="highlight"><code>bin/logstash -f conf/sample.conf
</code></pre>
+ </div>
</li>
<li>
- <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka topic specified by <code>topic_id</code></p>
+ <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka topic specified by <code class="highlighter-rouge">topic_id</code></p>
</li>
</ul>
@@ -252,14 +255,15 @@ bin/kafka-topics.sh --create --zookeeper
<li>
<p><strong>Step 1</strong>: Create a Kafka topic. Here is a example Kafka command for creating topic âsandbox_hdfs_audit_logâ</p>
- <pre><code>cd <kafka-home>
+ <div class="highlighter-rouge"><pre class="highlight"><code>cd <kafka-home>
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
<li>
<p><strong>Step 2</strong>: Configure $HADOOP_CONF_DIR/log4j.properties, and add a log4j appender âKAFKA_HDFS_AUDITâ to hdfs audit logging</p>
- <pre><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <div class="highlighter-rouge"><pre class="highlight"><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -269,22 +273,25 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
#log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=1
#log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=1
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p>
- <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 4</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and append the following command to it.</p>
- <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/*
+ <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/*
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -294,8 +301,9 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
<li>
<p><strong>Step 6</strong>: Check whether logs are flowing into Topic sandbox_hdfs_audit_log</p>
- <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
</ul>
@@ -306,10 +314,10 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
<div class="footnotes">
<ol>
<li id="fn:KAFKA">
- <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p>
</li>
<li id="fn:AMBARI">
- <p><em>all mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
+ <p><em>all mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>
Modified: eagle/site/docs/index.html
URL: http://svn.apache.org/viewvc/eagle/site/docs/index.html?rev=1816163&r1=1816162&r2=1816163&view=diff
==============================================================================
--- eagle/site/docs/index.html (original)
+++ eagle/site/docs/index.html Thu Nov 23 15:39:02 2017
@@ -204,13 +204,13 @@
<div class="footnotes">
<ol>
<li id="fn:HADOOP">
- <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p>
</li>
<li id="fn:SPARK">
- <p><em>All mentions of âsparkâ on this page represent Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âsparkâ on this page represent Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p>
</li>
<li id="fn:HIVE">
- <p><em>All mentions of âhiveâ on this page represent Apache HIVE.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
+ <p><em>All mentions of âhiveâ on this page represent Apache HIVE.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p>
</li>
</ol>
</div>